Working with Spark Using HDInsight & Cluster Management

Apache Hadoop 2.7    |    Intermediate
  • 12 videos | 55m 12s
  • Includes Assessment
  • Earns a Badge
Likes 4 Likes 4
Discover how to work with Spark and its in-memory capabilities of data management. How to manage and troubleshoot HDInsight clusters using Ambari and the Azure CLI tool is also covered.

WHAT YOU WILL LEARN

  • specify the essential capabilities of Spark and its essential architectural components
    list the data structures along with the RDD and lineage concepts that are used in Spark
    set up Spark clusters using PowerShell and Azure Resource Manager template
    describe the relationship between Spark SQL and Hive
    specify the essential concepts of Spark SQL and DataFrame
    demonstrate the approach of customizing HDInsight clusters using bootstrap
  • install Hadoop applications on Azure HDInsight
    illustrate the usage of Ambari as a tool in order to manage clusters
    manage Hadoop clusters in HDInsight using Azure CLI
    specify the approach of troubleshooting and tuning HDInsight clusters
    monitor Hadoop clusters in HDInsight to collect metrics for analysis
    set up Spark clusters and manage the clusters using Ambari GUI

IN THIS COURSE

  • 6m 11s
  • 5m 47s
  • Locked
    3.  Create Spark Clusters Using PowerShell
    3m 52s
  • Locked
    4.  Spark SQL and Hive
    3m 29s
  • Locked
    5.  Spark SQL Data Sources and DataFrames
    4m 8s
  • Locked
    6.  Customizing HDInsight Cluster
    4m 42s
  • Locked
    7.  Application Installation on HDInsight
    3m 13s
  • Locked
    8.  Ambari User Management
    6m 26s
  • Locked
    9.  HDInsight Management Using Azure CLI
    3m 11s
  • Locked
    10.  Troubleshooting HDInsight
    3m 20s
  • Locked
    11.  Monitoring HDInsight Hadoop
    6m 30s
  • Locked
    12.  Exercise: Working with Spark and Ambari
    4m 26s

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Channel Apache Spark
Likes 107 Likes 107  
Book The Azure Data Lakehouse Toolkit: Building and Scaling Data Lakehouses on Azure with Delta Lake, Apache Spark, Databricks, Synapse Analytics, and Snowflake
Course Microsoft Azure DevOps Solutions: Introducing Azure DevOps