Working with Spark Using HDInsight & Cluster Management
Apache Hadoop
| Intermediate
- 12 videos | 55m 12s
- Includes Assessment
- Earns a Badge
Discover how to work with Spark and its in-memory capabilities of data management. How to manage and troubleshoot HDInsight clusters using Ambari and the Azure CLI tool is also covered.
WHAT YOU WILL LEARN
-
Specify the essential capabilities of spark and its essential architectural components
List the data structures along with the rdd and lineage concepts that are used in spark
Set up spark clusters using powershell and azure resource manager template
Describe the relationship between spark sql and hive
Specify the essential concepts of spark sql and dataframe
Demonstrate the approach of customizing hdinsight clusters using bootstrap -
Install hadoop applications on azure hdinsight
Illustrate the usage of ambari as a tool in order to manage clusters
Manage hadoop clusters in hdinsight using azure cli
Specify the approach of troubleshooting and tuning hdinsight clusters
Monitor hadoop clusters in hdinsight to collect metrics for analysis
Set up spark clusters and manage the clusters using ambari gui
IN THIS COURSE
-
6m 11sAfter completing this video, you will be able to specify the essential capabilities of Spark and its essential architectural components. FREE ACCESS
-
5m 47sUpon completion of this video, you will be able to list the data structures, along with the RDD and lineage concepts, that are used in Spark. FREE ACCESS
-
3. Create Spark Clusters Using PowerShell3m 52sDuring this video, you will learn how to set up Spark clusters using PowerShell and Azure Resource Manager templates. FREE ACCESS
-
4. Spark SQL and Hive3m 29sAfter completing this video, you will be able to describe the relationship between Spark SQL and Hive. FREE ACCESS
-
5. Spark SQL Data Sources and DataFrames4m 8sUpon completion of this video, you will be able to specify the essential concepts of Spark SQL and DataFrames. FREE ACCESS
-
6. Customizing HDInsight Cluster4m 42sLearn about the approach of customizing HDInsight clusters using a bootstrap. FREE ACCESS
-
7. Application Installation on HDInsight3m 13sDuring this video, you will learn how to install Hadoop applications on Azure HDInsight. FREE ACCESS
-
8. Ambari User Management6m 26sUpon completion of this video, you will be able to illustrate the usage of Ambari as a tool for managing clusters. FREE ACCESS
-
9. HDInsight Management Using Azure CLI3m 11sFind out how to manage Hadoop clusters in HDInsight using the Azure CLI. FREE ACCESS
-
10. Troubleshooting HDInsight3m 20sAfter completing this video, you will be able to specify the approach for troubleshooting and tuning HDInsight clusters. FREE ACCESS
-
11. Monitoring HDInsight Hadoop6m 30sDuring this video, you will learn how to monitor Hadoop clusters in HDInsight to collect metrics for analysis. FREE ACCESS
-
12. Exercise: Working with Spark and Ambari4m 26sIn this video, find out how to set up Spark clusters and manage the clusters using the Ambari GUI. FREE ACCESS
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.
