Spark Monitoring & Tuning
Apache Spark 2.2
| Intermediate
- 14 Videos | 49m 23s
- Includes Assessment
- Earns a Badge
Explore various ways to monitor Spark applications such as web UIs, metrics, and other monitoring tools, and examine memory tuning.
WHAT YOU WILL LEARN
-
access the web user interfaceuse the Spark environment configuration parametersuse JSON to query monitoring tools for Sparkset JVM fractional memory amounts for Sparkmodify speculation controls for Spark tasksdescribe data serialization and the role it plays in the performance of Spark applicationsdescribe memory management and consumption
-
determine executor memory allocationdescribe garbage collection tuningset the level of parallelismuse the broadcast functionalityuse query execution plan explainerimplement data compression on parquet storagemonitor Spark applications
IN THIS COURSE
-
1.Web UI5m 24sUP NEXT
-
2.Environment Configuration3m 19s
-
3.REST API4m 14s
-
4.Memory Allocation2m 14s
-
5.Speculation2m 34s
-
6.Serialization2m 30s
-
7.Memory Tuning2m 33s
-
8.Executor Memory3m 3s
-
9.Garbage Collection Tuning2m 31s
-
10.Parallelism2m 5s
-
11.Broadcast Functionality4m
-
12.Explain Query Execution6m 39s
-
13.Data Compression4m 29s
-
14.Exercise: Monitor Spark Applications3m 50s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform
Digital badges are yours to keep, forever.