Spark Monitoring & Tuning
Apache Spark 2.2
| Intermediate
- 14 videos | 49m 23s
- Includes Assessment
- Earns a Badge
Explore various ways to monitor Spark applications such as web UIs, metrics, and other monitoring tools, and examine memory tuning.
WHAT YOU WILL LEARN
-
access the web user interface
use the Spark environment configuration parameters
use JSON to query monitoring tools for Spark
set JVM fractional memory amounts for Spark
modify speculation controls for Spark tasks
describe data serialization and the role it plays in the performance of Spark applications
describe memory management and consumption -
determine executor memory allocation
describe garbage collection tuning
set the level of parallelism
use the broadcast functionality
use query execution plan explainer
implement data compression on parquet storage
monitor Spark applications
IN THIS COURSE
-
1. Web UI5m 24s
-
2. Environment Configuration3m 19s
-
3. REST API4m 14s
-
4. Memory Allocation2m 14s
-
5. Speculation2m 34s
-
6. Serialization2m 30s
-
7. Memory Tuning2m 33s
-
8. Executor Memory3m 3s
-
9. Garbage Collection Tuning2m 31s
-
10. Parallelism2m 5s
-
11. Broadcast Functionality4m
-
12. Explain Query Execution6m 39s
-
13. Data Compression4m 29s
-
14. Exercise: Monitor Spark Applications3m 50s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.
