Spark Monitoring & Tuning

Apache Spark 2.2    |    Intermediate
  • 14 Videos | 55m 53s
  • Includes Assessment
  • Earns a Badge
Likes 18 Likes 18
Explore various ways to monitor Spark applications such as web UIs, metrics, and other monitoring tools, and examine memory tuning.

WHAT YOU WILL LEARN

  • access the web user interface
    use the Spark environment configuration parameters
    use JSON to query monitoring tools for Spark
    set JVM fractional memory amounts for Spark
    modify speculation controls for Spark tasks
    describe data serialization and the role it plays in the performance of Spark applications
    describe memory management and consumption
  • determine executor memory allocation
    describe garbage collection tuning
    set the level of parallelism
    use the broadcast functionality
    use query execution plan explainer
    implement data compression on parquet storage
    monitor Spark applications

IN THIS COURSE

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Likes 14 Likes 14  
CHANNEL Justinmind
Likes 3 Likes 3  
Likes 24 Likes 24  

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Likes 193 Likes 193  
Likes 40 Likes 40  
Likes 30 Likes 30