Apache Kafka: Integration with Spark

Kafka 2.1
  • 10 Videos | 1h 7m 59s
  • Includes Assessment
  • Earns a Badge
Likes 16 Likes 16
Apache Kafka can easily integrate with Apache Spark to allow processing of the data entered into Kafka. Discover how to integrate Kafka with Spark.

WHAT YOU WILL LEARN

  • install and configure the Spark Streaming package for Kafka
    read data into Spark from Kafka
    read data in parallel into Spark from Kafka
    write data back to Kafka from Spark
    write data back to Kafka from Spark in parallel
  • create a direct stream to access Kafka data from Spark
    use LocationStrategies and ConsumerStrategies to improve performance
    use an RDD in cases where batch processing would be a better solution
    use offsets to handle exactly-once semantics
    use Kafka and Spark to split words from sentences

IN THIS COURSE

  • Playable
    1. 
    Configuring Spark and Kafka
    3m 59s
    UP NEXT
  • Playable
    2. 
    Reading Data from Kafka
    6m 25s
  • Locked
    3. 
    Reading Data from Kafka in Parallel
    3m 13s
  • Locked
    4. 
    Writing Data to Kafka
    6m 1s
  • Locked
    5. 
    Writing Data to Kafka in Parallel
    8m 34s
  • Locked
    6. 
    Creating a Direct Stream
    5m 43s
  • Locked
    7. 
    Planning for Location and Consumer Strategies
    4m 26s
  • Locked
    8. 
    Using an RDD
    5m 20s
  • Locked
    9. 
    Managing Offsets
    12m 28s
  • Locked
    10. 
    Creating a Kafka-Spark Word-splitting Application
    6m 50s

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

CHANNEL Apache Spark
Likes 72 Likes 72  
Likes 4 Likes 4  

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Likes 244 Likes 244  
Likes 56 Likes 56  
Likes 66 Likes 66