Apache Kafka: Integration with Spark
Kafka 2.1
| Intermediate
- 10 Videos | 1h 2m 59s
- Includes Assessment
- Earns a Badge
Apache Kafka can easily integrate with Apache Spark to allow processing of the data entered into Kafka. Discover how to integrate Kafka with Spark.
WHAT YOU WILL LEARN
-
install and configure the Spark Streaming package for Kafkaread data into Spark from Kafkaread data in parallel into Spark from Kafkawrite data back to Kafka from Sparkwrite data back to Kafka from Spark in parallel
-
create a direct stream to access Kafka data from Sparkuse LocationStrategies and ConsumerStrategies to improve performanceuse an RDD in cases where batch processing would be a better solutionuse offsets to handle exactly-once semanticsuse Kafka and Spark to split words from sentences
IN THIS COURSE
-
1.Configuring Spark and Kafka3m 59sUP NEXT
-
2.Reading Data from Kafka6m 25s
-
3.Reading Data from Kafka in Parallel3m 13s
-
4.Writing Data to Kafka6m 1s
-
5.Writing Data to Kafka in Parallel8m 34s
-
6.Creating a Direct Stream5m 43s
-
7.Planning for Location and Consumer Strategies4m 26s
-
8.Using an RDD5m 20s
-
9.Managing Offsets12m 28s
-
10.Creating a Kafka-Spark Word-splitting Application6m 50s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform
Digital badges are yours to keep, forever.