Apache Kafka: Integration with Spark
Kafka 2.1
10 Videos | 1h 7m 59s - Includes Assessment
- Earns a Badge
Apache Kafka can easily integrate with Apache Spark to allow processing of the data entered into Kafka. Discover how to integrate Kafka with Spark.
WHAT YOU WILL LEARN
-
install and configure the Spark Streaming package for Kafka
read data into Spark from Kafka
read data in parallel into Spark from Kafka
write data back to Kafka from Spark
write data back to Kafka from Spark in parallel -
create a direct stream to access Kafka data from Spark
use LocationStrategies and ConsumerStrategies to improve performance
use an RDD in cases where batch processing would be a better solution
use offsets to handle exactly-once semantics
use Kafka and Spark to split words from sentences
IN THIS COURSE
-
1.Configuring Spark and Kafka3m 59sUP NEXT
-
2.Reading Data from Kafka6m 25s
-
3.Reading Data from Kafka in Parallel3m 13s
-
4.Writing Data to Kafka6m 1s
-
5.Writing Data to Kafka in Parallel8m 34s
-
6.Creating a Direct Stream5m 43s
-
7.Planning for Location and Consumer Strategies4m 26s
-
8.Using an RDD5m 20s
-
9.Managing Offsets12m 28s
-
10.Creating a Kafka-Spark Word-splitting Application6m 50s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform
Digital badges are yours to keep, forever.
