Apache Kafka: Integration with Spark

Kafka 2.1    |    Intermediate
  • 10 videos | 1h 2m 59s
  • Includes Assessment
  • Earns a Badge
Apache Kafka can easily integrate with Apache Spark to allow processing of the data entered into Kafka. Discover how to integrate Kafka with Spark.

WHAT YOU WILL LEARN

  • Install and configure the spark streaming package for kafka
    Read data into spark from kafka
    Read data in parallel into spark from kafka
    Write data back to kafka from spark
    Write data back to kafka from spark in parallel
  • Create a direct stream to access kafka data from spark
    Use locationstrategies and consumerstrategies to improve performance
    Use an rdd in cases where batch processing would be a better solution
    Use offsets to handle exactly-once semantics
    Use kafka and spark to split words from sentences

IN THIS COURSE

  • 3m 59s
  • 6m 25s
  • Locked
    3.  Reading Data from Kafka in Parallel
    3m 13s
  • Locked
    4.  Writing Data to Kafka
    6m 1s
  • Locked
    5.  Writing Data to Kafka in Parallel
    8m 34s
  • Locked
    6.  Creating a Direct Stream
    5m 43s
  • Locked
    7.  Planning for Location and Consumer Strategies
    4m 26s
  • Locked
    8.  Using an RDD
    5m 20s
  • Locked
    9.  Managing Offsets
    12m 28s
  • Locked
    10.  Creating a Kafka-Spark Word-splitting Application
    6m 50s

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Channel Apache Kafka
Course Working with Apache Cassandra: Getting Started
Course Processing Data: Using Kafka with Cassandra & Confluent

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course REST API with Java: Spring Boot with Java
Course Apache Kafka: Integration with Storm
Course Apache Kafka: Clustering