Final Exam: Apache Kafka

WHAT YOU WILL LEARN

• 

  Outline a use case for and the services offered by apache kafka
  

  recall why brokers, partitions, and replicas are used in kafka
  

  install and set up apache kafka
  

  produce and consume basic messages with a kafka topic
  

  provision a kafka environment with multiple brokers
  

  create and use topics with partitions and replicas
  

  recognize the use cases of consumer groups
  

  create and use a consumer group
  

  recognize the different options available to improve the performance of a kafka environment
  

  distinguish the different options available to improve the performance of a kafka environment
  

  configure kafka brokers using properties files
  

  enable and disable autogeneration of topics
  

  publish fake data on a kafka topic
  

  install and configure apache spark
  

  create a spark cluster with a master and worker
• 

  configure a spark cluster using the spark-env.sh file
  

  recall the architecture and features of apache spark
  

  execute spark commands and monitor jobs with the spark web ui
  

  distinguish between spark standalone and local deployment modes
  

  execute apps on a spark standalone cluster
  

  manipulate streaming data and publish the output to the console
  

  develop a spark application that publishes transformed data to a kafka topic
  

  describe what windows are in the context of spark streaming and define them using dataframes
  

  build a spark application that reads from a kafka topic
  

  subscribe to multiple kafka topics from a spark application
  

  control streaming data and publish the output to the console
  

  create a customer instance
  

  download and set up apache cassandra
  

  download and install the confluent platform
  

  describe how to use confluent to manage kafka