Streaming Data Architectures: An Introduction to Streaming Data in Spark
Data Science
| Intermediate
- 9 Videos | 50m 9s
- Includes Assessment
- Earns a Badge
Learn the fundamentals of streaming data with Apache Spark. During this course, you will discover the differences between batch and streaming data. Observe the types of streaming data sources. Learn about how to process streaming data, transform the stream, and materialize the results. Decouple a streaming application from the data sources with a message transport. Next, learn about techniques used in Spark 1.x to work with streaming data and how it contrasts with processing batch data; how structured streaming in Spark 2.x is able to ease the task of stream processing for the app developer; and how streaming processing works in both Spark 1.x and 2.x. Finally, learn how triggers can be set up to periodically process streaming data; and the key aspects of working with structured streaming in Spark
WHAT YOU WILL LEARN
-
recognize the differences between batch and streaming data and the types of streaming data sourceslist the steps in involved in processing streaming data, the transformation of streams, and the materialization of the results of the transformationdescribe how the use of a message transport decouples a streaming application from the sources of streaming datadescribe the techniques used in Spark 1.x to work with streaming data and how it contrasts with processing batch data
-
recall how structured streaming in Spark 2.x is able to ease the task of stream processing for the app developercompare how streaming processing works in both Spark 1.x and 2.xrecognize how triggers can be set up to periodically process streaming data and describe the various output modes available to publish the results of stream processingrecognize the key aspects of working with structured streaming in Spark
IN THIS COURSE
-
1.Course Overview2m 29sUP NEXT
-
2.Introduction to Streaming data7m 18s
-
3.The Stream Processing Model3m 57s
-
4.The Message Transport4m 57s
-
5.Stream Processing with RDDs6m 19s
-
6.Structured Streaming for Continuous Applications6m 3s
-
7.Streaming vs Structured Streaming4m 37s
-
8.Triggers and Output Modes7m 21s
-
9.Exercise: Working with Streaming Data7m 7s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform
Digital badges are yours to keep, forever.