Structured Streaming

Apache Spark    |    Intermediate
  • 12 videos | 1h 5m 24s
  • Includes Assessment
  • Earns a Badge
Rating 5.0 of 4 users Rating 5.0 of 4 users (4)
Discover the concepts of Structured Steaming such as Windowing, DataFrame, and SQL Operations, and explore File Sinks, Deduplication, and Checkpointing.

WHAT YOU WILL LEARN

  • Describe structured streaming
    Read stream input using readstream
    Write stream data using writestream
    Apply window operations on event time
    Describe continuous applications in terms of structured streaming
    Implement deduplication with and without watermarking
  • Store stream output to a directory using a file sink
    Use streaming query objects
    Manage streaming queries
    Enable checkpointing in structured streaming
    Use structured streaming to implement a word count on a text stream
    Describe the basics of spark streaming

IN THIS COURSE

  • 4m 53s
    Upon completion of this video, you will be able to describe Structured Streaming. FREE ACCESS
  • 7m 7s
    In this video, learn how to read stream input using the readStream function. FREE ACCESS
  • Locked
    3.  Stream Output
    4m 29s
    In this video, find out how to write stream data using the writeStream function. FREE ACCESS
  • Locked
    4.  Windowing
    7m 43s
    In this video, learn how to apply window operations to event time. FREE ACCESS
  • Locked
    5.  Continuous Applications
    4m 1s
    Upon completion of this video, you will be able to describe continuous applications as structured streaming. FREE ACCESS
  • Locked
    6.  Deduplication
    6m 4s
    In this video, you will learn how to implement deduplication with and without watermarks. FREE ACCESS
  • Locked
    7.  File Sinks
    4m 46s
    In this video, you will learn how to store stream output to a directory using a file sink. FREE ACCESS
  • Locked
    8.  Streaming Query
    4m 27s
    Find out how to use streaming query objects. FREE ACCESS
  • Locked
    9.  Streaming Query Manager
    6m 20s
    In this video, you will learn how to manage streaming queries. FREE ACCESS
  • Locked
    10.  Checkpointing
    5m 37s
    During this video, you will learn how to enable checkpointing for structured streaming. FREE ACCESS
  • Locked
    11.  Word Count
    5m 8s
    During this video, you will learn how to use structured streaming to implement a word count on a text stream. FREE ACCESS
  • Locked
    12.  Exercise: Identify Spark Streaming Basics
    4m 50s
    Upon completion of this video, you will be able to describe the basics of Spark Streaming. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Data Analysis using Spark SQL
Rating 4.5 of 35 users Rating 4.5 of 35 users (35)
Course Graph Modeling on Apache Spark: Working with Apache Spark GraphFrames
Rating 4.7 of 24 users Rating 4.7 of 24 users (24)
Channel RavenDB

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course Data Analysis using Spark SQL
Rating 4.5 of 35 users Rating 4.5 of 35 users (35)
Course Data Analysis Using the Spark DataFrame API
Rating 4.7 of 31 users Rating 4.7 of 31 users (31)
Course Apache Kafka: Concepts & Components
Rating 4.3 of 152 users Rating 4.3 of 152 users (152)