Search⌘ K
AI Features

Spark Streaming

Explore how Spark Structured Streaming facilitates scalable real-time data processing for machine learning pipelines. Understand reading from Kafka, applying transformations with Spark SQL and DataFrame APIs, and writing outputs to streaming platforms like PubSub and Kinesis. Gain skills to build low-latency streaming model workflows for production environments.

We'll cover the following...

Structured streaming

Streaming datasets have been supported in Spark since version 0.7, but it was not until version 2.3 ...

Spark