Introduction to Streaming
Explore the essentials of streaming data and how it differs from batch processing. Understand stream processing techniques, real-time systems, and practical examples like fraud detection and stock monitoring to grasp how continuous data is managed and analyzed effectively.
We'll cover the following...
Overview
Streaming data is generated and delivered continuously, in a never-ending manner, and at a variable rate. It can be of two types: inbound or outbound.
The inbound streaming data could arrive so fast and be so massive in volume that it is futile, unworthy, or infeasible to store them. It is almost impossible to regulate structure, data integrity, or control the volume and velocity of the data generated.
That means our application needs to extract knowledge from the data as soon as it arrives. In other words, speed matters the most in big data streaming, because the value of data decreases with time if not processed quickly.
Stream processing
Stream processing is a technique used to process and analyze data in motion.
As the stream of data is ...