HomeCoursesKafka Streams for Software Developers

4.8

Intermediate

Updated 3 months ago

Kafka Streams for Software Developers

Explore Kafka Streams for real-time data processing. Learn Kafka concepts, CLI tools, complex topologies, and Spring Boot integration to build scalable, resilient applications.

Join 2.7 million developers at

Overview

Content

Reviews

Kafka Streams is a Java library designed to develop applications and microservices tailored for real-time data stream processing. Harnessing Kafka’s capabilities, applications constructed using Kafka Streams exhibit exceptional scalability and fault tolerance. This versatile tool finds applications in various scenarios and domains. The course starts with an introduction to Kafka Streams. Next, you will learn important Kafka concepts and gain experience using Kafka CLI tools. Then, you will learn how to build complex Kafka Streams topologies using stateless operators, error handling, and stateful operations. Finally, you will learn how to integrate Kafka Streams in Spring Boot applications, including using Spring’s monitoring and metrics capabilities. After completing this course, you can build data-intensive real-time stream processing applications and microservices using Kafka Streams, enabling you to build powerful, resilient, and scalable products.

Kafka Streams is a Java library designed to develop applications and microservices tailored for real-time data stream processing...Show More

WHAT YOU'LL LEARN

An understanding of Apache Kafka concepts and CLI tools application

Hands-on experience building stateless and stateful topologies using Kafka Streams

Working knowledge of error handling in Kafka Streams applications

Familiarity with building Kafka Streams applications using Spring Boot

An understanding of Apache Kafka concepts and CLI tools application

Content

45 Lessons1 Project6 Quizzes

Kafka Streams Overview

5 Lessons

Get familiar with real-time data processing, Kafka Streams architecture, and practical applications.

Introduction to the Course

Introduction to Kafka Streams

Kafka Streams Topologies

Kafka Streams Hello World

Quiz: Basic Kafka Streams Concepts

Building Our Kafka Tool Belt

10 Lessons

Discover the logic behind essential Kafka tools, scripts, message handling, and partitioning.

First Steps with Kafka Scripts

Consuming and Producing Messages

Consuming and Producing Messages with Keys

Kafka Topic as a Log

Kafka Topic Partitions

Kafka Topic Partitions in Practice

Consumer Groups

The kafka-consumer-groups Command

What’s in Our Kafka Tool Belt: A Summary

Quiz: Kafka Concepts and Commands

Stateless Processing

10 Lessons

Work your way through stateless processing in Kafka Streams with setup, operations, and testing.

Stateless Processing Introduction

Setting Up the Project

Serialization and Deserialization

Merging and Adding a Sink Node

Testing Kafka Streams Topologies

Quiz: Stateless Processing

Error Handling

4 Lessons

Break down the steps to manage error handling in Kafka Streams applications effectively.

Error Handling in Kafka Streams: Overview

Deserialization Error Handling

Processor Error Handling

Quiz: Error Handling

Stateful Processing

7 Lessons

Dig into stateful processing, operations, windowing, and interactive queries in Kafka Streams.

Stateful Processing Basic Concepts

Kafka Streams Stateful Operations

Windowing: Tumbling and Hopping Windows

Windowing: Sliding and Session Windows

Interactive Queries

Interactive Queries: Remote Queries

Quiz: Stateful Processing

Setting up a Streaming Data Pipeline With Kafka

Project

Kafka Streams with Spring Boot

8 Lessons

Investigate integrating Kafka Streams with Spring Boot, including setup, topology, monitoring, and visualization.

Spring Boot: Motivation and Overview

Classic Integration: Project Setup

Classic Integration: Topology and State Store

Spring Cloud Stream: Setup and Configuration

Spring Cloud Stream: Topology and State Store

Kafka Streams Monitoring and Metrics with Spring Boot

Kafka Streams Topology Visualization

Quiz: Kafka Streams with Spring Boot

Build an Order Processing Kafka Streams Application

Project

Wrap Up

1 Lessons

Build on your knowledge of real-time stream processing and Kafka Streams integration.

Conclusion

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Stav Shamir

Developed by MAANG Engineers

Every Educative resource is designed by our team of ex-MAANG software engineers and PhD computer science educators — subject matter experts who’ve shipped production code at scale and taught the theory behind it. The goal is to get you hands-on with the skills you need to stay ahead in today's constantly evolving tech landscape. No videos, no fluff — just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Course

Building Scalable Data Pipelines with Kafka

Gain insights into Apache Kafka's role in scalable data pipelines. Explore its theory and practice interactive commands to build efficient and diverse data transmission solutions.

3 h

beginner

Course

Spring Data: Bridging Multiple Databases

Gain insights into integrating Spring Data with relational, NoSQL, graph, and distributed databases. Discover how to leverage Spring Data for seamless application and data service interactions.

23 h

intermediate

Course

REST APIs with Spring, JPA, and Springfox

Delve into creating REST APIs with Spring Framework, integrating databases with JPA, implementing Aspect-Oriented Programming, unit testing, and documenting with Springfox, and monitoring with Spring Boot Actuator.

23 h

advanced

Course

Java 8 for Experienced Developers: Lambdas, Stream API & Beyond

Gain insights into Java 8's new features: lambdas, Stream API, Functional Interfaces, Collections improvements, Memory Management, and Date & Time API to enhance productivity and code quality.

7 h

intermediate

Course

The Complete Guide to Spring 6 and Spring Boot 3

Gain insights into Spring 6 and Spring Boot 3, exploring dependency injection, Spring MVC, JDBC, and AOP. Discover how to create robust applications with inversion of control.

13 h 30 m

beginner

Course

Mastering Apache Kafka

Learn about Apache Kafka's architecture, client APIs, stream processing, and connectors. Build real-time data streaming and event-driven applications while exploring Kafka's ecosystem.

7 h

intermediate

Course

Building Scalable Data Pipelines with Kafka

beginner

3 hour

Course

Spring Data: Bridging Multiple Databases

intermediate

23 hour

Course

REST APIs with Spring, JPA, and Springfox