Replication
Explore Kafka replication to grasp how leader and follower replicas work together to maintain data availability and durability within scalable distributed systems. Learn about in-sync and out-of-sync replicas, leader election, and configurations affecting replica synchronization.
We'll cover the following...
Replication is one of the cornerstone features of Kafka. It is the mechanism that allows Kafka to advertise availability and durability in the face of inevitable individual node failures. Kafka has topics, which consist of partitions and these partitions have replicas of themselves hosted on different brokers. Generally, each broker has several hundred or thousand partitions hosted at any given time.
When designing distributed systems, creating a replica of a data store or data structure can help increase the availability of the system. Yet at the same time, it introduces the challenge of keeping the replicas in-sync. Replicas can also be introduced in places where the read volume is very high and a ...