Design of a Distributed Messaging Queue: Part 1
Define a high-level design for a fault-tolerant distributed messaging queue. Describe the role of the load balancer and stateless frontends, including request deduplication. Explain how to scale queue metadata with sharding and replication to improve availability and performance.
We'll cover the following...
We have discussed the requirements and design considerations. Now, let’s examine the high-level design of a distributed messaging queue.
Distributed messaging queue
Unlike a single-server queue, a distributed queue runs across multiple servers. This adds operational complexity but addresses the scalability and fault-tolerance limitations of a single-node design. The next sections explain how the architecture achieves scalability, availability, and durability using replication and fault-tolerant design patterns.
High-level design
To simplify the design discussion, we assume the following:
Replication: Queue data is replicated within a cluster using primary-secondary or quorum-like systems (see data replication). If a queue exceeds single-server capacity, we ...