Design of a Rate Limiter
Discover the detailed System Design required to build a highly available rate limiter. Learn how to structure components such as the decision-maker and the cache to manage traffic and mitigate race conditions. Implement online and offline updates to ensure low latency and system stability.
We'll cover the following...
We'll cover the following...
High-level design
A rate limiter is a dedicated service that sits between the client and the web server. It evaluates incoming requests against defined rules to decide whether to forward them to the server or block them. The figure below illustrates this interaction. Lyft’s rate-limiting service provides a practical example of how these rules are structured.