System Design: Rate Limiter

What is a rate limiter?

Rate limiter, as the name suggests, puts a limit on the number of requests a service fulfills. It throttles those requests that cross the predefined limit. For example, a client using a particular service’s API that is configured to allow 500 requests per minute would block further incoming requests for the client if the number of requests the client makes exceeds that limit.