Unbalanced Capacities

Learn about missed match ratios, simultaneous calls to the scheduling system, front-end and back-end load capacities, Circuit Breaker, and backpressure.

Mismatched ratios

Whether our resources take months, weeks, or seconds to provision, we can end up with mismatched ratios between different layers. That makes it possible for one tier or service to flood another with requests beyond its capacity. This especially holds when we deal with calls to rate-limited or throttled APIs.

In the illustration below, the front-end service has 3,000 request-handling threads available. During peak usage, the majority of these will be serving product catalog pages or search results. Some smaller numbers will be in various corporate “telling” pages and a few will be involved in a checkout process.

Get hands-on with 1200+ tech skills courses.