Rate limiter. Protection from overload

A rate limiter in front of the load balancer: a fast 429 instead of overload, per-client limits, backpressure and retries without a storm.

System Design — Load balancers, caches, queues and regions: build a system that holds the load