Logging pipeline. Buffer and sampling
Collecting the logs of 3,000 services: a buffer so agents lose nothing when the index falls behind, and sampling when the storm outlasts the buffer.
- System Design — Load balancers, caches, queues and regions: build a system that holds the load