Designing Logging and Aggregation System

In a large system, important sub-services (like web layer, app layer, etc.) continuously produce diagnostic data in the form of local logs. Different monitoring services need to consume this huge data for timely alerts.

The key observation here is that producers and consumers of data might be working. at different speeds, and might be active at different times. We need to decouple producers and consumers of the data so that they could work asynchronously.