Monitoring Streaming Pipeline Health — Roadmap Step & Resources
Metrics specific to streaming: lag, throughput and processing latency
- Level: beginner
- Estimated time: 1 days
- Roadmap: Streaming & Real-Time Data Engineering
Before this step
Study resources
- Apache Flink Documentation (Article) — Official site and documentation for Apache Flink, a stream processing engine built for low-latency, stateful processing. Background reading/viewing for: Monitoring Streaming Pipeline Health.
- Confluent Documentation (Article) — Documentation from Confluent on monitoring Kafka-based pipelines. Relevant to: Monitoring Streaming Pipeline Health.
Part of
- Monitoring and Operating Streaming Systems — section
- Streaming & Real-Time Data Engineering roadmap — the full learning path