Scaling Stream Processing Jobs — Roadmap Step & Resources
Adjusting parallelism as data volume increases
- Level: beginner
- Estimated time: 1 days
- Roadmap: Streaming & Real-Time Data Engineering
Before this step
Study resources
- Apache Flink Documentation (Article) — Official site and documentation for Apache Flink, a stream processing engine built for low-latency, stateful processing. Background reading/viewing for: Scaling Stream Processing Jobs.
- Confluent Documentation (Article) — Documentation from Confluent on scaling Kafka clusters. Relevant to: Scaling Stream Processing Jobs.
Part of
- Scaling Streaming Infrastructure — section
- Streaming & Real-Time Data Engineering roadmap — the full learning path