Combining Batch and Streaming (Lambda/Kappa Architecture) — Roadmap S…
Architectural patterns for unifying batch and real-time processing
- Level: beginner
- Estimated time: 1 days
- Roadmap: Big Data Processing & Lakehouse Engineering
Before this step
Interview questions
- How would you design a system that needs both real-time and historical batch views of the same data?
Study resources
- Databricks Documentation (Article) — Official documentation for the Databricks managed Spark and lakehouse platform. Background reading/viewing for: Combining Batch and Streaming (Lambda/Kappa Architecture).
- Apache Spark Documentation (Article) — Official documentation on Structured Streaming. Relevant to: Combining Batch and Streaming (Lambda/Kappa Architecture).
Part of
- Structured Streaming with Spark — section
- Big Data Processing & Lakehouse Engineering roadmap — the full learning path