Driver, Executors and Cluster Architecture — Roadmap Step & Resources
How the pieces of a running Spark application fit together
- Level: beginner
- Estimated time: 1 days
- Roadmap: Big Data Processing & Lakehouse Engineering
Before this step
Study resources
- Apache Spark Documentation (Article) — Official documentation for Apache Spark, covering core concepts, SQL, and structured streaming. Background reading/viewing for: Driver, Executors and Cluster Architecture.
- freeCodeCamp (Video) — freeCodeCamp's data engineering course covers Spark architecture. Relevant to: Driver, Executors and Cluster Architecture.
Part of
- Spark Architecture and Execution — section
- Big Data Processing & Lakehouse Engineering roadmap — the full learning path