Memory Management Internals — Roadmap Step & Resources
How Spark divides memory between execution and storage
- Level: beginner
- Estimated time: 1 days
- Roadmap: Big Data Processing & Lakehouse Engineering
Before this step
Study resources
- Databricks Documentation (Article) — Official documentation for the Databricks managed Spark and lakehouse platform. Background reading/viewing for: Memory Management Internals.
- Apache Spark Documentation (Article) — Official documentation on caching and persistence. Relevant to: Memory Management Internals.
Part of
- Caching and Memory Management — section
- Big Data Processing & Lakehouse Engineering roadmap — the full learning path