Choosing a Format for a Given Pipeline — Roadmap Step & Resources
Matching format choice to the pipeline's actual access patterns
- Level: beginner
- Estimated time: 1 days
- Roadmap: ETL/ELT Pipeline Engineering
Before this step
Study resources
- Apache Airflow Documentation (Article) — Official documentation for Apache Airflow, the most widely used pipeline orchestration tool. Background reading/viewing for: Choosing a Format for a Given Pipeline.
- freeCodeCamp (Video) — freeCodeCamp's data engineering course covers file formats and serialization. Relevant to: Choosing a Format for a Given Pipeline.
Part of
- File Formats and Serialization — section
- ETL/ELT Pipeline Engineering roadmap — the full learning path