Case Study: Building a Production Ingestion Pipeline — Roadmap Step &…
Taking a pipeline from design through monitoring and on-call readiness
- Level: beginner
- Estimated time: 1 days
- Roadmap: ETL/ELT Pipeline Engineering
Before this step
Mini projects
- Build a complete ELT pipeline with incremental loading, testing and failure alerting
Study resources
- Apache Airflow Documentation (Article) — Official documentation for Apache Airflow, the most widely used pipeline orchestration tool. Background reading/viewing for: Case Study: Building a Production Ingestion Pipeline.
- freeCodeCamp (Video) — freeCodeCamp's full data engineering course, useful for portfolio-building projects. Relevant to: Case Study: Building a Production Ingestion Pipeline.
Part of
- Career and Capstone — section
- ETL/ELT Pipeline Engineering roadmap — the full learning path