Designing for Reprocessing and Backfills — Roadmap Step & Resources
Building pipelines that can safely re-run over historical data
- Level: beginner
- Estimated time: 1 days
- Roadmap: ETL/ELT Pipeline Engineering
Before this step
Study resources
- dbt Documentation (Article) — Official documentation for dbt, covering transformation, testing and project structure. Background reading/viewing for: Designing for Reprocessing and Backfills.
- freeCodeCamp (Video) — freeCodeCamp's data engineering course covers pipeline architecture patterns. Relevant to: Designing for Reprocessing and Backfills.
Part of
- Pipeline Design Patterns — section
- ETL/ELT Pipeline Engineering roadmap — the full learning path