Data Quality Tests in Pipelines — Roadmap Step & Resources
Asserting things like uniqueness, non-null and referential integrity
- Level: beginner
- Estimated time: 1 days
- Roadmap: ETL/ELT Pipeline Engineering
Before this step
Study resources
- Apache Airflow Documentation (Article) — Official documentation for Apache Airflow, the most widely used pipeline orchestration tool. Background reading/viewing for: Data Quality Tests in Pipelines.
- dbt Documentation (Article) — Official documentation on testing data pipelines and transformations. Relevant to: Data Quality Tests in Pipelines.
Part of
- Testing Data Pipelines — section
- ETL/ELT Pipeline Engineering roadmap — the full learning path