Watermarking and High-Water Marks — Roadmap Step & Resources
Tracking exactly how far a pipeline has processed
- Level: beginner
- Estimated time: 1 days
- Roadmap: ETL/ELT Pipeline Engineering
Before this step
Study resources
- dbt Documentation (Article) — Official documentation for dbt, covering transformation, testing and project structure. Background reading/viewing for: Watermarking and High-Water Marks.
- Airbyte Documentation (Article) — Official documentation on incremental sync and change data capture. Relevant to: Watermarking and High-Water Marks.
Part of
- Incremental Loading and CDC — section
- ETL/ELT Pipeline Engineering roadmap — the full learning path