Incremental Loading and CDC — ETL/ELT Pipeline Engineering Roadmap
Processing only what's new or changed
Steps in Incremental Loading and CDC
- Incremental Loading Fundamentals — beginner · Processing only what's new or changed since the last run
- Change Data Capture (CDC) Patterns — beginner · Timestamp-based, log-based and trigger-based CDC compared
- Watermarking and High-Water Marks — beginner · Tracking exactly how far a pipeline has processed
- Handling Out-of-Order and Late Changes — beginner · Keeping incremental pipelines correct despite real-world messiness
- CDC Tooling (Debezium and Alternatives) — beginner · Popular tools for log-based change data capture
Part of
- ETL/ELT Pipeline Engineering roadmap — the full learning path