File Formats and Serialization — ETL/ELT Pipeline Engineering Roadmap
Choosing the right shape for data at rest
Steps in File Formats and Serialization
- Common Data Serialization Formats — beginner · CSV, JSON, Avro, Parquet and when each makes sense
- Columnar vs Row-Based Storage — beginner · Why Parquet outperforms CSV for analytical workloads
- Schema Evolution in File Formats — beginner · Handling new or changed fields without breaking downstream pipelines
- Compression Trade-offs — beginner · Balancing file size against read/write performance
- Choosing a Format for a Given Pipeline — beginner · Matching format choice to the pipeline's actual access patterns
Part of
- ETL/ELT Pipeline Engineering roadmap — the full learning path