Batch Normalization & Layer Normalization — Roadmap Step & Resources
Normalizing activations during training to stabilize and speed up learning
- Level: intermediate
- Estimated time: 1 days
- Roadmap: Deep Learning & Neural Networks
Before this step
Interview questions
- Why does batch normalization behave differently at training time vs inference time?
Study resources
- Batch Normalization, Clearly Explained!!! (Video) — StatQuest's widely-loved explanation of batch normalization.
- torch.nn.BatchNorm2d (Article) — The official PyTorch documentation for batch normalization layers.
Part of
- Training Deep Neural Networks — section
- Deep Learning & Neural Networks roadmap — the full learning path