Vector Calculus for Backpropagation — Roadmap Step & Resources
Jacobians and gradients of matrix operations used when differentiating through layers
- Level: beginner
- Estimated time: 2 days
- Roadmap: Deep Learning & Neural Networks
Before this step
Study resources
- Backpropagation calculus | Deep learning, chapter 4 (Video) — 3Blue1Brown's precise, symbol-heavy walkthrough connecting calculus to backpropagation.
- But what is backpropagation really doing? | Deep learning chapter 3 (Video) — 3Blue1Brown's intuitive explanation preceding the more formal calculus treatment.
Part of
- Mathematics for Deep Learning — section
- Deep Learning & Neural Networks roadmap — the full learning path