Gradient Descent for Regression — Roadmap Step & Resources
How regression coefficients are actually learned iteratively from data
- Level: intermediate
- Estimated time: 2 days
- Roadmap: Machine Learning
Before this step
Mini projects
- Implement linear regression with gradient descent from scratch using only NumPy
Study resources
- Gradient Descent, Step-by-Step (Video) — StatQuest's widely-loved, step-by-step explanation of gradient descent applied to regression.
- Stochastic Gradient Descent (Article) — The official scikit-learn documentation on gradient-descent-based linear models.
Part of
- Supervised Learning: Regression — section
- Machine Learning roadmap — the full learning path