Gradient Descent Variants — Study Resources & PYQs
Curated resources, past papers and PYQs for Gradient Descent Variants.
Study resources
- Stochastic Gradient Descent, Clearly Explained!!! (Video) — StatQuest's widely-loved explanation of SGD and mini-batch gradient descent.
- Algorithms for Optimization (Article) — The official PyTorch documentation's reference for SGD, Adam and other optimizers.