Knowledge Distillation — Study Resources & PYQs
Curated resources, past papers and PYQs for Knowledge Distillation.
Study resources
- Knowledge Distillation Tutorial (Article) — The official PyTorch tutorial on training a smaller student model from a larger teacher.
- Knowledge Distillation Explained (Video) — A practical explanation of compressing a model via teacher-student training.