Fine-Tuning Pretrained Transformers — Roadmap Step & Resources
Adapting a large pretrained model to a specific downstream task
- Level: advanced
- Estimated time: 2 days
- Roadmap: Deep Learning & Neural Networks
Before this step
Mini projects
- Fine-tune a pretrained transformer for a custom text classification task
Study resources
- Fine-tuning a pretrained model (Article) — The official Hugging Face documentation's own guide to fine-tuning pretrained models.
- Fine-Tuning BERT Explained (Video) — A practical tutorial fine-tuning a pretrained Transformer for a downstream task.
Part of
- Transformers & Modern Architectures — section
- Deep Learning & Neural Networks roadmap — the full learning path