Fine-Tuning vs Prompt Engineering — Roadmap Step & Resources
When adjusting weights beats adjusting instructions
- Level: beginner
- Estimated time: 1 days
- Roadmap: Fine-Tuning & Model Customization
Before this step
Study resources
- Hugging Face Documentation (Article) — Official documentation covering Transformers, PEFT, and fine-tuning workflows for open-weight models. Background reading/viewing for: Fine-Tuning vs Prompt Engineering.
- OpenAI API Documentation (Article) — OpenAI's official documentation, including guidance on when to fine-tune. Relevant to: Fine-Tuning vs Prompt Engineering.
Part of
- When to Fine-Tune vs Prompt vs RAG — section
- Fine-Tuning & Model Customization roadmap — the full learning path