Career and Capstone — Prompt Engineering & Evaluation Roadmap
Turning prompt engineering skill into a job-ready profile
Steps in Career and Capstone
- LLM Application Developer Career Paths — beginner · How this role compares to traditional software and ML engineering roles
- Prompt Engineer Career Paths — beginner · How this specialization fits within broader AI engineering roles
- LLMOps Engineer Career Paths — beginner · How this specialization fits within platform, SRE and ML engineering tracks
- RAG Engineer Career Paths — beginner · How this specialization fits within broader AI engineering roles
- Fine-Tuning Engineer Career Paths — beginner · How this specialization fits within broader ML and AI engineering roles
- AI Agent Developer Career Paths — beginner · How this specialization fits within broader AI engineering roles
- Breaking Into LLM Application Development — beginner · Common paths in from web development, backend engineering or data roles
- Breaking Into Prompt Engineering and Evaluation — beginner · Common paths in from writing, QA, data science or software roles
- Breaking Into LLMOps — beginner · Common paths in from DevOps, SRE or MLOps roles
- Breaking Into Model Fine-Tuning Work — beginner · Common paths in from ML engineering, research or data science roles
- Breaking Into Agent Development — beginner · Common paths in from software engineering, ML or automation roles
- Breaking Into RAG and Retrieval Engineering — beginner · Common paths in from search engineering, data engineering or ML roles
- Resume and Interview Prep for LLM App Developers — beginner · Preparing for take-home projects and system design interviews
- Resume and Interview Prep for Agent Developers — beginner · Preparing for system design interviews focused on agentic systems
- Resume and Interview Prep for Prompt Engineering Roles — beginner · Preparing for practical prompt design and evaluation exercises
- Resume and Interview Prep for LLMOps Roles — beginner · Preparing for reliability and infrastructure-focused interviews
- Resume and Interview Prep for RAG Engineers — beginner · Preparing for retrieval system design interviews
- Resume and Interview Prep for Fine-Tuning Roles — beginner · Preparing for technical training and evaluation-focused interviews
- Case Study: Fine-Tuning for a Production Use Case — beginner · Taking a fine-tuning project from data collection to deployed model
- Case Study: Building a Production Copilot Feature — beginner · Taking a copilot-style feature from prototype to shipped product
- Case Study: Operationalizing an AI Feature at Scale — beginner · Taking a prototype AI feature through a full production hardening process
- Case Study: Improving a Production Prompt Through Testing — beginner · Taking a real prompt from inconsistent to reliable through systematic testing
- Case Study: Building a Production Coding Agent — beginner · Taking an agent from prototype to a reliable, deployed tool
- Case Study: Building an Internal Knowledge Assistant — beginner · Taking a RAG-based internal tool from prototype to production
- Staying Current with Training Techniques — beginner · Following a fast-evolving area of applied ML research
- Staying Current as Models and Techniques Evolve — beginner · Why prompting techniques that worked on one model generation may not transfer
- Staying Current as Models and Tools Evolve — beginner · Keeping skills relevant in a fast-moving ecosystem
- Staying Current in a Fast-Moving Field — beginner · Following agent architecture research and tooling as it evolves rapidly
- Staying Current with LLMOps Tooling — beginner · Following a rapidly evolving tooling and practices landscape
- Staying Current with Retrieval Research — beginner · Following a fast-moving area of applied research
- Capstone: Build a Complete Prompt Evaluation System — beginner · A full pipeline covering test design, automated and human evaluation, and optimization
- Capstone: Ship a Production RAG System — beginner · A complete system covering ingestion, retrieval, grounding and evaluation
- Capstone: Build a Production LLMOps Platform — beginner · A complete operational stack covering deployment, monitoring, evaluation and cost control
- Capstone: Ship a Production-Ready LLM Application — beginner · A complete application covering architecture, testing, security and deployment
- Capstone: Fine-Tune and Ship a Custom Model — beginner · A complete project covering data, training, evaluation, compression and deployment
- Capstone: Ship a Production Multi-Agent System — beginner · A complete system covering orchestration, guardrails, evaluation and deployment
Part of
- Prompt Engineering & Evaluation roadmap — the full learning path