Inter-Rater Reliability — Roadmap Step & Resources
Making sure human evaluators agree closely enough to trust the results
- Level: beginner
- Estimated time: 1 days
- Roadmap: Prompt Engineering & Evaluation
Before this step
Study resources
- Anthropic Prompt Engineering Guide (Article) — Anthropic's official, systematic guide to prompt engineering techniques for Claude. Background reading/viewing for: Inter-Rater Reliability.
- Prompt Engineering Guide (Article) — A widely used independent guide covering evaluation methodology. Relevant to: Inter-Rater Reliability.
Part of
- Evaluation Methodology Fundamentals — section
- Prompt Engineering & Evaluation roadmap — the full learning path