A/B Testing Infrastructure for AI Features — Roadmap Step & Resources
Building the plumbing needed to safely experiment with AI changes
- Level: beginner
- Estimated time: 1 days
- Roadmap: LLMOps & AI Infrastructure
Before this step
Study resources
- Anthropic API Documentation (Article) — Anthropic's official documentation, including administration, monitoring and usage/cost APIs. Background reading/viewing for: A/B Testing Infrastructure for AI Features.
- Google Cloud Vertex AI Documentation (Article) — Google Cloud's official documentation relevant to experimentation infrastructure. Relevant to: A/B Testing Infrastructure for AI Features.
Part of
- A/B Testing and Experimentation Infrastructure — section
- LLMOps & AI Infrastructure roadmap — the full learning path