Quality
All articles
20 total
System Evaluation New
Testing an AI model plus everything around it - retrieval, prompts, …
Added 29 Jun
·
Upd 29 Jun
·5 min
What is Testing? New
Testing is checking that software works the way it should before real …
Basics
Added 15 Jun
·
Upd 15 Jun
·4 min
AI-Adapted Test Pyramid
The testing pyramid adapted for AI systems: unit tests for deterministic …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Amazon Lookout for Vision
Visual Anomaly Detection
Models
Added 28 Mar
·
Upd 14 Jun
·7 min
CMMI
Capability Maturity Model Integration
Glossary
Added 28 Mar
·
Upd 30 May
·2 min
Code Review Practices for ML Codebases
Practical guide to code review for ML projects, covering what to look …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
End-to-End Testing
What end-to-end testing is, how browser automation validates full-stack …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Evaluator-Optimizer Pattern
Automated evaluation loops where one model generates output and another …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Flaky Test
What flaky tests are, why they are especially common in AI systems, and …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Integration Testing
What integration testing is, how it verifies component interactions, and …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
LLM Evaluation Methods
Measuring Language Model Quality
Guides
Added 28 Mar
·
Upd 30 May
·7 min
Mocking
Test doubles for AI systems: mocks, stubs, fakes, and spies explained, …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Property-Based Testing
What property-based testing is, why it is ideal for AI systems that …
Glossary
Added 25 Mar
·
Upd 30 May
·4 min
RAG Evaluation
Methods and metrics for measuring the quality of Retrieval Augmented …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Reflection Pattern
Self-Critique and Iterative Refinement for LLMs
Patterns
Added 28 Mar
·
Upd 30 May
·4 min
Snapshot Testing
What snapshot testing is, how it captures and compares output snapshots …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Test Fixture
What test fixtures are, how they provide predefined data and state for …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Test-Driven Development
The TDD red-green-refactor cycle and how it applies to AI application …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Unit Testing
What unit testing is, how isolation and test doubles work, and assertion …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Unit Testing AI Applications
How to unit test AI codebases effectively: testing prompt templates, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Open source projects