35 / 87 · 02 AI-Augmented Test Design · The 10x Review Pattern← prev⊞ allnext →☰ Read as one page
6.5Quantifying Review Quality
Track these metrics over time to measure your review effectiveness:
| Metric | Target | How to Measure |
|---|---|---|
| Tests deleted during review | 10-20% | Count of deleted / total generated |
| Tests revised during review | 20-30% | Count of revised / total generated |
| Post-review test failures | < 5% | Tests that fail after review due to test bugs |
| Tautology rate | < 5% | Tests that pass even when the feature is broken |
| Mutation score | > 70% | Run mutmut/mutpy and measure surviving mutants |
If your deletion rate is consistently above 30%, your prompts need improvement. If it is consistently below 10%, you might be accepting too many weak tests.