45 / 87 · 02 AI-Augmented Test Design · Common AI Test Failures← prev⊞ allnext →☰ Read as one page
7.8Failure Mode Summary Table
| Failure Mode | Detection Speed | Frequency | Severity |
|---|---|---|---|
| Tautology | Medium (requires tracing) | 15-20% of AI tests | High |
| Happy path only | Fast (count error tests) | 30-40% of AI suites | High |
| Overly specific | Fast (look for literals) | 10-15% of AI tests | Medium |
| Hallucinated API | Medium (requires grep) | 5-10% of AI tests | Critical |
| Non-deterministic | Slow (appears as flakiness) | 5-10% of AI tests | High |
| Assertion-free | Fast (automated check) | 5-8% of AI tests | Critical |