38 / 87 · 02 AI-Augmented Test Design · Common AI Test Failures← prev⊞ allnext →☰ Read as one page
7.1Why AI-Generated Tests Fail
AI-generated tests fail in predictable ways. Understanding these failure modes lets you spot them instantly during review, rather than discovering them later in CI or -- worse -- in production when the test passes despite a real bug.
These failure modes are not random. They emerge from how LLMs work: they predict statistically likely text, not logically correct code. This means they produce patterns that look like tests but do not function as tests.