5.5Handling Questions About Bugs Found in Production
When a stakeholder asks "Why did this bug make it to production?", they are rarely asking a technical question. They are asking: "Can I trust the QA process?"
Response Framework
Step 1: Acknowledge without defensiveness.
"That's a valid question. Let me walk through what happened."
Step 2: Explain the specific gap.
"This bug was in the interaction between the discount engine and the tax calculator. Our test suite covers each independently, but this specific combination was not in our test matrix."
Step 3: Show what you have done about it.
"We have added 8 integration tests covering discount-plus-tax combinations. We also updated our test design process to include combinatorial analysis for features that interact with pricing."
Step 4: Show the systemic improvement.
"Our escaped defect rate is trending down -- from 12% to 4% over the last 6 sprints. This specific bug prompted the improvement that will prevent similar issues going forward."
What Not to Do
- Do not blame the developer who wrote the code
- Do not say "we tested everything we could" -- it sounds like you are making excuses
- Do not promise it will never happen again -- that is not credible
- Do not minimize the impact -- acknowledge it honestly