5.3Presenting Test Coverage, Risk Areas, and Quality Trends
Test Coverage Visualization
Present coverage in terms stakeholders understand -- not lines of code, but features and user journeys.
FEATURE COVERAGE -- Sprint 47
User Registration ████████████████████ 100% (automated)
Login / Auth ████████████████████ 100% (automated)
Product Search ████████████████░░░░ 80% (sort/filter gaps)
Shopping Cart ████████████████████ 100% (automated)
Checkout ██████████████████░░ 90% (edge cases pending)
Order History ████████████████████ 100% (automated)
Partner API ████████████░░░░░░░░ 60% (fault handling gaps)
Admin Dashboard ████████░░░░░░░░░░░░ 40% (new, in progress)
This visualization tells stakeholders exactly where the safety net is strong and where the gaps are, without requiring them to understand code coverage tools.
Risk Heat Map
A risk heat map combines likelihood and impact to show where attention is needed:
Low Impact Medium Impact High Impact
┌─────────────┬───────────────┬──────────────┐
High │ │ Admin perf. │ Partner API │
Likelihood │ │ │ timeouts │
├─────────────┼───────────────┼──────────────┤
Medium │ Tooltip │ Search sort │ Checkout │
Likelihood │ formatting │ edge cases │ saved cards │
├─────────────┼───────────────┼──────────────┤
Low │ IE11 │ Timezone │ │
Likelihood │ rendering │ display │ │
└─────────────┴───────────────┴──────────────┘
The top-right corner gets attention. The bottom-left does not. This is exactly how executives think about risk.
Quality Trend Charts
Sprint-over-sprint trends are more valuable than point-in-time snapshots because they show direction.
Metrics to trend:
- Bugs found per sprint -- is the product getting more or less buggy?
- Escaped defects -- are fewer bugs reaching production over time?
- Automation coverage -- is the safety net growing?
- Test execution time -- is the feedback loop getting faster or slower?
- Flaky test rate -- is the test suite becoming more or less reliable?
Example trend narrative:
"Over the last 6 sprints, our escaped defect rate dropped from 12% to 4%. This correlates with two changes: we added automated smoke tests for the checkout flow in Sprint 43, and we started three amigos sessions in Sprint 44. The investment in shift-left practices is measurably reducing production incidents."