Library › Book 26 › Flaky Tests and Magical Retries
Flaky Tests and Magical Retries
5.1🔒The Flaky Test EpidemicA flaky test is a test that sometimes passes and sometimes fails without any change to the code. It is the most corrosive problem in test…
5.2🔒Why Retry Is Not a SolutionThe most common response to flaky tests is automatic retry. The logic seems sound: if a test fails, run it again. If it passes on retry, it…
5.3🔒The Pattern: Deterministic DesignThe solution is not to tolerate flakiness or mask it with retries. It is to eliminate it through deterministic test design.
5.4🔒Building a Flakiness DashboardEliminating flakiness requires measurement. You cannot fix what you cannot see.
5.5🔒Career Translation- Reduced the CI flaky test rate from 11% to under 1% by replacing fixed waits with event-driven synchronization, isolating test data per…
5.6🔒Q&AInterview Depth CheckPrompt: A test passes nine times out of ten. Your team's policy is to retry once. What is wrong with this approach? What a strong answer…