Testing Like a Senior
The QA Engineer's Field Manual: Patterns and Anti-Patterns in Software QA
Career-level skill (progressive). See the master guide for context.
The Arc of a QA Career
Every QA career follows a trajectory. You begin by understanding the system. Then you write tests. Then you build automation systems. Then you manage risk. Then you shape architecture. Eventually, you build organizations where quality emerges without your direct involvement.
At each level, your leverage increases. The junior engineer writes code; the senior engineer designs systems; the principal engineer shapes the organization. This book maps that entire journey — from your first two weeks on the job to the strategic decisions that define QA leadership — through the lens of patterns (what works) and anti-patterns (what wastes time, burns trust, or silently damages quality).
The uncomfortable truth about QA: the end goal is not to build the perfect test suite. It is to make the test suite unnecessary — to build systems so well-designed, so well-monitored, and so well-governed that quality is inevitable rather than inspected.
Topics Covered
Level 0. Entry Shock — 01-entry-shock/
- The First Two Weeks — System reconnaissance, social architecture mapping, AI-assisted codebase digestion, and the 30-day assessment document that builds your reputation from day one
Level 1. Test Executor — 02-test-executor/
- Authentication and Navigation Patterns — The Login Page Lie (why UI login in every test is an anti-pattern), API-level authentication, saved browser state, Page Object Model as behaviors not selectors, the Service Layer pattern
- Assertions and Flaky Tests — Diagnostic-first assertions, soft assertions, custom assertion helpers, flaky test root causes (timing, shared state, external dependencies), deterministic test design
Level 2. Automation Engineer — 03-automation-engineer/
- Test Suites and CI/CD — Tiered execution (smoke, PR, nightly, specialized), impact-based test selection, pipeline speed/information/trust, fail-fast strategies, parallelization
- Reporting and API Testing — Self-diagnosing failures, audience-specific reports (developer, QA, product, leadership), API contract validation, schema testing, negative testing, auth boundary testing
Level 3. Quality Engineer — 04-quality-engineer/
- Risk-Based Strategy and Metrics — Risk matrix (business impact x failure likelihood), failure history analysis, vanity metrics vs outcome metrics (escaped defects, MTTR, signal-to-noise ratio, change failure rate)
- Dashboards and Release Decisions — Four dashboards for four audiences, dashboard as communication tool, release blocking criteria, escalation frameworks, political navigation
Level 4. Systems Thinker — 05-systems-thinker/
- Testability and Test Curation — Testability as a design principle (dependency injection, observability, determinism), killing bad tests (tautological, duplicate, implementation-detail, permanently skipped), cost-value analysis
- Scaling and Organizational Quality — QA guilds, standards governance, internal testing frameworks, flaky tests as organizational smell (architecture signal, process signal, leadership signal)
Level 5. QA Leader — 06-qa-leader/
- Strategic QA and Platforms — Repositioning QA from cost center to strategic asset, aligning quality with revenue, the strategic QA roadmap, building internal QA platforms (framework vs platform distinction), versioning and multi-team support
- Career Growth and Visibility — Conference speaking as career accelerator, impact-driven resume writing, making invisible work visible, performance reviews for systems builders, the impact log
Advanced. Advanced Topics — 07-advanced-topics/
- AI in Testing — What AI does well (codebase analysis, test generation from specs, selector healing, coverage gap detection), what it does not (replacing QA judgment, understanding user intent), the pragmatic approach
- The Future of QA Engineering — From test executor to quality systems engineer, skills increasing/stable/decreasing in importance, testing as a career of increasing leverage
How to Use This Chapter
Each career level builds on the previous one. If you are early in your career, start at Level 0 and read forward — the patterns at each level prepare you for the challenges at the next. If you are a senior engineer, skip to the level that matches your current challenges and read the anti-patterns — you will likely recognize problems you have seen but could not name.
The anti-pattern / pattern structure throughout this chapter is deliberate. Anti-patterns are common, reasonable-seeming approaches that produce poor results at scale. Patterns are their replacements — approaches that experienced QA engineers have converged on through hard-won experience.
The Leverage Curve
| Career Level | Focus | Leverage |
|---|---|---|
| Level 0 — Entry Shock | Understanding the system | Learning |
| Level 1 — Test Executor | Writing reliable tests | 1:1 (each test catches one bug) |
| Level 2 — Automation Engineer | Building automation systems | 1:many (framework catches hundreds) |
| Level 3 — Quality Engineer | Managing risk | Beyond testing (influences priorities) |
| Level 4 — Systems Thinker | Shaping architecture | Preventive (eliminates bug categories) |
| Level 5 — QA Leader | Building organizations | Organizational (quality emerges) |