Atlas › 22 Test Strategy & Quality Metrics › Test Automation Strategy☰ Read as one page
Test Automation Strategy
3.1Automate the Right Things for the Right ReasonsTest automation is not a goal. It is a tool. The goal is fast, reliable feedback about software quality. Automation serves that goal when…3.2What to Automate vs What to Keep ManualFor each test scenario, evaluate it against four criteria:3.3ROI Calculation for Test AutomationScenario: Automating the checkout regression suite (25 test cases)3.4Selecting Automation ToolsRate each tool on a 1-5 scale for each criterion. Multiply by the weight for your context.3.5Building vs Buying Test Infrastructure- Your testing needs are unique to your domain (custom hardware, proprietary protocols) - Existing tools cannot integrate with your…3.6Automation Maintenance: The Hidden CostFor every hour spent writing automation, budget 0.3-0.5 hours per year for maintenance. A suite of 500 automated tests written over 2 years…3.7The 80/20 Rule Applied to Test Automation80% of the automation value comes from 20% of the tests. Identify that 20% and invest heavily in their reliability and maintenance.3.8Common Automation Strategy MistakesSymptom: Test automation starts before the feature is stable. Tests break every sprint as the feature evolves.3.9Hands-On Exercise1. List your top 20 test scenarios by business risk. How many are automated? This is your automation coverage for the things that matter…