Modern QA2026Future Directions: Where AI-Driven Testing Is Heading
Log inJoin

Course01 Agent Skills for Browser Automation⊞ Tile viewNew!

Cutting-edge · Chapter 01

Future Directions: Where AI-Driven Testing Is Heading

Updated Aug 2026

Revised July 2026. It's worth keeping score: of the January 2026 edition's "near-term" predictions, first-party test agents and CLI-skills-as-standard already shipped; AI locators arrived in several forms; persistent app memory has not. Predictions below carry that calibration.

Already Arrived (2026 — no longer "future")

First-Party Test Agents

Playwright's planner / generator / healer shipped (v1.56+) and matured through 1.61. The plan → generate → heal loop is now the reference workflow, portable across agent runtimes via init-agents. Cypress answered with cy.prompt() natural-language authoring in v15. The commercial platforms (testRigor, mabl, KaneAI, Applitools, Testim, Functionize) all market the same shape as "agentic execution."

What's still open: review discipline. The tooling generates; the industry is still working out how teams review, own, and version agent-generated suites without drowning.

AI-Powered Locators

Arrived from several directions at once:

  • Intent APIs — Stagehand's act("click the submit button") resolves natural language to actions per-run
  • Snapshot refs — Playwright CLI's YAML snapshots address elements by role/name, no CSS authoring
  • Momentic-style intent-based locators resolved at runtime in commercial tools
  • Appium's Inspector now suggests locators with AI assistance on mobile

The #1 maintenance burden — hand-authored CSS selectors — is genuinely dissolving. Ambiguity handling ("the button" when there are five) remains the weak spot across all of them.

Network Interception via Standards

The BiDi network module is real: WebDriver BiDi now covers ~70% of the CDP surface across Chrome and Firefox. On the Playwright side, HAR capture folded into tracing (v1.60), making network evidence a default artifact of every agent run.

Near-Term (2026-2027)

Application Memory — the Open Frontier

What: A persistent model of the application — pages, flows, elements — that survives across agent sessions.

Why it matters: Today's agents rediscover your app every session. That's the single biggest economic inefficiency left in agent-driven testing: exploration tokens are spent re-learning what was known yesterday.

Who's building it: Vibium's Cortex (SQLite + sqlite-vec embeddings, graph pathfinding — "how do I get from login to settings?") is the clearest public articulation, still roadmap as of V1. Expect the major players to ship some form of app-map memory; whoever does it well changes the cost curve of exploratory agent testing.

Watch for: pathfinding across app graphs, automatic drift detection ("this page had 5 buttons, now 4"), and memory invalidation strategy (the hard part — stale memory is worse than no memory).

Passive Observation / Session Mining

Recording human sessions (Vibium's planned Retina extension; Meticulous and Checksum already mine session recordings commercially) to generate test scenarios from real user behavior. The privacy and data-governance questions are as hard as the technology.

Shared Browser Instances Between Humans, Agents, and Runners

Playwright's browser.bind() (v1.59) points the direction: the agent watches a human click through a flow (Screencast API), then acts in the same session. Expect "pair-testing with an agent" to become a normal workflow.

Medium-Term (2027-2028)

Autonomous Test Generation at Suite Scale

The agent explores the application and grows the test suite with minimal human scenario-writing. OpenObserve's "Council of Sub-Agents" (8 specialized agents, suite grown from 380 to 700+ tests) was the early production example; Playwright's planner is the commoditized single-agent version. The multi-agent orchestration patterns are covered in the Agentic Testing Architectures topic.

Impact: QA engineers shift from writing tests to reviewing and curating AI-generated tests — and to designing the constraints that keep generation honest.

Full Cross-Browser BiDi

Chrome and Firefox are done; Edge rides Chromium; Safari remains the laggard with partial support. When Safari completes BiDi — and when Selenium 5 ships its high-level BiDi APIs — "one protocol, every browser" stops being aspirational.

Long-Term (2028+)

Self-Writing Test Suites

The AI continuously monitors the application, detects changes, generates tests, runs them, and reports issues — with humans reviewing rather than authoring:

Application updated →
  Agent detects changes →
    Agent generates new tests →
      Agent runs all tests →
        Agent reports issues →
          Developer fixes bugs → (repeat)

Visual Testing at Scale

Vision models comparing screenshots across versions, browsers, and devices. Frontier models handle this well already; per-look cost and latency still gate suite-wide use. As on-device and small vision models improve, expect visual assertion to become as cheap as text assertion.

Test-Driven Development with AI

Developer describes a feature → agent generates the test plan → agent generates the code → healer iterates until green → human reviews both. Already partially real with today's coding agents; the missing piece is trust infrastructure (evals, review gates), not capability.

Industry Convergence Points

Protocol: BiDi Won the Argument

2023: Puppeteer adds BiDi ───────────────────┐
2024: Selenium 4 low-level BiDi ─────────────┤
2025: Vibium launches BiDi-native ───────────┤── W3C WebDriver BiDi
2026: WebdriverIO v9 defaults to BiDi ───────┤   (the present tense)
20??: Selenium 5 high-level BiDi APIs ───────┘

Interface: Skills Became the Standard

2025: Agent Skills concept introduced ─────────┐
2025: Vibium's vibe-check skill (the pioneer) ─┤
2025-26: Skills Directory, cross-agent ────────┤── SKILL.md as de facto
2026: Playwright CLI ships --skills ───────────┤   agent interface
2026: Microsoft recommends CLI over MCP ───────┘

Intelligence: From Scripts to Reasoning

2004: Scripts ─────────────────────────────┐
2015: Page Objects ────────────────────────┤
2020: Self-healing (rule-based) ───────────┤── Testing intelligence
2025: Agent reasoning (LLM-based) ─────────┤   spectrum
2026: First-party test agents shipped ─────┤
2027+: Autonomous generation at scale ─────┘

What This Means for Your Career

Skills to Develop

  1. AI agent architectures — ReAct patterns, multi-agent systems, tool use
  2. Testing AI systems themselves — LLM evals (Ragas, TruLens, OpenAI Evals), RAG metrics, MCP/A2A flow testing; this is now explicit in QA job postings
  3. Prompt/plan engineering for testing — writing effective specs and skill files
  4. WebDriver BiDi protocol — the technical standard underneath
  5. Token economics — understanding and optimizing AI costs as a first-class quality metric
  6. CI/CD for AI workflows — running agent-driven tests in pipelines, reviewing healer patches

Skills That Are Declining

  1. Manual selector management — refs, intents, and AI locators replaced it
  2. Explicit wait strategies — actionability checks handle this
  3. Page Object boilerplate — plans + seed tests replace class hierarchies
  4. Browser-specific workarounds — BiDi standardization eliminates these

The QA Engineer of 2028

Instead of writing and maintaining test scripts, you'll:

  • Define testing intent in natural language
  • Curate AI-generated test suites and review healer patches
  • Design evals for the AI features your product ships
  • Manage AI test infrastructure costs
  • Design test strategies that agents can execute
  • Interpret AI-generated failure analysis

The job title might change from "QA Automation Engineer" to "AI Test Architect" or "Test Intelligence Engineer."

Interview Talking Point

"The industry converged on three things faster than most people predicted: WebDriver BiDi as the protocol, CLI skills as the agent interface — Microsoft shipping --skills on the Playwright CLI settled that — and LLM reasoning as the intelligence layer, now productized as Playwright's planner, generator, and healer agents. The open frontier I'm watching is persistent application memory: agents still rediscover the app every session, and whoever ships a reliable app-map — Vibium's Cortex is the clearest public design — changes the economics of exploratory testing. Our role is evolving from writing tests to architecting the AI systems that generate, execute, and maintain them — and to testing the AI systems our own products ship, which is where evals come in."