Modern QA2026Harness Patterns for Different Test Types — tiles
Log inJoin
70 / 108 · 03 Agentic Testing Architectures · Production Test Harness Implementation← prev⊞ allnext →☰ Read as one page

9.5Harness Patterns for Different Test Types

Exploratory Test Harness (loose guardrails)

exploratory_config = HarnessConfig(
    max_steps=50,
    timeout_seconds=600,          # 10 minutes
    max_tokens=100_000,
    allowed_domains=None,         # Any domain
    allowed_actions=None,         # Any action
    require_assertion=False,      # Exploration may not assert
    screenshot_on_failure=True,
)

CI Gate Harness (strict guardrails)

ci_config = HarnessConfig(
    max_steps=20,
    timeout_seconds=120,          # 2 minutes
    max_tokens=30_000,
    allowed_domains=["staging.myapp.com"],
    allowed_actions=["NAVIGATE", "CLICK", "TYPE", "ASSERT", "SCREENSHOT"],
    require_assertion=True,
    screenshot_on_failure=True,
)

Production Monitoring Harness (read-only)

monitoring_config = HarnessConfig(
    max_steps=10,
    timeout_seconds=60,           # 1 minute
    max_tokens=10_000,
    allowed_domains=["app.mycompany.com"],
    allowed_actions=["NAVIGATE", "ASSERT", "SCREENSHOT"],  # No CLICK or TYPE
    require_assertion=True,
    screenshot_on_failure=True,
)