70 / 108 · 03 Agentic Testing Architectures · Production Test Harness Implementation← prev⊞ allnext →☰ Read as one page
9.5Harness Patterns for Different Test Types
Exploratory Test Harness (loose guardrails)
exploratory_config = HarnessConfig(
max_steps=50,
timeout_seconds=600, # 10 minutes
max_tokens=100_000,
allowed_domains=None, # Any domain
allowed_actions=None, # Any action
require_assertion=False, # Exploration may not assert
screenshot_on_failure=True,
)
CI Gate Harness (strict guardrails)
ci_config = HarnessConfig(
max_steps=20,
timeout_seconds=120, # 2 minutes
max_tokens=30_000,
allowed_domains=["staging.myapp.com"],
allowed_actions=["NAVIGATE", "CLICK", "TYPE", "ASSERT", "SCREENSHOT"],
require_assertion=True,
screenshot_on_failure=True,
)
Production Monitoring Harness (read-only)
monitoring_config = HarnessConfig(
max_steps=10,
timeout_seconds=60, # 1 minute
max_tokens=10_000,
allowed_domains=["app.mycompany.com"],
allowed_actions=["NAVIGATE", "ASSERT", "SCREENSHOT"], # No CLICK or TYPE
require_assertion=True,
screenshot_on_failure=True,
)