runbooks validation benchmarkΒΆ
Auto-generated from
runbooks validation benchmark --helpon 2026-05-21. Source of truth: runbooks PyPI package v1.3.22
Usage: runbooks validation benchmark [OPTIONS]
Run performance benchmark for MCP validation framework with universal
profile support.
Benchmark Features: β’ Comprehensive performance testing across all
operations β’ Configurable accuracy targets and iteration counts β’ Multi-
account benchmarking with --all flag β’ Statistical analysis with confidence
intervals β’ Enterprise readiness assessment
Examples: runbooks validation benchmark --target-accuracy 99.0
--iterations 10 runbooks validation benchmark --performance-target 20
runbooks validation benchmark --all --iterations 3 # Multi-account
benchmark
Options:
--profile TEXT AWS profile for single-account operations.
π Profile Selection Guide:
βββββββββββββββββββββββββββββββββββββββββββββββ
Single Account β Use --profile YOUR_PROFILE
Example: --profile dev-account When:
Developer/operator working in one AWS account
Multi-Account LZ β Use --all-profiles (see
inventory commands) Example: --all-profiles
When: Platform team discovering across
organization
π Enrichment Profiles (Automatic): β’
Organizations: MANAGEMENT_PROFILE β’ Costs:
BILLING_PROFILE Note: Separate from discovery
profile
Decision: Single account = --profile | Multi-
account = --all-profiles
--region TEXT AWS region override (default: ap-southeast-2)
--dry-run Safe analysis mode - no resource modifications
(enterprise default)
--target-accuracy FLOAT Target accuracy percentage
--iterations INTEGER Number of benchmark iterations
--performance-target FLOAT Performance target in seconds
--all Use all available AWS profiles for multi-account
benchmarking
--help Show this message and exit.