Skip to content

runbooks validation benchmarkΒΆ

Auto-generated from runbooks validation benchmark --help on 2026-05-21. Source of truth: runbooks PyPI package v1.3.22

Usage: runbooks validation benchmark [OPTIONS]

  Run performance benchmark for MCP validation framework with universal
  profile support.

  Benchmark Features: β€’ Comprehensive performance testing across all
  operations β€’ Configurable accuracy targets and iteration counts β€’ Multi-
  account benchmarking with --all flag β€’ Statistical analysis with confidence
  intervals β€’ Enterprise readiness assessment

  Examples:     runbooks validation benchmark --target-accuracy 99.0
  --iterations 10     runbooks validation benchmark --performance-target 20
  runbooks validation benchmark --all --iterations 3  # Multi-account
  benchmark

Options:
  --profile TEXT              AWS profile for single-account operations.

                              πŸ“‹ Profile Selection Guide:
                              ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

                              Single Account β†’ Use --profile YOUR_PROFILE
                              Example: --profile dev-account   When:
                              Developer/operator working in one AWS account

                              Multi-Account LZ β†’ Use --all-profiles (see
                              inventory commands)   Example: --all-profiles
                              When: Platform team discovering across
                              organization

                              πŸ” Enrichment Profiles (Automatic):   β€’
                              Organizations: MANAGEMENT_PROFILE   β€’ Costs:
                              BILLING_PROFILE   Note: Separate from discovery
                              profile

                              Decision: Single account = --profile | Multi-
                              account = --all-profiles
  --region TEXT               AWS region override (default: ap-southeast-2)
  --dry-run                   Safe analysis mode - no resource modifications
                              (enterprise default)
  --target-accuracy FLOAT     Target accuracy percentage
  --iterations INTEGER        Number of benchmark iterations
  --performance-target FLOAT  Performance target in seconds
  --all                       Use all available AWS profiles for multi-account
                              benchmarking
  --help                      Show this message and exit.

ExamplesΒΆ