runbooks validation test

Auto-generated from runbooks validation test --help on 2026-05-21. Source of truth: runbooks PyPI package v1.3.22

Usage: runbooks validation test [OPTIONS]

  Comprehensive test command integration for Sprint 1 validation framework.

  STRATEGIC CONTEXT: Enterprise framework requires `/test` command validation
  with ≥99.5% MCP validation accuracy for ALL deployments before completion
  claims.

  Test Framework Features: • Real AWS profile testing across all resolution
  scenarios • MCP validation testing with configurable accuracy targets • CLI
  parameter testing for all command combinations • Evidence generation testing
  for manager reports • Performance testing with enterprise targets (<30s
  analysis time)

  Test Types: • basic: Core functionality and CLI integration • profile-tests:
  All AWS profile resolution scenarios • mcp-validation: MCP accuracy
  validation ≥99.5% • full-validation: Comprehensive end-to-end testing

  Examples:     # Test finops ec2-snapshots with basic validation     runbooks
  validation test --module finops --component ec2-snapshots --test-type basic

      # Test profile resolution scenarios     runbooks validation test
      --module finops --component ec2-snapshots --test-type profile-tests

      # Test MCP validation accuracy     runbooks validation test --module
      finops --component ec2-snapshots --test-type mcp-validation --accuracy-
      target 99.5

      # Full validation with evidence generation     runbooks validation test
      --module finops --component ec2-snapshots --test-type full-validation
      --generate-evidence --export-results

      # Performance testing     runbooks validation test --module finops
      --component ec2-snapshots --test-type basic --performance-target 20

  Sprint 1 Context:     Required for Sprint 1, Task 1 completion validation
  ensuring all identified     issues are fixed and comprehensive evidence
  generated for manager review.

Options:
  --profile TEXT                  AWS profile for single-account operations.

                                  📋 Profile Selection Guide: ━━━━━━━━━━━━━━━━━
                                  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

                                  Single Account → Use --profile YOUR_PROFILE
                                  Example: --profile dev-account   When:
                                  Developer/operator working in one AWS
                                  account

                                  Multi-Account LZ → Use --all-profiles (see
                                  inventory commands)   Example: --all-
                                  profiles   When: Platform team discovering
                                  across organization

                                  🔐 Enrichment Profiles (Automatic):   •
                                  Organizations: MANAGEMENT_PROFILE   • Costs:
                                  BILLING_PROFILE   Note: Separate from
                                  discovery profile

                                  Decision: Single account = --profile |
                                  Multi-account = --all-profiles
  --region TEXT                   AWS region override (default: ap-
                                  southeast-2)
  --dry-run                       Safe analysis mode - no resource
                                  modifications (enterprise default)
  --module [finops|inventory|security|vpc|cfat|operate]
                                  Module to test  [required]
  --component TEXT                Specific component within module (e.g.,
                                  'ec2-snapshots' for finops module)
  --test-type [basic|profile-tests|mcp-validation|full-validation]
                                  Type of testing to perform
  --performance-target FLOAT      Performance target in seconds
  --accuracy-target FLOAT         MCP validation accuracy target percentage
  --generate-evidence             Generate comprehensive evidence reports for
                                  manager review
  --export-results                Export test results to JSON file
  --help                          Show this message and exit.

Examples