Uploaded image for project: 'Red Hat Advanced Cluster Management'
  1. Red Hat Advanced Cluster Management
  2. ACM-25282

Global Hub 1.6.0 Regression Testing(used to test jira tools)

XMLWordPrintable

    • Global Hub 1.6.0 Regression Test Plan
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • False
    • Not Selected
    • To Do
    • 100% To Do, 0% In Progress, 0% Done

      Global Hub 1.6.0 Comprehensive Regression Testing

      Execute comprehensive regression testing for Global Hub 1.6.0 across 13 test scenarios covering multiple test phases and environment configurations.

      Test Matrix Overview

      • Release: Global Hub 1.6.0
      • Reference Epic: ACM-25266 (completed)
      • Matrix File: glo_test_matrix.csv
      • Total Scenarios: 13

      Supported Versions

      • ACM Versions: 2.13, 2.14, 2.15
      • OCP Versions: 4.16, 4.17, 4.18, 4.19, 4.20

      Environment Matrix - Test Scenarios

      # Category Priority Type Control Plane Regional Hubs BYO Hosted Brownfield FIPS Owner Task Link
      1 Regression 1 A ACM2.15/OCP4.20 ACM2.15/OCP4.19 ✅ Yes ❌ No ❌ No ✅ Yes Yaheng Liu ACM-25506
      2 Regression 2 A ACM2.15/OCP4.20 ACM2.14/OCP4.19 ❌ No ❌ No ✅ Yes ❌ No Yaheng Liu ACM-25505
      3 Regression 1 F ACM2.14/OCP4.19 ACM2.15/OCP4.20 ❌ No ✅ Yes ✅ Yes ✅ Yes Yaheng Liu ACM-25412
      4 Regression 2 A ACM2.13/OCP4.17 ACM2.14/OCP4.16 ✅ Yes ✅ Yes ✅ Yes ❌ No Dang Peng Liu ACM-25508
      5 Regression 2 A ACM2.14/OCP4.16 ACM2.13/OCP4.18 ✅ Yes ✅ Yes ❌ No ❌ No Meng Yan ACM-25509
      6 Regression 2 A BM Disconnect IPv6 - ❌ No ❌ No ✅ Yes ❌ No Yaheng Liu ACM-25510
      7 Upgrade 1 F ACM2.14→2.15/OCP4.19 ACM2.13→2.14/OCP4.17→18 ❌ No ❌ No ✅ Yes ❌ No Yaheng Liu ACM-25511
      8 Upgrade 2 A ACM2.14/OCP4.18 ACM2.15/OCP4.17 ✅ Yes ❌ No ❌ No ✅ Yes - ACM-25512
      9 Sanity Check 1 A ACM2.15/OCP4.20 ACM2.14/OCP4.19 ❌ No ✅ Yes ✅ Yes ✅ Yes - ACM-25513
      10 Sanity Check 2 A ACM2.14/OCP4.19 ACM2.15/OCP4.18 ❌ No ❌ No ✅ Yes ❌ No - ACM-25514
      11 Stage 1 A ACM2.15/OCP4.20 ACM2.15/OCP4.20 ❌ No ✅ Yes ✅ Yes ❌ No - ACM-25515
      12 Stage 1 A ACM2.15/OCP4.19 ACM2.13/OCP4.17 ❌ No ❌ No ❌ No ❌ No - ACM-25516
      13 PostPublish 1 A ACM2.15/OCP4.20 ACM2.15/OCP4.20 ❌ No ✅ Yes ✅ Yes ❌ No - ACM-25517

      Test Categories Summary

      • Regression Tests: 6 scenarios (2 P1, 4 P2) - Core functionality validation
      • Upgrade Tests: 2 scenarios (1 P1, 1 P2) - Version transition testing
      • Sanity Check: 2 scenarios (1 P1, 1 P2) - RC phase validation
      • Stage Tests: 2 scenarios (2 P1) - Staging environment validation
      • PostPublish: 1 scenario (1 P1) - Post-release validation

      Configuration Coverage Matrix

      Configuration Scenario Count Percentage
      BYO (Bring Your Own) 4 31%
      Hosted Mode 5 38%
      Brownfield Integration 9 69%
      FIPS Compliance 4 31%

      Test Execution Strategy

      • Priority 1: 7 scenarios (54%) - Execute first, critical for release
      • Priority 2: 6 scenarios (46%) - Secondary validation
      • Automation Only: 11 scenarios (85%) - A = Automated execution
      • Full Regression: 2 scenarios (15%) - F = Complete manual + auto

      Acceptance Criteria

      • [ ] All Priority 1 test scenarios completed successfully
      • [ ] 95% pass rate for Priority 2 scenarios
      • [ ] No critical or high-priority bugs introduced
      • [ ] Multi-version compatibility matrix fully validated
      • [ ] BYO, Hosted, Brownfield, and FIPS configurations validated
      • [ ] Performance metrics within acceptable baseline

      Dependencies

      • Global Hub 1.6.0 release candidate availability
      • Multi-version ACM test infrastructure (2.13, 2.14, 2.15)
      • Multi-version OCP clusters (4.16, 4.17, 4.18, 4.19, 4.20)
      • Specialized configurations (BYO, Hosted, Brownfield, FIPS)

      Historical Context

      • Builds upon previous regression test epic ACM-25266 (completed)
      • Matrix based on proven test scenarios from production testing
      • All task links reference completed work for validation

      Team Assignment

      • Primary Component: Global Hub
      • Owner Team: @acm-qe-serverfoundation
      • Test Execution: Multi-team collaboration as per matrix assignments

      This Epic was updated by Claude Code with comprehensive matrix analysis from glo_test_matrix.csv. Generated content based on Global Hub 1.6.0 test planning requirements.

              huichen@redhat.com Hui Chen
              huichen@redhat.com Hui Chen
              Yaheng Liu Yaheng Liu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: