Epic Goal │
│ Execute comprehensive regression testing for Global Hub 1.6.0 across 13 test scenarios covering regression, upgrade, sanity check, stage, and post-publish testing to ensure version compatibility and feature stability. │
│ │
│ Why is this important? │
│ Global Hub 1.6.0 introduces critical updates that must be validated across multiple ACM (2.13-2.15) and OCP (4.16-4.20) version combinations. This comprehensive regression testing ensures backward compatibility, upgrade path reliability, and advanced configuration features (BYO, Hosted, Brownfield, FIPS) │
│ function correctly across the supported version matrix. │
│ │
│ Scenarios │
│ │
│ Test Scenarios - Environment Matrix │
│ │
│ Regression Test Scenarios (6 scenarios): │
│ 1. Priority 1 - Automation: ACM2.15/OCP4.20 → ACM2.15/OCP4.19 (BYO + FIPS) │
│ 2. Priority 2 - Automation: ACM2.15/OCP4.20 → ACM2.14/OCP4.19 (Brownfield) │
│ 3. Priority 1 - Full: ACM2.14/OCP4.19 → ACM2.15/OCP4.20 (Hosted + Brownfield + FIPS) │
│ 4. Priority 2 - Automation: ACM2.14/OCP4.18 → ACM2.13/OCP4.17 (Basic) │
│ 5. Priority 2 - Automation: ACM2.13/OCP4.17 → ACM2.14/OCP4.16 (BYO + Hosted + Brownfield) │
│ 6. Priority 2 - Automation: ACM2.13/OCP4.16 → ACM2.13/OCP4.16 (BYO + Brownfield + FIPS) │
│ │
│ Upgrade Test Scenarios (2 scenarios): │
│ 7. Priority 1 - Full: ACM2.14/OCP4.19 → ACM2.15/OCP4.19 + ACM2.13/OCP4.17 → ACM2.14/OCP4.18 (Hosted + Brownfield) - 1.5.1 → 1.6.0 │
│ 8. Priority 2 - Automation: ACM2.14/OCP4.17 → ACM2.15/OCP4.18 (Basic) - 1.4.2→1.5.1→1.6.0 │
│ │
│ Sanity Check Test Scenarios (2 scenarios): │
│ 9. Priority 2 - Automation: ACM2.15/OCP4.20 → ACM2.14/OCP4.19 (Hosted + Brownfield + FIPS) │
│ 10. Priority 2 - Automation: ACM2.14/OCP4.19 → ACM2.15/OCP4.18 (Basic) - For upgrade: 1.4.1 → 1.5 │
│ │
│ Stage Test Scenarios (2 scenarios): │
│ 11. Priority 1 - Automation: ACM2.13/OCP4.18 → ACM2.14/OCP4.19 (Hosted + Brownfield + FIPS) │
│ 12. Priority 1 - Automation: ACM2.13/OCP4.18 → ACM2.13/OCP4.17 (Basic) │
│ │
│ PostPublish Test Scenarios (1 scenario): │
│ 13. Priority 1 - Automation: ACM2.15/OCP4.20 → ACM2.15/OCP4.20 (Brownfield) │
│ │
│ Version Compatibility Matrix │
│ - Global Hub Version: 1.6.0 │
│ - ACM Versions: 2.13, 2.14, 2.15 │
│ - OCP Versions: 4.16, 4.17, 4.18, 4.19, 4.20 │
│ │
│ Configuration Features to Test │
│ - BYO (Bring Your Own): 4 scenarios │
│ - Hosted Mode: 5 scenarios │
│ - Brownfield: 8 scenarios │
│ - FIPS: 5 scenarios │
│ │
│ Acceptance Criteria │
│ - [ ] All Priority 1 test scenarios completed successfully (6 scenarios) │
│ - [ ] 95% pass rate for Priority 2 scenarios (7 scenarios) │
│ - [ ] No critical or high-priority bugs introduced │
│ - [ ] Version compatibility matrix fully validated │
│ - [ ] Advanced configuration features working properly (BYO, Hosted, Brownfield, FIPS) │
│ - [ ] Performance metrics within acceptable baseline │
│ - [ ] All test execution documented with evidence │
│ - [ ] Test results reviewed and signed off by QE team │
│ │
│ Dependencies (internal and external) │
│ - Global Hub 1.6.0 release candidate availability │
│ - Test infrastructure provisioning for all ACM/OCP version combinations │
│ - Required certificates and security configurations for FIPS scenarios │
│ - Access to all required ACM versions (2.13, 2.14, 2.15) and OCP versions (4.16-4.20) │
│ - Test automation framework updates for new version combinations │
│ │
│ Previous Work (Optional): │
│ - Global Hub 1.5.x regression testing │
│ - ACM 2.14 and 2.15 compatibility validation │
│ │
│ Open questions: │
│ - Are there any specific performance benchmarks for the 1.6.0 release? │
│ - Do we have confirmed availability dates for all required test infrastructure? │
│ - Are there any known issues with specific ACM/OCP version combinations that need workarounds? │
│ │
│ Done Checklist │
│ - [ ] CI - CI is running, tests are automated and merged. │
│ - [ ] Release Enablement │
│ - [ ] DEV - Upstream code and tests merged: │
│ - [ ] DEV - Upstream documentation merged: │
│ - [ ] DEV - Downstream build attached to advisory: │
│ - [ ] QE - Test plans in Polarion: │
│ - [ ] QE - Automated tests merged: │
│ - [ ] DOC - Doc issue opened with a completed template. Separate doc issue opened for any deprecation, removal, or any current known issue/troubleshooting removal from the doc, if applicable. │
│ - [ ] Considerations were made for Extended Update Support (EUS) │
│ │
│ 🤖 Generated with Claude Code