-
Epic
-
Resolution: Unresolved
-
Major
-
None
-
None
-
Global Hub 1.6.0 Regression Test Plan
-
Quality / Stability / Reliability
-
False
-
-
False
-
Not Selected
-
To Do
-
100% To Do, 0% In Progress, 0% Done
Global Hub 1.6.0 Regression Testing
Execute comprehensive regression testing for Global Hub 1.6.0 across 13 test scenarios with detailed environment configurations.
Test Scenarios - Complete Environment Matrix
| # | Category | Priority | Automation | Control Plane | Regional Hubs | BYO | Hosted | Brownfield | FIPS | Owner |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Regression | 🔴 P1 | A | ACM2.15/OCP4.20 | ACM2.15/OCP4.19 | ✅ Yes | ❌ No | ❌ No | ✅ Yes | [~hchenxa] |
| 2 | Regression | 🟡 P2 | A | ACM2.15/OCP4.20 | ACM2.14/OCP4.19 | ❌ No | ❌ No | ✅ Yes | ❌ No | [~hchenxa] |
| 3 | Regression | 🔴 P1 | F | ACM2.14/OCP4.19 | ACM2.15/OCP4.20 | ❌ No | ✅ Yes | ✅ Yes | ✅ Yes | [~hchenxa] |
| 4 | Regression | 🟡 P2 | A | ACM2.14/OCP4.18 | ACM2.13/OCP4.17 | ❌ No | ❌ No | ❌ No | ❌ No | [~hchenxa] |
| 5 | Regression | 🟡 P2 | A | ACM2.13/OCP4.17 | ACM2.14/OCP4.16 | ✅ Yes | ✅ Yes | ✅ Yes | ❌ No | [~hchenxa] |
| 6 | Regression | 🟡 P2 | A | ACM2.13/OCP4.16 | ACM2.13/OCP4.16 | ✅ Yes | ❌ No | ✅ Yes | ✅ Yes | [~hchenxa] |
| 7 | Upgrade | 🔴 P1 | F | ACM2.14→2.15/OCP4.19 | ACM2.13→2.14/OCP4.17→4.18 | ❌ No | ✅ Yes | ✅ Yes | ❌ No | [~hchenxa] |
| 8 | Upgrade | 🟡 P2 | A | ACM2.14/OCP4.17 | ACM2.15/OCP4.18 | ❌ No | ❌ No | ❌ No | ❌ No | [~hchenxa] |
| 9 | Sanity | 🟡 P2 | A | ACM2.15/OCP4.20 | ACM2.14/OCP4.19 | ❌ No | ✅ Yes | ✅ Yes | ✅ Yes | [~hchenxa] |
| 10 | Sanity | 🟡 P2 | A | ACM2.14/OCP4.19 | ACM2.15/OCP4.18 | ❌ No | ❌ No | ❌ No | ❌ No | [~hchenxa] |
| 11 | Stage | 🔴 P1 | A | ACM2.13/OCP4.18 | ACM2.14/OCP4.19 | ❌ No | ✅ Yes | ✅ Yes | ✅ Yes | [~hchenxa] |
| 12 | Stage | 🔴 P1 | A | ACM2.13/OCP4.18 | ACM2.13/OCP4.17 | ❌ No | ❌ No | ❌ No | ❌ No | [~hchenxa] |
| 13 | PostPublish | 🔴 P1 | A | ACM2.15/OCP4.20 | ACM2.15/OCP4.20 | ❌ No | ❌ No | ✅ Yes | ❌ No | [~hchenxa] |
Environment Configuration Legend
- A = Automation Only, F = Full Regression
- BYO = Bring Your Own Global Hub deployment
- Hosted = Cloud-managed Global Hub instances
- Brownfield = Integration with existing environments
- FIPS = Federal Information Processing Standards compliance
Test Categories Summary
| Category | Scenario Count | Priority 1 | Priority 2 | Automation | Full | BYO | Hosted | Brownfield | FIPS |
|---|---|---|---|---|---|---|---|---|---|
| Regression | 6 | 1 | 5 | 5 | 1 | 3 | 2 | 4 | 3 |
| Upgrade | 2 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 0 |
| Sanity | 2 | 0 | 2 | 2 | 0 | 0 | 1 | 1 | 1 |
| Stage | 2 | 2 | 0 | 2 | 0 | 0 | 1 | 1 | 1 |
| PostPublish | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 1 | 0 |
| Total | 13 | 5 | 8 | 11 | 2 | 3 | 5 | 8 | 5 |
Version Compatibility Matrix
- ACM Versions: 2.13, 2.14, 2.15
- OCP Versions: 4.16, 4.17, 4.18, 4.19, 4.20
- Global Hub Version: 1.6.0
Special Configuration Testing Coverage
- BYO Scenarios: 3 test cases covering custom Global Hub deployments
- Hosted Mode Scenarios: 5 test cases for cloud-managed instances
- Brownfield Scenarios: 8 test cases for existing environment integration
- FIPS Compliance: 5 test cases ensuring security standard compliance
Acceptance Criteria
- [ ] All Priority 1 test scenarios completed successfully (5 scenarios)
- [ ] 95% pass rate for Priority 2 scenarios (8 scenarios)
- [ ] No critical or high-priority bugs introduced
- [ ] Version compatibility matrix fully validated across ACM 2.13-2.15
- [ ] All environment configurations tested (BYO, Hosted, Brownfield, FIPS)
- [ ] Performance metrics within acceptable baseline
- [ ] Upgrade paths validated (1.5.1 → 1.6.0, 1.4.2→1.5.1→1.6.0)
Dependencies
- Global Hub 1.6.0 release candidate availability
- Test infrastructure provisioning for all environment types
- BYO, Hosted, Brownfield, and FIPS environment configurations
- Required certificates and security configurations
This Epic was generated by Claude Code test-plan automation with complete environment matrix from Globalhub_Test_Matrix_1.6.csv.