Extend HO/CPO compatibility testing to AKS platform, implement comprehensive observability (dashboards, metrics, alerts), and automate maintenance tasks for long-term operational excellence.

This epic ensures the testing infrastructure scales to multiple platforms and is sustainable with minimal manual intervention.

Epic Acceptance Criteria

• All periodic and upgrade tests from Epic 1 run on Azure platform (ARO HCP)
• (stretch) dashboards visualize test results and trends
• Alerting configured for test failures and regressions
• Konflux Release gating
• Test health metrics tracked and reviewed regularly
• Documentation for operating and maintaining the test infrastructure

Scope

In Scope

• Azure platform test coverage (ARO HCP)
• (stretch) dashboards for test visibility
• (stretch) Prometheus metrics and alerting
• Automated version update tooling
• Operational runbooks and documentation
• Test health monitoring and SLOs
• Konflux releaseplan changes

Out of Scope

• Additional platforms beyond AWS and Azure (IBM Cloud, KubeVirt - future consideration)
• Performance benchmarking and optimization
• Advanced analytics and ML-based predictions
• Customer-facing dashboards (internal use only)

Target Users

• HyperShift QE team
• CI/CD administrators
• SRE and operations teams
• ARO HCP team (Azure-specific testing)
• ROSA HCP team (AWS testing)

Dependencies

• Epic 1 must be substantially complete
• Access to Azure test infrastructure
• Azure credentials and quotas
• Access to Grafana and Prometheus infrastructure
• Permissions to create alerts and dashboards