-
Epic
-
Resolution: Done
-
Critical
-
None
-
poc-improve-openshift-virtualization-tests-failure-management
-
Quality / Stability / Reliability
-
77
-
- Document the workflow for Enhanced Failure Management and Quarantine Strategy
- PoC - An volunteer SIG group to implement the workflow to stablize the Tier2 test
-
Yellow
-
In Progress
-
0% To Do, 0% In Progress, 100% Done
-
Goal
To ensure a dependable test suite in https://github.com/RedHatQE/openshift-virtualization-tests, we must prioritize detecting flaky tests while keeping the test lanes GREEN.
Unreliable tests lead to mistrust in test results, forcing the QE to spend extra time determining if failures are actual bugs or just test instability.
The goal of this proposal is to enhance our testing efficiency and reliability while maintaining full test coverage and ensuring high product quality.
User Stories
- As QE, we are going to have the workflow
- how we make the test lanes GREEN
- Daily Review of Failing Tests
- Initial Assessment and Triage
- Flake Identification
- Failure Reporting
- Quarantine Decision
- Quarantine Implementation
- Monitoring Quarantined Tests
- Dequarantine workflow
- An volunteer SIG group to implement the workflow with maintainer.
Non-Requirements
- List of things not included in this epic, to alleviate any doubt raised during the grooming process.
Notes
- Any additional details or decisions made/needed
