-
Story
-
Resolution: Unresolved
-
Critical
-
None
-
None
We would like to establish a systematic Software Test Plan (STP) process for OpenShift Virtualization QE to improve test coverage visibility, consistency, and quality outcomes.
Current State:
Our QE members deliver quality testing across OpenShift Virtualization features.
As we scale and handle more complex features, we have an opportunity to make our proven testing practices more systematic and visible.
Problem:
- Test scope and coverage are often implicit rather than documented
- Automation timing varies by feature (sometimes merges after GA)
- Untestable aspects not formally documented with stakeholder sign-off
- Difficult to trace requirements to test coverage
Why This Matters:
This approach aligns with how Kubernetes, OpenShift, and KubeVirt manage their enhancement requirements - using formal docs, documented entry/exit criteria, and mandatory gates. By adopting similar structured processes, we ensure consistency with the broader ecosystem and industry best practices.
Solution:
Implement mandatory STPs that document:
- Test scope, strategy, and environment requirements
- Entry/exit criteria (automation merged before GA)
- Risk management with stakeholder agreement
- Requirements-to-tests traceability
Deliverables:
- STP template
- STP writing guide
- Testing tiers documentation
- Process documentation (feature → STP → approval → testing → sign-off)
Success Criteria:
- All new features require approved STP before testing begins
- 100% automation merged before Code Freeze
- Clear traceability from requirements to tests
- Stakeholder sign-off on test scope and non-goals
Timeline: Process established and documented, ready for pilot with upcoming features
Repo: https://github.com/RedHatQE/openshift-virtualization-tests-design-docs
- is related to
-
CNV-71725 Verify Capabilities per guest OS
-
- New
-