Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-71375

Standardize QE testing process with Software Test Plans

XMLWordPrintable

    • Quality / Stability / Reliability
    • 0.42
    • False
    • Hide

      None

      Show
      None
    • False
    • None

      We would like to establish a systematic Software Test Plan (STP) process for OpenShift Virtualization QE to improve test coverage visibility, consistency, and quality outcomes.

      Current State:
      Our QE members deliver quality testing across OpenShift Virtualization features.

      As we scale and handle more complex features, we have an opportunity to make our proven testing practices more systematic and visible.

      Problem:
        - Test scope and coverage are often implicit rather than documented
        - Automation timing varies by feature (sometimes merges after GA)
        - Untestable aspects not formally documented with stakeholder sign-off
        - Difficult to trace requirements to test coverage

      Why This Matters:
      This approach aligns with how Kubernetes, OpenShift, and KubeVirt manage their enhancement requirements - using formal docs, documented entry/exit criteria, and mandatory gates. By adopting similar structured processes, we ensure consistency with the broader ecosystem and industry best practices.

      Solution:
        Implement mandatory STPs that document:
        - Test scope, strategy, and environment requirements
        - Entry/exit criteria (automation merged before GA)
        - Risk management with stakeholder agreement
        - Requirements-to-tests traceability

      Deliverables:
        - STP template
        - STP writing guide
        - Testing tiers documentation
        - Process documentation (feature → STP → approval → testing → sign-off)

      Success Criteria:
        - All new features require approved STP before testing begins
        - 100% automation merged before Code Freeze
        - Clear traceability from requirements to tests
        - Stakeholder sign-off on test scope and non-goals

        Timeline: Process established and documented, ready for pilot with upcoming features

       

      Repo: https://github.com/RedHatQE/openshift-virtualization-tests-design-docs

       

       

              Unassigned Unassigned
              ruth.netser1 Ruth Netser
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: