Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-69584

Measure Product Quality Index

XMLWordPrintable

    • pqi
    • Quality / Stability / Reliability
    • 77
    • Hide
        1. Acceptance Criteria for CNV-69584
      • Automated system queries Jira to track PQI metrics per y-stream release: blocking/critical/regression issue count, major/critical/blocker bug arrival rate, and total unresolved bugs backlog with historical trend data
      • Dashboard displays real-time PQI metrics with visual indicators (graphs/charts) showing trends over time, target thresholds (0 blocking issues at release, decreasing arrival rate), and release-over-release comparison
      • Integration with demo session workflow delivers automated PQI reports (weekly/bi-weekly) to designated channels (Slack/Email) with summary insights and drill-down links to detailed dashboard
      • API endpoints expose PQI data for external consumption with filtering by release version, severity, component, and date range, supporting automated reporting and integration with existing services-health-check system
      • Documentation includes PQI metric definitions, calculation methodology, interpretation guidelines for PM/Dev stakeholders, and runbook for troubleshooting data collection issues, validated through 3+ successful demo session presentations
      Show
      Acceptance Criteria for CNV-69584 Automated system queries Jira to track PQI metrics per y-stream release: blocking/critical/regression issue count, major/critical/blocker bug arrival rate, and total unresolved bugs backlog with historical trend data Dashboard displays real-time PQI metrics with visual indicators (graphs/charts) showing trends over time, target thresholds (0 blocking issues at release, decreasing arrival rate), and release-over-release comparison Integration with demo session workflow delivers automated PQI reports (weekly/bi-weekly) to designated channels (Slack/Email) with summary insights and drill-down links to detailed dashboard API endpoints expose PQI data for external consumption with filtering by release version, severity, component, and date range, supporting automated reporting and integration with existing services-health-check system Documentation includes PQI metric definitions, calculation methodology, interpretation guidelines for PM/Dev stakeholders, and runbook for troubleshooting data collection issues, validated through 3+ successful demo session presentations
    • Green
    • To Do
    • VIRTSTRAT-515 - Establish and Achieve Quality and Stability Metrics in v4.21
    • qe-ack, doc-ack, px-ack
    • VIRTSTRAT-515Establish and Achieve Quality and Stability Metrics in v4.21
    • dev-ready, doc-ready, po-ready, prodsec-ready, px-ready, qe-ready, ux-ready
    • Hide

      2026-02-16:
      Exploring Jira together with the CNV DevOps Dashboard and Datadog to measure product and CI quality....

      Show
      2026-02-16: Exploring Jira together with the CNV DevOps Dashboard and Datadog to measure product and CI quality....

      Goal

      Repot our PQI in every demo session

      User Stories

      As a CNV PM or Developer I'd like to know our product quality index, hereby defined as

      1. Number of blocking/critical/regression issues (should be 0 on release).
      2. Major/critical/blocker bugs arrival rate (should decrease, converge to 0 on release).
      3. The total unresolved Bugs Backlog (should be decreasing release over release).
        per y-stream release.

      This should be socialized in every demo session; can be implemented by a Jira dashboard.

      Non-Requirements

      • List of things not included in this epic, to alleviate any doubt raised during the grooming process.

      Notes

      • Any additional details or decisions made/needed

          1.
          upstream roadmap issue Sub-task Closed Undefined Unassigned
          2.
          upstream design Sub-task Closed Undefined Unassigned
          3.
          upstream documentation Sub-task Closed Undefined Unassigned
          4.
          upgrade consideration Sub-task Closed Undefined Unassigned
          5.
          test plans in polarion Sub-task Closed Undefined Unassigned
          6.
          automated tests Sub-task Closed Undefined Unassigned
          7.
          downstream documentation merged Sub-task Closed Undefined Unassigned
          8.
          CNV QE DevOps Requirement/Enablement Sub-task Closed Undefined Unassigned

              dkeler@redhat.com Daniel Keler
              dkenigsb@redhat.com Dan Kenigsberg
              Ying Cui Ying Cui
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: