Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-64958

Enhancement: check-tests-for-flakes in ci-health and voting job before merge the PRs

XMLWordPrintable

    • improve_pre_merge_flake_detection
    • Quality / Stability / Reliability
    • 77
    • False
    • Hide

      None

      Show
      None
    • False
      • Failure rate of flake detection job measured on merged PRs
      • Infrastructure failures filtered from actual test failures
      • Job timeout optimized with runtime metrics
      • High-confidence flakes block PR merge
    • None
    • Green
    • To Do
    • 100% To Do, 0% In Progress, 0% Done
    • Hide

      2026-02-16:
      but do we still need to groom how can we improve the flakes in ci-health?...

      Show
      2026-02-16: but do we still need to groom how can we improve the flakes in ci-health?...

      Goal

      check-tests-for-flakes: Make the KubeVirt Pre-Merge Flake detection process voting job and also  integrate flakes per sig into ci-health. 

      User Stories

      • Measure the failure rate of this job on merged PRs
      • Enhanced Filtering & Exclusions: Add more sophisticated filtering for infrastructure-related failures and Filter out failures during cluster initialization vs. actual test failures
      • Timeout & Resource Optimization: the 7h timeout seems very long.  Adding metrics to track actual runtime vs. timeout
      • integrate flakes per sig into ci-health

      Non-Requirements

      • List of things not included in this epic, to alleviate any doubt raised during the grooming process.

      Notes

      • Any additional details or decisions made/needed

          1.
          upstream roadmap issue Sub-task New Undefined Unassigned
          2.
          upstream design Sub-task New Undefined Unassigned
          3.
          upstream documentation Sub-task New Undefined Unassigned
          4.
          upgrade consideration Sub-task New Undefined Unassigned
          5.
          automated tests Sub-task New Undefined Unassigned

              dollierp@redhat.com Denis Ollier Pinas
              dhiller72 Daniel Hiller
              Denis Ollier Pinas Denis Ollier Pinas
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: