Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-66510

most-flaky-tests: make data more recent

XMLWordPrintable

    • Quality / Stability / Reliability
    • 2
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • NXT UpstreamCI Platform Sprint
    • None

      As a person interested in mitigating flaky tests
      I want to have the data in most-flaky-tests report as recent as possible
      in order to act on flaky tests as soon as possible

      In a recent discussion it was asked why a recently merged PR (merged half an hour before the meeting) was not visible in the report.

      This is caused by our flakefinder data being updated only daily, which effectively creates a blind spot of failures on the recent day. This may cause us not seeing a hard flake only after the next day and will affect KPIs wrt test lane failure.

      Mitigation:
      1) include the flakefinder rolling window data into the most-flaky-tests report so we can also see today's updates
      2) increase the most-flaky-tests report job frequency to every 30 minutes.
      3) change the periodic flakefinder rolling window job into a postsubmit so it will get updated every time a merge happens

              dhiller72 Daniel Hiller
              dhiller72 Daniel Hiller
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: