-
Story
-
Resolution: Unresolved
-
Critical
-
None
-
None
-
Quality / Stability / Reliability
-
2
-
False
-
-
False
-
None
-
-
NXT UpstreamCI Platform Sprint
-
None
As a person interested in mitigating flaky tests
I want to have the data in most-flaky-tests report as recent as possible
in order to act on flaky tests as soon as possible
In a recent discussion it was asked why a recently merged PR (merged half an hour before the meeting) was not visible in the report.
This is caused by our flakefinder data being updated only daily, which effectively creates a blind spot of failures on the recent day. This may cause us not seeing a hard flake only after the next day and will affect KPIs wrt test lane failure.
Mitigation:
1) include the flakefinder rolling window data into the most-flaky-tests report so we can also see today's updates
2) increase the most-flaky-tests report job frequency to every 30 minutes.
3) change the periodic flakefinder rolling window job into a postsubmit so it will get updated every time a merge happens