-
Task
-
Resolution: Unresolved
-
Major
-
None
-
None
-
False
-
-
False
-
-
Task
Build a flake quarantine mechanism that auto-skips tests after 3 consecutive flakes. Currently no structured process exists.
Background
Implement:
- quarantine.json file in e2e-tests/ with metadata (test path, Jira link, date, expiry)
- Playwright integration that reads quarantine list and applies test.skip()
- Quarantined tests still run in nightly via dedicated showcase-quarantine project (no gating)
- CI Medic weekly rotation documented in e2e-tests/README.md
Process:
- Detection: automatic via ReportPortal
- Quarantine: auto-skip after 3 consecutive flakes
- Tracking: Jira issue created per flake
- Resolution: CI Medic rotation investigates
- Reinstatement: test returns after fix verified
- Auto-expire: quarantine expires after 2 weeks
Acceptance Criteria
- quarantine.json schema defined and documented
- Playwright reads quarantine list and skips listed tests in gating projects
- Quarantined tests run in nightly showcase-quarantine project
- CI Medic rotation documented with duties and schedule
- At least one flaky test quarantined as proof of concept