-
Epic
-
Resolution: Unresolved
-
Undefined
-
None
-
None
-
None
-
None
-
Automatic performance regression monitoring of scale test data
-
False
-
-
False
-
Not Selected
-
To Do
-
-
-
-
Rox Sprint 4.8H - Global, Rox Sprint 4.9A - Global, Rox Sprint 4.9B - Global, Rox Sprint 4.9C - Global, Rox Sprint 4.9D - Global, Rox Sprint 4.9E - Global, Rox Sprint 4.9F - Global, Rox Sprint 4.9G - Global, Rox Sprint 4.9H - Global, Rox Sprint 4.10A - Global, Rox Sprint 4.9I - Global
acs perf&scale meeting notes from May 14, 2025 (https://docs.google.com/document/d/1hETOzx5e-eWVP8pL8p18JNBHf3DULxMs82go0GX6Gv0/edit?tab=t.0):
Regression detection
-
- https://github.com/cloud-bulldozer/e2e-benchmarking/blob/master/utils/index.sh#L27-L37
- Example orion configs
- A passing run of orion: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/periodic-ci-openshift-eng-ocp-qe-perfscale-ci-main-aws-4.18-nightly-x86-payload-control-plane-6nodes/1922562978981351424/artifacts/payload-control-plane-6nodes/openshift-qe-orion-cluster-density/build-log.txt
- An anomaly-found run of orion: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-eng-ocp-qe-perfscale-ci-main-aws-4.19-nightly-x86-payload-control-plane-6nodes/1922258803282153472
- Gotcha’s
- The right metrics must be collected to detect a problem
- The tool accounts for variance (unlikely to raise false alerts)
