-
Bug
-
Resolution: Unresolved
-
Undefined
-
None
-
4.18, 4.19
-
None
-
Moderate
-
None
-
False
-
Description of problem
CI is flaky because of test failures such as the following:
{ fail [github.com/openshift/origin/test/extended/apiserver/api_requests.go:406]: Expected
<[]string | len:1, cap:1>: [
"Operator \"cluster-samples-operator\" produces more watch requests than expected: watchrequestcount=151, upperbound=118, ratio=1.28",
]
to be empty
Ginkgo exit error 1: exit with code 1}
This particular failure comes from https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_cluster-ingress-operator/1147/pull-ci-openshift-cluster-ingress-operator-master-e2e-azure-ovn/1857099470299205632. Search.ci has other similar failures.
Version-Release number of selected component (if applicable)
4.18 and 4.19.
How reproducible
Presently, search.ci shows the following stats for the past two days:
pull-ci-openshift-origin-master-e2e-openstack-ovn (all) - 32 runs, 25% failed, 38% of failures match = 9% impact pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout (all) - 32 runs, 38% failed, 33% of failures match = 13% impact pull-ci-openshift-origin-master-e2e-metal-ipi-ovn (all) - 34 runs, 38% failed, 15% of failures match = 6% impact pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6 (all) - 44 runs, 30% failed, 46% of failures match = 14% impact pull-ci-openshift-machine-api-operator-master-e2e-metal-ipi (all) - 3 runs, 67% failed, 50% of failures match = 33% impact periodic-ci-openshift-release-master-ci-4.18-e2e-azure-ovn-upgrade (all) - 64 runs, 38% failed, 4% of failures match = 2% impact periodic-ci-openshift-release-master-nightly-4.18-e2e-gcp-ovn-serial (all) - 6 runs, 17% failed, 100% of failures match = 17% impact periodic-ci-openshift-release-master-nightly-4.18-e2e-vsphere-ovn-serial (all) - 6 runs, 67% failed, 25% of failures match = 17% impact periodic-ci-openshift-release-master-nightly-4.18-e2e-metal-ipi-ovn-techpreview (all) - 6 runs, 100% failed, 17% of failures match = 17% impact pull-ci-openshift-cluster-ingress-operator-master-e2e-azure-ovn (all) - 16 runs, 31% failed, 40% of failures match = 13% impact periodic-ci-openshift-release-master-nightly-4.18-e2e-agent-compact-fips (all) - 8 runs, 63% failed, 40% of failures match = 25% impact pull-ci-openshift-origin-master-e2e-agnostic-ovn-cmd (all) - 34 runs, 38% failed, 8% of failures match = 3% impact periodic-ci-openshift-multiarch-master-nightly-4.18-ocp-e2e-gcp-ovn-multi-a-a (all) - 5 runs, 40% failed, 50% of failures match = 20% impact openshift-origin-29265-nightly-4.18-e2e-metal-ipi-ovn-dualstack-techpreview (all) - 3 runs, 100% failed, 67% of failures match = 67% impact pull-ci-openshift-insights-operator-master-e2e-metal-ipi-ovn-ipv6 (all) - 17 runs, 29% failed, 40% of failures match = 12% impact periodic-ci-openshift-release-master-ci-4.18-e2e-gcp-ovn-upgrade (all) - 77 runs, 25% failed, 5% of failures match = 1% impact periodic-ci-openshift-release-master-nightly-4.19-e2e-agent-compact-fips (all) - 9 runs, 44% failed, 50% of failures match = 22% impact periodic-ci-openshift-release-master-nightly-4.19-e2e-agent-ha-dualstack-conformance (all) - 9 runs, 33% failed, 67% of failures match = 22% impact openshift-etcd-302-nightly-4.18-e2e-metal-ipi-serial-ovn-ipv6 (all) - 1 runs, 100% failed, 100% of failures match = 100% impact openshift-etcd-302-nightly-4.18-e2e-metal-ipi-ovn-ipv6 (all) - 1 runs, 100% failed, 100% of failures match = 100% impact periodic-ci-openshift-release-master-ci-4.19-e2e-gcp-ovn-upgrade (all) - 35 runs, 34% failed, 25% of failures match = 9% impact pull-ci-openshift-machine-api-operator-master-e2e-metal-ipi-ovn-ipv6 (all) - 3 runs, 67% failed, 50% of failures match = 33% impact pull-ci-openshift-origin-master-e2e-gcp-ovn (all) - 46 runs, 22% failed, 20% of failures match = 4% impact periodic-ci-openshift-release-master-nightly-4.18-e2e-metal-ipi-serial-ovn-dualstack (all) - 6 runs, 50% failed, 33% of failures match = 17% impact pull-ci-openshift-machine-api-operator-master-e2e-gcp-ovn (all) - 3 runs, 67% failed, 50% of failures match = 33% impact periodic-ci-openshift-release-master-nightly-4.18-e2e-metal-ipi-ovn-ipv6 (all) - 8 runs, 25% failed, 50% of failures match = 13% impact periodic-ci-openshift-release-master-nightly-4.18-e2e-metal-ipi-ovn-bm (all) - 8 runs, 25% failed, 50% of failures match = 13% impact periodic-ci-openshift-release-master-nightly-4.19-e2e-metal-ipi-ovn-ipv6-techpreview (all) - 7 runs, 100% failed, 14% of failures match = 14% impact periodic-ci-openshift-release-master-nightly-4.19-e2e-metal-ipi-ovn-dualstack-techpreview (all) - 7 runs, 100% failed, 14% of failures match = 14% impact pull-ci-openshift-machine-config-operator-master-e2e-vsphere-ovn-zones (all) - 24 runs, 29% failed, 14% of failures match = 4% impact pull-ci-openshift-installer-master-e2e-gcp-ovn-xpn (all) - 5 runs, 20% failed, 100% of failures match = 20% impact pull-ci-openshift-installer-master-e2e-aws-ovn (all) - 30 runs, 10% failed, 33% of failures match = 3% impact
Steps to Reproduce
1. Post a PR and have bad luck.
2. Check search.ci: https://search.dptools.openshift.org/?search=Operator+%5C%5C%22cluster-samples-operator%5C%5C%22+produces+more+watch+requests+than+expected&maxAge=48h&context=1&type=build-log&name=&excludeName=&maxMatches=5&maxBytes=20971520&groupBy=job
Actual results
CI fails.
Expected results
CI passes, or fails on some other test failure.