-
Bug
-
Resolution: Duplicate
-
Undefined
-
None
-
4.22
-
None
-
False
-
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Sippy AI-assisted description; please review details for accuracy.
Filed from: Test Regression Details
Test Name
[ sig-imagepolicy][OCPFeatureGate:SigstoreImageVerificationPKI][Serial][Skipped:Disconnected] clusterimagepolicy signature validation tests pass with valid PKI [Suite:openshift/conformance/serial]
Brief Overview
Significant regression detected. Fishers Exact probability of a regression: 99.96%. Test pass rate dropped from 100.00% to 91.89%.
Statistics Section
Release: 4.22
Time Period: 2026-02-09T00:00:00Z to 2026-02-16T12:00:00Z
Success Rate: 91.89%
Successes: 34
Failures: 3
Flakes: 0
Release: 4.21
Time Period: 2026-01-04T00:00:00Z to 2026-02-03T23:59:59Z
Success Rate: 100.00%
Successes: 70
Failures: 0
Flakes: 0
Sample Failure Outputs
* Job Run ID: 2022358329874976768
* build-log.txt:
* time="2026-02-13T18:21:02Z" level=info msg="event interval matches KubeletUnhealthyReadinessProbeFailed" locator="{Kind map[hmsg:e7a751a213 namespace:e2e-daemonsets-7385 node:ip-10-0-97-142.us-west-1.compute.internal pod:daemon-set-8c995]}" message="{Unhealthy Readiness probe failed: map[firstTimestamp:2026-02-13T18:21:02Z lastTimestamp:2026-02-13T18:21:02Z reason:Unhealthy]}"
* {"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2026-02-13T20:14:01Z"}
* error: failed to execute wrapped command: exit status 1
* Reporting job state 'failed' with reason 'executing_graph:step_failed:utilizing_lease:executing_test:executing_multi_stage_test'
* Job Run ID: 2022539565364940800
* build-log.txt:
* time="2026-02-14T06:19:11Z" level=info msg="event interval matches KubeletUnhealthyReadinessProbeFailed" locator="{Kind map[hmsg:36b79e79a9 namespace:openshift-monitoring node:ip-10-0-40-153.us-west-2.compute.internal pod:metrics-server-6f97dd975-5dvf4]}" message="{Unhealthy Readiness probe failed: HTTP probe failed with statuscode: 500 map[firstTimestamp:2026-02-14T06:19:10Z lastTimestamp:2026-02-14T06:19:10Z reason:Unhealthy]}"
* time="2026-02-14T06:19:12Z" level=info msg="event interval matches ConnectionErrorDuringSingleNodeAPIServerTargetDown" locator="{Kind map[hmsg:8ab29936d5 namespace:openshift-dns node:ip-10-0-40-153.us-west-2.compute.internal pod:dns-default-92wjc]}" message="{ProbeError Readiness probe error: Get \"http://10.129.2.6:8181/ready\": dial tcp 10.129.2.6:8181: connect: connection refused\nbody: \n map[firstTimestamp:2026-02-14T06:19:12Z lastTimestamp:2026-02-14T06:19:12Z reason:ProbeError]}"
* {"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2026-02-14T08:09:12Z"}
* error: failed to execute wrapped command: exit status 1
* Reporting job state 'failed' with reason 'executing_graph:step_failed:utilizing_lease:executing_test:executing_multi_stage_test'
* Job Run ID: 2022901957168992256
* build-log.txt:
* time="2026-02-15T06:22:59Z" level=info msg="event interval matches ConnectionErrorDuringSingleNodeAPIServerTargetDown" locator="{Kind map[hmsg:c5fb68b9c9 namespace:openshift-dns node:ip-10-0-32-2.us-west-2.compute.internal pod:dns-default-4cgbn]}" message="{ProbeError Readiness probe error: Get \"http://10.129.2.7:8181/ready\": dial tcp 10.129.2.7:8181: connect: connection refused\nbody: \n map[firstTimestamp:2026-02-15T06:22:58Z lastTimestamp:2026-02-15T06:22:58Z reason:ProbeError]}"
* time="2026-02-15T06:22:59Z" level=info msg="event interval matches KubeletUnhealthyReadinessProbeFailed" locator="{Kind map[hmsg:773222eaca namespace:e2e-pod-network-disruption-test-mmzct node:ip-10-0-32-2.us-west-2.compute.internal pod:pod-network-disruption-target-67d794bbd8-xmjrs]}" message="{Unhealthy Readiness probe failed: HTTP probe failed with statuscode: 503 map[firstTimestamp:2026-02-15T06:22:58Z lastTimestamp:2026-02-15T06:22:58Z reason:Unhealthy]}"
* {"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2026-02-15T08:13:00Z"}
* error: failed to execute wrapped command: exit status 1
* Reporting job state 'failed' with reason 'executing_graph:step_failed:utilizing_lease:executing_test:executing_multi_stage_test'
Links to Relevant Jobs
- periodic-ci-openshift-release-main-ci-4.22-e2e-aws-ovn-rhcos10-techpreview-serial-3of3
- periodic-ci-openshift-release-main-ci-4.22-e2e-aws-ovn-rhcos10-techpreview-serial-3of3
- periodic-ci-openshift-release-main-ci-4.22-e2e-aws-ovn-rhcos10-techpreview-serial-3of3
Patterns and Insights
The test has regressed significantly, with the pass rate dropping from 100% in the base period (4.21) to 91.89% in the sample period (4.22). All three failed job runs exhibit similar error patterns: "KubeletUnhealthyReadinessProbeFailed" and "ConnectionErrorDuringSingleNodeAPIServerTargetDown" related to network connectivity or readiness probes, ultimately leading to "Error executing test process" and "wrapped process failed: exit status 1". This suggests a potential issue with network stability or pod readiness within the test environment, specifically affecting the Node / CRI-O component. The failures appear consistent across the recent failed runs, indicating a clear regression of an existing test.
Filed by: kehannon@redhat.com
- relates to
-
-
- ON_QA
-
