-
Bug
-
Resolution: Done
-
Critical
-
None
-
None
-
Quality / Stability / Reliability
-
False
-
-
3
-
None
-
None
-
uShift Sprint 268, uShift Sprint 269, uShift Sprint 270
-
None
-
None
-
None
Description of problem:
CI cache jobs fail occasionally due to unable to pull microshift-ci-brew image from the CI registry
Version-Release number of selected component (if applicable):
Version agnostic
How reproducible:
Occasionally in CI
Steps to Reproduce:
Check history of cache jobs, for example this and this ones
Actual results:
Cache job failing with container pull error
Expected results:
Cache job must pass
Additional info:
mERRO[0m[2025-03-05T01:11:27Z] * could not run steps: step e2e-aws-tests-cache-nightly-arm failed: "e2e-aws-tests-cache-nightly-arm" test steps failed: "e2e-aws-tests-cache-nightly-arm" pod "e2e-aws-tests-cache-nightly-arm-openshift-microshift-infra-iso-build" failed: pod pending for more than 1h0m0s: containers have not started in 1h0m0.000880617s: test: * Container test is not ready with reason ImagePullBackOff and message Back-off pulling image "image-registry.openshift-image-registry.svc:5000/ci-op-3c5qfrqs/pipeline:microshift-ci-brew" Found 24 events for Pod e2e-aws-tests-cache-nightly-arm-openshift-microshift-infra-iso-build: * 2025-03-05T00:10:13Z 1x multiarch-tuning-operator: Successfully gated with the multiarch.openshift.io/scheduling-gate scheduling gate * 2025-03-05T00:10:14Z 1x multiarch-tuning-operator: Failed to retrieve the supported architectures: reading manifest microshift-ci-brew in image-registry.openshift-image-registry.svc:5000/ci-op-3c5qfrqs/pipeline: manifest unknown * 2025-03-05T00:10:14Z 1x multiarch-tuning-operator: Successfully removed the multiarch.openshift.io/scheduling-gate scheduling gate * 0001-01-01T00:00:00Z 0x : Successfully assigned ci-op-3c5qfrqs/e2e-aws-tests-cache-nightly-arm-openshift-microshift-infra-iso-build to ip-10-28-64-30.us-east-2.compute.internal * 2025-03-16T00:16:17Z 1x multus: Add eth0 [10.130.133.2/23] from ovn-kubernetes * 2025-03-16T00:16:17Z 1x kubelet: Pulling image "registry.access.redhat.com/ubi8" * 2025-03-16T00:16:18Z 1x kubelet: Successfully pulled image "registry.access.redhat.com/ubi8" in 888ms (888ms including waiting). Image size: 212578971 bytes. * 2025-03-16T00:16:18Z 1x kubelet: Created container: ci-scheduling-dns-wait * 2025-03-16T00:16:18Z 1x kubelet: Started container ci-scheduling-dns-wait * 2025-03-16T00:16:20Z 1x kubelet: Container image "us-docker.pkg.dev/k8s-infra-prow/images/entrypoint:v20250307-7a867cddc" already present on machine * 2025-03-16T00:16:21Z 1x kubelet: Created container: place-entrypoint * 2025-03-16T00:16:21Z 1x kubelet: Started container place-entrypoint * 2025-03-16T00:16:21Z 1x kubelet: Pulling image "registry.ci.openshift.org/ci/entrypoint-wrapper:latest" * 2025-03-16T00:16:22Z 1x kubelet: Successfully pulled image "registry.ci.openshift.org/ci/entrypoint-wrapper:latest" in 467ms (467ms including waiting). Image size: 190078577 bytes. * 2025-03-16T00:16:22Z 1x kubelet: Created container: cp-entrypoint-wrapper * 2025-03-16T00:16:22Z 1x kubelet: Started container cp-entrypoint-wrapper * 2025-03-16T00:16:38Z 2x kubelet: Pulling image "image-registry.openshift-image-registry.svc:5000/ci-op-mllpn4vp/pipeline:microshift-ci-brew" * 2025-03-16T00:16:39Z 2x kubelet: Failed to pull image "image-registry.openshift-image-registry.svc:5000/ci-op-mllpn4vp/pipeline:microshift-ci-brew": initializing source docker://image-registry.openshift-image-registry.svc:5000/ci-op-mllpn4vp/pipeline:microshift-ci-brew: reading manifest microshift-ci-brew in image-registry.openshift-image-registry.svc:5000/ci-op-mllpn4vp/pipeline: manifest unknown * 2025-03-16T00:16:39Z 2x kubelet: Error: ErrImagePull * 2025-03-16T00:16:23Z 1x kubelet: Container image "us-docker.pkg.dev/k8s-infra-prow/images/ *
- is duplicated by
-
-
- Closed
-
- links to
(4 links to)