Details
-
Bug
-
Resolution: Won't Do
-
Normal
-
None
-
4.12.0, 4.11.z, 4.10.z, 4.9.z
-
None
-
Moderate
-
False
-
Description
Description of problem:
Meet pulling image failure sometimes in osp with error "rpc error: code = Unknown desc = writing blob: setting up to decompress blob: happened during read: unexpected EOF"
Version-Release number of selected component (if applicable):
4.9.54/4.10/4.11/4.12
How reproducible:
Sometimes
Steps to Reproduce:
1.Launch 4.8 to 4.12 upgrade test for a disconnect cluster in osp16 The upgrade job is https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/ocp-upgrade/job/upgrade-pipeline/31760/ 2.The qe-app-registry pods in openshift-marketplace namespace failed to start due to pulling image when upgrade to 4.9 3. The qe-app-registry pods failed to restart when upgrade 4.11 to 4.12 for disconnect cluster in osp16 The job is https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/ocp-upgrade/job/upgrade-pipeline/31734/ 4. Meet same error when pull this image using podman client in node
Actual results:
Step 2: the pod events,pod failed to pull imageWarning Failed 61m (x25 over 166m) kubelet Failed to pull image "upshift.mirror-registry.qe.devcluster.openshift.com:6001/openshift-qe-optional-operators/aosqe-index:v4.9": rpc error: code = Unknown desc = writing blob: setting up to decompress blob: happened during read: unexpected EOF Step 3: the pod events,pod failed to pull imageWarning Failed 61m (x25 over 166m) kubelet Failed to pull image "upshift.mirror-registry.qe.devcluster.openshift.com:6001/openshift-qe-optional-operators/aosqe-index:v4.11": rpc error: code = Unknown desc = writing blob: setting up to decompress blob: happened during read: unexpected EOF step 4: http://pastebin.test.redhat.com/1087682
Expected results:
Could pull this image, then pod could be running
Additional info:
1. Could pull this image outside the cluster, proves the repository no issue. The podman version is 4.2.0 2. The must-gather log https://drive.google.com/file/d/1LQ6OyCuzROY7Gmx_AJS4MP5gL6Sx8M5r/view?usp=share_link
