Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-60929

oc-mirror creates tar file even after errors from image pull

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Important
    • None
    • None
    • CLID Sprint 277
    • 1
    • In Progress
    • Release Note Not Required
    • None
    • None
    • None
    • None
    • None

      Description of problem:

          When mirroring a large bundle of Openshift 4.19 and several operators, the oc-mirror pull ended with errors but created the mirror.tar file.

      Version-Release number of selected component (if applicable):

          oc-mirror v2 4.20

      How reproducible:

          happens every time I run this imagesetconfig

      Steps to Reproduce:

          1.Create imagesetconfig
          2.run oc-mirror pull, let it complete
          3. See errors at the end of the run
          

      Actual results:

          several operator images failed to pull and mirror.tar was created.

      Expected results:

      If there are any images that fail to pull, do not create mirror.tar file as it is an incomplete representation of the imagesetconfig.  I would expect if a tar file is created that all images I requested to pull are in the mirror.tar    

      Additional info:

          Error Log:

      error mirroring image docker://registry.redhat.io/odf4/mcg-core-rhel9@sha256:7102fcc64ffc2b021f0e12bf98ce80b5aafc1766411fa5aa3215e92b90987bfc (Operator bundles: [mcg-operator.v4.19.3-rhodf ocs-operator.v4.19.3-rhodf] - Operators: [mcg-operator ocs-operator]) error: copying image 3/3 from manifest list: writing blob: Patch "http://localhost:55000/v2/odf4/mcg-core-rhel9/blobs/uploads/15801616-3800-4283-977c-4031eb2d8df1?_state=gvUO-lQoPxzDVUaULDcYeMA1gDJjUhEMwSxSuC1p2T17Ik5hbWUiOiJvZGY0L21jZy1jb3JlLXJoZWw5IiwiVVVJRCI6IjE1ODAxNjE2LTM4MDAtNDI4My05NzdjLTQwMzFlYjJkOGRmMSIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyNS0wOC0yNlQxOTozNjo0Mi4xMTM2NzQyOTlaIn0%3D": context deadline exceeded
      error mirroring image docker://registry.redhat.io/advanced-cluster-security/rhacs-collector-rhel8@sha256:081f2198ad70bfb2ec66153b50b48b950b9a5550ba996de413c5a2aff4052783 (Operator bundles: [rhacs-operator.v3.68.2] - Operators: [rhacs-operator]) error: copying image 1/1 from manifest list: writing blob: Patch "http://localhost:55000/v2/advanced-cluster-security/rhacs-collector-rhel8/blobs/uploads/88957a5a-3197-4493-889a-c49da6cf9c19?_state=ty8bL-sFa43TvOxq86dzBBP4RCPD_E1hhOHWh4C9bvd7Ik5hbWUiOiJhZHZhbmNlZC1jbHVzdGVyLXNlY3VyaXR5L3JoYWNzLWNvbGxlY3Rvci1yaGVsOCIsIlVVSUQiOiI4ODk1N2E1YS0zMTk3LTQ0OTMtODg5YS1jNDlkYTZjZjljMTkiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjUtMDgtMjZUMjA6MzY6MTYuMDk3MjM2NDM4WiJ9": context deadline exceeded
      error mirroring image docker://registry.redhat.io/odf4/mcg-operator-bundle@sha256:92fc467a2cb3854e724b0b2da8701d7163091a01950de93c70987ff1ff2eb2ef error: skipping operator bundle docker://registry.redhat.io/odf4/mcg-operator-bundle@sha256:92fc467a2cb3854e724b0b2da8701d7163091a01950de93c70987ff1ff2eb2ef because one of its related images failed to mirror
      error mirroring image docker://registry.redhat.io/advanced-cluster-security/rhacs-operator-bundle@sha256:6a10a4859527946f61f497ff84b80f973cb7be5982d428423836b5aca81a1f5d error: skipping operator bundle docker://registry.redhat.io/advanced-cluster-security/rhacs-operator-bundle@sha256:6a10a4859527946f61f497ff84b80f973cb7be5982d428423836b5aca81a1f5d because one of its related images failed to mirror
      error mirroring image docker://registry.redhat.io/odf4/ocs-operator-bundle@sha256:686702e707a00dc7d36fed8b4e452f69db2623b8180debd7858e11cebdb8c2be error: skipping operator bundle docker://registry.redhat.io/odf4/ocs-operator-bundle@sha256:686702e707a00dc7d36fed8b4e452f69db2623b8180debd7858e11cebdb8c2be because one of its related images failed to mirror

       

       

      End result of oc-mirror:

      2025/08/26 21:10:22  [INFO]   : === Results ===
      2025/08/26 21:10:22  [INFO]   :  ✓  191 / 191 release images mirrored successfully
      2025/08/26 21:10:22  [INFO]   :  ✗  743 / 748 operator images mirrored: Some operator images failed to be mirrored - please check the logs
      2025/08/26 21:10:22  [INFO]   :  ✓  2 / 2 additional images mirrored successfully
      2025/08/26 21:10:22  [ERROR]  : [Worker] error mirroring image docker://registry.redhat.io/odf4/mcg-core-rhel9@sha256:7102fcc64ffc2b021f0e12bf98ce80b5aafc1766411fa5aa3215e92b90987bfc (Operator bundles: [mcg-operator.v4.19.3-rhodf ocs-operator.v4.19.3-rhodf] - Operators: [mcg-operator ocs-operator]) error: copying image 3/3 from manifest list: writing blob: Patch "http://localhost:55000/v2/odf4/mcg-core-rhel9/blobs/uploads/15801616-3800-4283-977c-4031eb2d8df1?_state=gvUO-lQoPxzDVUaULDcYeMA1gDJjUhEMwSxSuC1p2T17Ik5hbWUiOiJvZGY0L21jZy1jb3JlLXJoZWw5IiwiVVVJRCI6IjE1ODAxNjE2LTM4MDAtNDI4My05NzdjLTQwMzFlYjJkOGRmMSIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyNS0wOC0yNlQxOTozNjo0Mi4xMTM2NzQyOTlaIn0%!D(MISSING)": context deadline exceeded
      2025/08/26 21:10:22  [ERROR]  : [Worker] error mirroring image docker://registry.redhat.io/advanced-cluster-security/rhacs-collector-rhel8@sha256:081f2198ad70bfb2ec66153b50b48b950b9a5550ba996de413c5a2aff4052783 (Operator bundles: [rhacs-operator.v3.68.2] - Operators: [rhacs-operator]) error: copying image 1/1 from manifest list: writing blob: Patch "http://localhost:55000/v2/advanced-cluster-security/rhacs-collector-rhel8/blobs/uploads/88957a5a-3197-4493-889a-c49da6cf9c19?_state=ty8bL-sFa43TvOxq86dzBBP4RCPD_E1hhOHWh4C9bvd7Ik5hbWUiOiJhZHZhbmNlZC1jbHVzdGVyLXNlY3VyaXR5L3JoYWNzLWNvbGxlY3Rvci1yaGVsOCIsIlVVSUQiOiI4ODk1N2E1YS0zMTk3LTQ0OTMtODg5YS1jNDlkYTZjZjljMTkiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjUtMDgtMjZUMjA6MzY6MTYuMDk3MjM2NDM4WiJ9": context deadline exceeded
      2025/08/26 21:10:22  [ERROR]  : [Worker] error mirroring image docker://registry.redhat.io/odf4/mcg-operator-bundle@sha256:92fc467a2cb3854e724b0b2da8701d7163091a01950de93c70987ff1ff2eb2ef error: skipping operator bundle docker://registry.redhat.io/odf4/mcg-operator-bundle@sha256:92fc467a2cb3854e724b0b2da8701d7163091a01950de93c70987ff1ff2eb2ef because one of its related images failed to mirror
      2025/08/26 21:10:22  [ERROR]  : [Worker] error mirroring image docker://registry.redhat.io/advanced-cluster-security/rhacs-operator-bundle@sha256:6a10a4859527946f61f497ff84b80f973cb7be5982d428423836b5aca81a1f5d error: skipping operator bundle docker://registry.redhat.io/advanced-cluster-security/rhacs-operator-bundle@sha256:6a10a4859527946f61f497ff84b80f973cb7be5982d428423836b5aca81a1f5d because one of its related images failed to mirror
      2025/08/26 21:10:22  [ERROR]  : [Worker] error mirroring image docker://registry.redhat.io/odf4/ocs-operator-bundle@sha256:686702e707a00dc7d36fed8b4e452f69db2623b8180debd7858e11cebdb8c2be error: skipping operator bundle docker://registry.redhat.io/odf4/ocs-operator-bundle@sha256:686702e707a00dc7d36fed8b4e452f69db2623b8180debd7858e11cebdb8c2be because one of its related images failed to mirror
      2025/08/26 21:10:22  [INFO]   : mirror time     : 1h47m55.461125528s
      2025/08/26 21:10:22  [INFO]   : 👋 Goodbye, thank you for using oc-mirror
      2025/08/26 21:10:22  [ERROR]  : [Executor] [Worker] some errors occurred during the mirroring.
      Please review content/working-dir/logs/mirroring_errors_20250826_192226.txt for a list of mirroring errors.
      You may consider:

      • removing images or operators that cause the error from the image set config, and retrying
      • keeping the image set config (images are mandatory for you), and retrying
      • mirroring the failing images manually, if retries also fail. 
         
        ✅ Mirror to disk complete!
        📁 Content saved to: content/
        💾 Cache created at: .cache/
        📦 Ready for transfer to disconnected environment
         
        💡 Next steps:
           • Archive: tar -czf content.tar.gz content/
           • Transfer content.tar.gz to disconnected system
         

              rh-ee-aguidi Alex Guidi
              rhn-gps-maclemen Mark Clemente
              None
              None
              Nidan Gavali Nidan Gavali
              None
              Votes:
              2 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated: