Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-37757

Content mirrored with oc-mirror v2 does not push openshift/release images to registry

XMLWordPrintable

    • No
    • CLID Sprint 257
    • 1
    • False
    • Hide

      None

      Show
      None
    • Hide
      * Previously, oc-mirror plugin v2 for tags were not created for the {product-title} release images. Some container registries depend on these tags as mandatory tags. With this release, these tags are added to all release images. (link:https://issues.redhat.com/browse/OCPBUGS-37757[*OCPBUGS-37757*])
      Show
      * Previously, oc-mirror plugin v2 for tags were not created for the {product-title} release images. Some container registries depend on these tags as mandatory tags. With this release, these tags are added to all release images. (link: https://issues.redhat.com/browse/OCPBUGS-37757 [* OCPBUGS-37757 *])
    • Bug Fix
    • Done

      This is a clone of issue OCPBUGS-36410. The following is the description of the original issue:

      Description of problem:

      When mirroring content with oc-mirror v2, some required images for OpenShift installation are missing from the registry    

      Version-Release number of selected component (if applicable):

      OpenShift installer version: v4.15.17 
      
      [admin@registry ~]$ oc-mirror version
      WARNING: This version information is deprecated and will be replaced with the output from --short. Use --output=yaml|json to get the full version.
      Client Version: version.Info{Major:"", Minor:"", GitVersion:"4.16.0-202406131906.p0.g7c0889f.assembly.stream.el9-7c0889f", GitCommit:"7c0889f4bd343ccaaba5f33b7b861db29b1e5e49", GitTreeState:"clean", BuildDate:"2024-06-13T22:07:44Z", GoVersion:"go1.21.9 (Red Hat 1.21.9-1.el9_4) X:strictfipsruntime", Compiler:"gc", Platform:"linux/amd64"}
      

      How reproducible:

      Use oc-mirror v2 to mirror content.
      
      $ cat imageset-config-ocmirrorv2-v4.15.yaml
      kind: ImageSetConfiguration
      apiVersion: mirror.openshift.io/v2alpha1
      mirror:
        platform:
          channels:
          - name: stable-4.15
            minVersion: 4.15.17
            type: ocp
        operators:
        - catalog: registry.redhat.io/redhat/redhat-operator-index:v4.15
          full: false
          packages:
            - name: ansible-automation-platform-operator
            - name: cluster-logging
            - name: datagrid
            - name: devworkspace-operator
            - name: multicluster-engine
            - name: multicluster-global-hub-operator-rh
            - name: odf-operator
            - name: quay-operator
            - name: rhbk-operator
            - name: skupper-operator
            - name: servicemeshoperator
            - name: submariner
            - name: lvms-operator
            - name: odf-lvm-operator
        - catalog: registry.redhat.io/redhat/certified-operator-index:v4.15
          full: false
          packages:
            - name: crunchy-postgres-operator
            - name: nginx-ingress-operator
        - catalog: registry.redhat.io/redhat/community-operator-index:v4.15
          full: false
          packages:
            - name: argocd-operator
            - name: cockroachdb
            - name: infinispan
            - name: keycloak-operator
            - name: mariadb-operator
            - name: nfs-provisioner-operator
            - name: postgresql
            - name: skupper-operator
        additionalImages:
        - name: registry.redhat.io/ubi8/ubi:latest
        - name: registry.access.redhat.com/ubi8/nodejs-18
        - name: registry.redhat.io/openshift4/ose-prometheus:v4.14.0
        - name: registry.redhat.io/service-interconnect/skupper-router-rhel9:2.4.3
        - name: registry.redhat.io/service-interconnect/skupper-config-sync-rhel9:1.4.4
        - name: registry.redhat.io/service-interconnect/skupper-service-controller-rhel9:1.4.4
        - name: registry.redhat.io/service-interconnect/skupper-flow-collector-rhel9:1.4.4
        helm: {}
      
      
      Run oc-mirror using the command:
      
      oc-mirror --v2 \
      -c imageset-config-ocmirrorv2-v4.15.yaml  \
      --workspace file:////data/oc-mirror/workdir/ \
      docker://registry.local.momolab.io:8443/mirror 

      Steps to Reproduce:

          1. Install Red Hat Quay mirror registry
          2. Mirror using oc-mirror v2 command and steps above
          3. Install OpenShift
          

      Actual results:

          Installation fails

      Expected results:

          Installation succeeds

      Additional info:

       ## Check logs on coreos:
      [core@sno1 ~]$ journalctl -b -f -u release-image.service -u bootkube.service
      Jul 02 03:46:22 sno1.local.momolab.io bootkube.sh[13486]: Error: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06: (Mirrors also failed: [registry.local.momolab.io:8443/mirror/openshift/release@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06: reading manifest sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06 in registry.local.momolab.io:8443/mirror/openshift/release: name unknown: repository not found]): quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06: reading manifest sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: unauthorized: access to the requested resource is not authorized
      
      ## Check if that image was pulled:
      
      [admin@registry ~]$ cat /data/oc-mirror/workdir/working-dir/dry-run/mapping.txt | grep -i f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06
      docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06=docker://registry.local.momolab.io:8443/mirror/openshift-release-dev/ocp-v4.0-art-dev@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06
      
      ## Problem is, it doesn't exist on the registry (also via UI):
      
      [admin@registry ~]$ podman pull registry.local.momolab.io:8443/mirror/openshift-release-dev/ocp-v4.0-art-dev@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06
      Trying to pull registry.local.momolab.io:8443/mirror/openshift-release-dev/ocp-v4.0-art-dev@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06...
      Error: initializing source docker://registry.local.momolab.io:8443/mirror/openshift-release-dev/ocp-v4.0-art-dev@sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06: reading manifest sha256:f36e139f75b179ffe40f5a234a0cef3f0a051cc38cbde4b262fb2d96606acc06 in registry.local.momolab.io:8443/mirror/openshift-release-dev/ocp-v4.0-art-dev: manifest unknown
      

            rh-ee-aguidi Alex Guidi
            openshift-crt-jira-prow OpenShift Prow Bot
            ying zhou ying zhou
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: