Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-47744

ODF operator upgrading failure due to the image pulling failure

XMLWordPrintable

    • Important
    • None
    • Eevee OLM Sprint 265
    • 1
    • False
    • Hide

      None

      Show
      None

      Nokia is testing upgrade 4.14.38 ---> 4.14.41 and observed that the base ocp is upgrade is completed but during day-2 operations upgrade fails.

      They observed that ICSP pointing to the newer release but it is still trying to fetch images from older build with newer path.

      • message: 'constraints not satisfiable: clusterserviceversion odf-operator.v4.14.11-rhodf
        exists and is not referenced by a subscription, subscription odf-operator requires
        cs-redhat-operator-index/openshift-marketplace/stable-4.14/odf-operator.v4.14.12-rhodf,
        subscription odf-operator exists, cs-redhat-operator-index/openshift-marketplace/stable-4.14/odf-operator.v4.14.12-rhodf
        and @existing/openshift-storage//odf-operator.v4.14.11-rhodf provide StorageSystem
        (odf.openshift.io/v1alpha1)'
        reason: ConstraintsNotSatisfiable
        status: "True"
        type: ResolutionFailed

      $ omc get sub -n openshift-storage
      NAME PACKAGE SOURCE CHANNEL
      mcg-operator-stable-4.14-cs-redhat-operator-index-openshift-marketplace mcg-operator cs-redhat-operator-index stable-4.14
      ocs-operator-stable-4.14-cs-redhat-operator-index-openshift-marketplace ocs-operator cs-redhat-operator-index stable-4.14
      odf-csi-addons-operator-stable-4.14-cs-redhat-operator-index-openshift-marketplace odf-csi-addons-operator cs-redhat-operator-index stable-4.14
      odf-operator odf-operator cs-redhat-operator-index

      $ omc get sub -n openshift-storage -o yaml | grep clusterserviceversion -A2

      • message: 'constraints not satisfiable: clusterserviceversion odf-operator.v4.14.11-rhodf
        exists and is not referenced by a subscription, subscription odf-operator
        requires cs-redhat-operator-index/openshift-marketplace/stable-4.14/odf-operator.v4.14.12-rhodf,
      • message: 'constraints not satisfiable: clusterserviceversion odf-operator.v4.14.11-rhodf
        exists and is not referenced by a subscription, subscription odf-operator
        requires cs-redhat-operator-index/openshift-marketplace/stable-4.14/odf-operator.v4.14.12-rhodf,
      • message: 'constraints not satisfiable: clusterserviceversion odf-operator.v4.14.11-rhodf
        exists and is not referenced by a subscription, subscription odf-operator
        requires cs-redhat-operator-index/openshift-marketplace/stable-4.14/odf-operator.v4.14.12-rhodf,
      • message: 'constraints not satisfiable: clusterserviceversion odf-operator.v4.14.11-rhodf
        exists and is not referenced by a subscription, subscription odf-operator
        requires cs-redhat-operator-index/openshift-marketplace/stable-4.14/odf-operator.v4.14.12-rhodf

      he image 8204d4550629 belongs to OCP 4.14.38 build
      registry.redhat.io/openshift4/ose-kube-rbac-proxy@sha256:8204d45506297578c8e41bcc61135da0c7ca244ccbd1b39070684dfeb4c2f26c=mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.38-nokia.24.10.1/redhat-operator/openshift4/ose-kube-rbac-proxy:2da1ddcd

      After upgrade, the operators is still referring to old image from the newer ICSP path. Meaning the 8204d455 image is being referred in OCP 4.14.41 path which is invalid.

      This is the actual issue and operator should refer to newer image which is available in 4.14.41

      [root@neat-vm158 redhat-operator]# cat mapping.txt | grep -i ose-kube-rbac-proxy
      registry.redhat.io/openshift4/ose-kube-rbac-proxy@sha256:*8204d455062*97578c8e41bcc61135da0c7ca244ccbd1b39070684dfeb4c2f26c=mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.38-nokia.24.10.1/redhat-operator/openshift4/ose-kube-rbac-proxy:2da1ddcd
      registry.redhat.io/openshift4/ose-kube-rbac-proxy@sha256:4c271935c67bea0746572365663cffca6f70a9d62ed4a686ca46962c5ceb2432=mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.38-nokia.24.10.1/redhat-operator/openshift4/ose-kube-rbac-proxy:1e75ecda

      [root@neat-vm158 redhat-operator]# cat mapping.txt | grep -i ose-kube-rbac-proxy
      registry.redhat.io/openshift4/ose-kube-rbac-proxy@sha256:4c271935c67bea0746572365663cffca6f70a9d62ed4a686ca46962c5ceb2432=mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.41-nokia.24.11.301/redhat-operator/openshift4/ose-kube-rbac-proxy:1e75ecda
      registry.redhat.io/openshift4/ose-kube-rbac-proxy@sha256:0c90e9a06033bdfb535acbb1bcd748813166bc7a9fe5a3746089b9e8b069d5c7=mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.41-nokia.24.11.301/redhat-operator/openshift4/ose-kube-rbac-proxy:e52c7042
      registry.redhat.io/openshift4/ose-kube-rbac-proxy@sha256:e9f4cda9fc8501f9f868379b5b89c2a9300860e535201ac9f3653645928eb4ee=mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.41-nokia.24.11.301/redhat-operator/openshift4/ose-kube-rbac-proxy:753a2f24

      $ podman pull --creds **:** mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.41-nokia.24.11.301/redhat-operator/openshift4/ose-kub
      e-rbac-proxy@sha256:8204d45506297578c8e41bcc61135da0c7ca244ccbd1b39070684dfeb4c2f26c
      Trying to pull mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.41-nokia.24.11.301/redhat-operator/openshift4/ose-kube-rbac-proxy@sha256:8204d45506297578c8e41bcc61135da0c7ca244ccbd1b39070684dfeb4c2f26c...
      Error: initializing source docker://mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.41-nokia.24.11.301/redhat-operator/openshift4/ose-kube-rbac-proxy@sha256:8204d45506297578c8e41bcc61135da0c7ca244ccbd1b39070684dfeb4c2f26c: reading manifest sha256:8204d45506297578c8e41bcc61135da0c7ca244ccbd1b39070684dfeb4c2f26c in mn-ran-ocp-release-local.artifactory-espoo2.int.net.nokia.com:443/ocp-4.14.41-nokia.24.11.301/redhat-operator/openshift4/ose-kube-rbac-proxy: manifest unknown: The named manifest is not known to the registry.

              rhn-support-jiazha Jian Zhang
              rhn-support-dseals Daniel Seals
              Jian Zhang Jian Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: