Uploaded image for project: 'Red Hat OpenShift Data Science'
  1. Red Hat OpenShift Data Science
  2. RHODS-7058

RHODS SM 1.22 install and upgrade failed due to missing image

XMLWordPrintable

    • Urgent

      Description of problem:

      Once the Errata is shipped live. We try to install the latest version of rhods (1.22) and observed that due to a missing image in regstry.redhat.io. Installation and upgrade is failed for SM

      Prerequisites (if any, like setup, operators/versions):

      Fresh cluster

      Steps to Reproduce

      1. Create a fresh Cluster
      2. For to Operatorhub
      3. Search for RHODS
      4. Install RHODS
      5. We observed that installation is stuck and operator pod is not being deployed due to missing image

      Actual results:

      We observed that installation is stuck and operator pod is not being deployed due to missing image

      Expected results:

      RHODS 1.22 install and upgrade should happen sucesfully

      Reproducibility (Always/Intermittent/Only Once):

      Always

      Build Details:

      RHODS 1.22.0-2

      Workaround:

      Additional info:

      Event:

      takumar@fedora ~]$ oc get csv; oc get events -n redhat-ods-operator;skopeo inspect --raw docker://registry.redhat.io/rhods/odh-operator-rhel8@sha256:4ae7131c9886b3a286b0de76c88c1fab986ec4f1d248950e04a36e96d4f51978
      NAME                      DISPLAY                          VERSION    REPLACES                   PHASE
      rhods-operator.1.22.0-2   Red Hat OpenShift Data Science   1.22.0-2   rhods-operator.1.21.0-22   Installing
      LAST SEEN   TYPE      REASON                OBJECT                                          MESSAGE
      13m         Normal    Scheduled             pod/rhods-operator-758877499d-plbcs             Successfully assigned redhat-ods-operator/rhods-operator-758877499d-plbcs to ip-10-0-146-56.us-east-2.compute.internal by ip-10-0-148-147
      13m         Normal    AddedInterface        pod/rhods-operator-758877499d-plbcs             Add eth0 [10.131.0.18/23] from openshift-sdn
      13m         Normal    Pulling               pod/rhods-operator-758877499d-plbcs             Pulling image "registry.redhat.io/rhods/odh-deployer-rhel8@sha256:38e96f50e2ae3911d5d9d2b8e9df87753ad66f9915a0e4e56364074e0b236be5"
      13m         Normal    Pulled                pod/rhods-operator-758877499d-plbcs             Successfully pulled image "registry.redhat.io/rhods/odh-deployer-rhel8@sha256:38e96f50e2ae3911d5d9d2b8e9df87753ad66f9915a0e4e56364074e0b236be5" in 4.703258832s
      13m         Normal    Created               pod/rhods-operator-758877499d-plbcs             Created container rhods-deployer
      13m         Normal    Started               pod/rhods-operator-758877499d-plbcs             Started container rhods-deployer
      10m         Normal    Pulling               pod/rhods-operator-758877499d-plbcs             Pulling image "registry.redhat.io/rhods/odh-operator-rhel8@sha256:4ae7131c9886b3a286b0de76c88c1fab986ec4f1d248950e04a36e96d4f51978"
      10m         Warning   Failed                pod/rhods-operator-758877499d-plbcs             Failed to pull image "registry.redhat.io/rhods/odh-operator-rhel8@sha256:4ae7131c9886b3a286b0de76c88c1fab986ec4f1d248950e04a36e96d4f51978": rpc error: code = Unknown desc = reading manifest sha256:4ae7131c9886b3a286b0de76c88c1fab986ec4f1d248950e04a36e96d4f51978 in registry.redhat.io/rhods/odh-operator-rhel8: unsupported: Not Found, or unsupported. V2 schema 1 manifest digest are no longer supported for image pulls. Use the equivalent schema 2 manifest digest instead. For more information see https://access.redhat.com/articles/6138332
      10m         Warning   Failed                pod/rhods-operator-758877499d-plbcs             Error: ErrImagePull
      3m9s        Normal    BackOff               pod/rhods-operator-758877499d-plbcs             Back-off pulling image "registry.redhat.io/rhods/odh-operator-rhel8@sha256:4ae7131c9886b3a286b0de76c88c1fab986ec4f1d248950e04a36e96d4f51978"
      10m         Warning   Failed                pod/rhods-operator-758877499d-plbcs             Error: ImagePullBackOff
      13m         Normal    SuccessfulCreate      replicaset/rhods-operator-758877499d            Created pod: rhods-operator-758877499d-plbcs
      13m         Normal    RequirementsUnknown   clusterserviceversion/rhods-operator.1.22.0-2   requirements not yet checked
      3m15s       Normal    AllRequirementsMet    clusterserviceversion/rhods-operator.1.22.0-2   all requirements found, attempting install
      3m15s       Normal    InstallSucceeded      clusterserviceversion/rhods-operator.1.22.0-2   waiting for install components to report healthy
      3m15s       Normal    InstallWaiting        clusterserviceversion/rhods-operator.1.22.0-2   installing: waiting for deployment rhods-operator to become ready: deployment "rhods-operator" not available: Deployment does not have minimum availability.
      3m15s       Warning   InstallCheckFailed    clusterserviceversion/rhods-operator.1.22.0-2   install timeout
      3m15s       Normal    NeedsReinstall        clusterserviceversion/rhods-operator.1.22.0-2   installing: waiting for deployment rhods-operator to become ready: deployment "rhods-operator" not available: Deployment does not have minimum availability.
      13m         Normal    ScalingReplicaSet     deployment/rhods-operator                       Scaled up replica set rhods-operator-758877499d to 1
      FATA[0000] Error parsing image name "docker://registry.redhat.io/rhods/odh-operator-rhel8@sha256:4ae7131c9886b3a286b0de76c88c1fab986ec4f1d248950e04a36e96d4f51978": reading manifest sha256:4ae7131c9886b3a286b0de76c88c1fab986ec4f1d248950e04a36e96d4f51978 in registry.redhat.io/rhods/odh-operator-rhel8: unsupported: Not Found, or unsupported. V2 schema 1 manifest digest are no longer supported for image pulls. Use the equivalent schema 2 manifest digest instead. For more information see https://access.redhat.com/articles/6138332
      

              rh-ee-dchouras Deepak Chourasia
              takumar@redhat.com Tarun Kumar
              Tarun Kumar Tarun Kumar
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

                Created:
                Updated:
                Resolved: