Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-35067

Multi-Arch: Operator installation fails on a Multi-Arch cluster because of amd64 image is used when pod is deployed on s390x compute node.

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Do
    • Icon: Normal Normal
    • None
    • 4.16
    • None
    • Moderate
    • Yes
    • Rejected
    • False
    • Hide

      None

      Show
      None

      Description of problem: 
      Operator installation fails on a Multi-Arch cluster because of amd64 image is used when pod is deployed on s390x compute node.
       
      Pre-condition:
      Deploy an multiarch x86 ocp cluster with 2 KVM s390x nodes as additonal compute nodes with 416-rc-3 build.

      oc version
      Client Version: 4.16.0-rc.3
      Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
      Server Version: 4.16.0-rc.3
      Kubernetes Version: v1.29.5+87992f4
      

      Steps to Reproduce:

      1. Install 3scale API Management operator (community operator) from console 
      2. Once installed check yaml labels: it says s390x is supported 
      3. Operator failed to deploy 
      4. Image of the container says amd64 insead of s390x 
      

      Actual results:

      oc get pods
      NAME                                                        READY   STATUS   RESTARTS   AGE
      threescale-operator-controller-manager-v2-bcbcfc97d-pvmx5   0/1     Error    12         36m
      
      NAME                                                        READY   STATUS             RESTARTS        AGE   IP           NODE                             NOMINATED NODE   READINESS GATES
      threescale-operator-controller-manager-v2-bcbcfc97d-pvmx5   0/1     CrashLoopBackOff   12 (5m1s ago)   41m   10.129.2.7   worker-3.multiarch.lnxero1.boe   <none>           <none>
      
      oc get csv
      
      NAME                                DISPLAY                 VERSION   REPLACES                           PHASE
      3scale-community-operator.v0.10.1   3scale API Management   0.10.1    3scale-community-operator.v0.9.0   Failed  
      
      [root@bastion ~]# lcsv 3scale-community-operator.v0.10.1 -oyaml|grep -i -A 4 'labels:'
        labels:
          olm.managed: "true"
          operatorframework.io/arch.amd64: supported
          operatorframework.io/arch.ppc64le: supported
          operatorframework.io/arch.s390x: supported
      --  
      
      pod is deployed on s390x worker node and it has failed because the image used for contianer is amd64    
      
      
      [root@worker-3 ~]# podman images |grep -i 6bd26afe9252quay.io/3scale/3scale-operator                  v0.10.1     6bd26afe9252  15 months ago  61 MB
      
      [root@worker-3 ~]# podman inspect 6bd26afe9252 |grep -i arch          "Architecture": "amd64",

      Expected results:

      Operator should be installed successfully 

      Additional info:
      ocp cluster info
      ==============================================================================================
      RUNNING SERVER HEALTH CHECK ... Fri Jun 702:44:59 AM EDT 2024
      ==============================================================================================

      ##############################################################################
      NAME VERSION AVAILABLE PROGRESSING SINCE STATUS
      version 4.16.0-rc.3 True False 2d1h Cluster version is 4.16.0-rc.3
      ##############################################################################

      ##############################################################################
      NAME STATUS ROLES AGE VERSION
      master-0.multiarch.lnxero1.boe Ready control-plane,master 2d1h v1.29.5+87992f4
      master-1.multiarch.lnxero1.boe Ready control-plane,master 2d1h v1.29.5+87992f4
      master-2.multiarch.lnxero1.boe Ready control-plane,master 2d1h v1.29.5+87992f4
      worker-0.multiarch.lnxero1.boe Ready worker 2d1h v1.29.5+87992f4
      worker-1.multiarch.lnxero1.boe Ready worker 2d1h v1.29.5+87992f4
      worker-2.multiarch.lnxero1.boe Ready worker 2m50s v1.29.5+87992f4
      worker-3.multiarch.lnxero1.boe Ready worker 3m44s v1.29.5+87992f4
      ##############################################################################

      ##############################################################################
      NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE
      authentication 4.16.0-rc.3 True False False 26h
      baremetal 4.16.0-rc.3 True False False 2d1h
      cloud-controller-manager 4.16.0-rc.3 True False False 2d1h
      cloud-credential 4.16.0-rc.3 True False False 2d1h
      cluster-autoscaler 4.16.0-rc.3 True False False 2d1h
      config-operator 4.16.0-rc.3 True False False 2d1h
      console 4.16.0-rc.3 True False False 2d1h
      control-plane-machine-set 4.16.0-rc.3 True False False 2d1h
      csi-snapshot-controller 4.16.0-rc.3 True False False 2d1h
      dns 4.16.0-rc.3 True False False 36h
      etcd 4.16.0-rc.3 True False False 40h
      image-registry 4.16.0-rc.3 True False False 2d1h
      ingress 4.16.0-rc.3 True False False 2d1h
      insights 4.16.0-rc.3 True False False 42h
      kube-apiserver 4.16.0-rc.3 True False False 2d1h
      kube-controller-manager 4.16.0-rc.3 True False False 2d1h
      kube-scheduler 4.16.0-rc.3 True False False 2d1h
      kube-storage-version-migrator 4.16.0-rc.3 True False False 2d1h
      machine-api 4.16.0-rc.3 True False False 2d1h
      machine-approver 4.16.0-rc.3 True False False 2d1h
      machine-config 4.16.0-rc.3 True False False 2d1h
      marketplace 4.16.0-rc.3 True False False 2d1h
      monitoring 4.16.0-rc.3 True False False 29h
      network 4.16.0-rc.3 True False False 2d1h
      node-tuning 4.16.0-rc.3 True False False 80s
      openshift-apiserver 4.16.0-rc.3 True False False 29h
      openshift-controller-manager 4.16.0-rc.3 True False False 2d1h
      openshift-samples 4.16.0-rc.3 True False False 2d1h
      operator-lifecycle-manager 4.16.0-rc.3 True False False 2d1h
      operator-lifecycle-manager-catalog 4.16.0-rc.3 True False False 2d1h
      operator-lifecycle-manager-packageserver 4.16.0-rc.3 True False False 40h
      service-ca 4.16.0-rc.3 True False False 2d1h
      storage 4.16.0-rc.3 True False False 2d1h
      ##############################################################################

      ##############################################################################
      GET ALL PODS WHICH ARE NOT IN RUNNING OR COMPLETED STATE ... Fri Jun 702:45:00 AM EDT 2024
      ##############################################################################
      NAMESPACE NAME READY STATUS RESTARTS AGE
      openshift-kube-apiserver installer-4-master-1.multiarch.lnxero1.boe 0/1 Error 0 2d1h
      openshift-kube-controller-manager installer-4-master-0.multiarch.lnxero1.boe 0/1 Error 0 2d1h
      openshift-kube-scheduler installer-6-master-2.multiarch.lnxero1.boe 0/1 Error 0 2d1h
      openshift-operator-lifecycle-manager collect-profiles-28629045-jxp9r 0/1 ContainerCreating 0 0s
      ##############################################################################

      ==============================================================================================
      Openshift Installer pod is failed, Retry Installer pod for the master would be successful. ... Fri Jun 702:45:01 AM EDT 2024
      ==============================================================================================
      ##############################################################################
      CHECK IF WEB UI IS REACHABLE' ... Fri Jun 7 02:45:03 AM EDT 2024
      ##############################################################################

      console-openshift-console.apps.multiarch.lnxero1.boe
      ##############################################################################
      console-openshift-console.apps.multiarch.lnxero1.boe
      <title>Red Hat OpenShift</title>
      <meta name="application-name" content="Red Hat OpenShift" />
      Openshift Console successfully reached

      ==============================================================================================
      SERVER HEALTH CHECK SUCCESSFUL ... Fri Jun 7 02:45:03 AM EDT 2024
      ==============================================================================================

              jpoulin Jeremy Poulin
              apuranda Amrut Purandare
              Doug Slavens Doug Slavens
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: