Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-57638

Hypershift network clusteroperator is failing the upgrade procedure 4.18.17->4.19.0

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      hypershift upgrade upgrade 4.18.17->4.19.0 fails

      Version-Release number of selected component (if applicable):

          

      How reproducible:

          1/1

      Steps to Reproduce:

          deploy a 4.19 hub cluster with hosted cluster 4.18->4.19 (I used this job running in steps  :https://jenkins-csb-kniqe-auto.dno.corp.redhat.com/job/CI/job/job-runner/5360/parameters/  )
          
      
      
      
      Actual results:
      (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc get clusterversions --kubeconfig ~/clusterconfigs/hosted-0/auth/kubeconfig
      NAME      VERSION   AVAILABLE   PROGRESSING   SINCE   STATUS
      version   4.18.17   True        True          72m     Unable to apply 4.19.0: wait has exceeded 40 minutes for these operators: network
      
        (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$  oc get co -A --kubeconfig ~/clusterconfigs/hosted-0/auth/kubeconfig
      NAME                                       VERSION   AVAILABLE   PROGRESSING   DEGRADED   SINCE   MESSAGE
      console                                    4.19.0    True        False         False      18h     
      csi-snapshot-controller                    4.19.0    True        False         False      81m     
      dns                                        4.19.0    True        False         False      18h     
      image-registry                             4.19.0    True        False         False      18h     
      ingress                                    4.19.0    True        False         False      18h     
      insights                                   4.19.0    True        False         False      18h     
      kube-apiserver                             4.19.0    True        False         False      19h     
      kube-controller-manager                    4.19.0    True        False         False      19h     
      kube-scheduler                             4.19.0    True        False         False      19h     
      kube-storage-version-migrator              4.19.0    True        False         False      18h     
      monitoring                                 4.19.0    True        False         False      18h     
      network                                    4.19.0    True        False         True       18h     Error while updating operator configuration: could not apply (apps/v1, Kind=Deployment) openshift-frr-k8s/frr-k8s-webhook-server: failed to apply / update (apps/v1, Kind=Deployment) openshift-frr-k8s/frr-k8s-webhook-server: Deployment.apps "frr-k8s-webhook-server" is invalid: spec.template.spec.containers[0].image: Required value
      node-tuning                                4.19.0    True        False         False      69m     
      openshift-apiserver                        4.19.0    True        False         False      19h     
      openshift-controller-manager               4.19.0    True        False         False      19h     
      openshift-samples                          4.19.0    True        False         False      18h     
      operator-lifecycle-manager                 4.19.0    True        False         False      19h     
      operator-lifecycle-manager-catalog         4.19.0    True        False         False      19h     
      operator-lifecycle-manager-packageserver   4.19.0    True        False         False      19h     
      service-ca                                 4.19.0    True        False         False      18h     
      storage                                    4.19.0    True        False         False      19h     
      
       (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$  oc get co -A --kubeconfig ~/clusterconfigs/hosted-0/auth/kubeconfig network -ojson | jq ".status.conditions"[1].message
      "Error while updating operator configuration: could not apply (apps/v1, Kind=Deployment) openshift-frr-k8s/frr-k8s-webhook-server: failed to apply / update (apps/v1, Kind=Deployment) openshift-frr-k8s/frr-k8s-webhook-server: Deployment.apps \"frr-k8s-webhook-server\" is invalid: spec.template.spec.containers[0].image: Required value"
      (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ 
       

      Expected results:

          upgrading to 4.19.0 ends succesfully

      Additional info:

          must-gather : https://drive.google.com/file/d/1GRhBBiP4I_oahSmnTrmx0dajXkfvjwFM/view?usp=sharing

              jcaamano@redhat.com Jaime Caamaño Ruiz
              rhn-support-gamado Gal Amado
              None
              None
              Yu Li Yu Li
              None
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: