Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-30817

[4.16] SDN to OVN live migration fail in ARO cluster

XMLWordPrintable

    • Moderate
    • No
    • Proposed
    • False
    • Hide

      None

      Show
      None

      Description of problem:

          

      Version-Release number of selected component (if applicable):

          

      How reproducible:

      SDN2OVN migration failed in two testing clusters

      Steps to Reproduce:

      4.13 SDN upgrade all the way to 4.16 SDN
      4.16 SDN2OVN migration failed in two testing clusters.     

      Actual results:

        $ oc get project | grep openshift-azure-operator openshift-azure-operator                                          Active [weliang@weliang sdn2ovn-multus]$ oc get clusterversion NAME      VERSION                              AVAILABLE   PROGRESSING   SINCE   STATUS version   4.16.0-0.nightly-2024-03-11-041450   True        False         14m     Cluster version is 4.16.0-0.nightly-2024-03-11-041450 
      $ oc get network.config/cluster -o jsonpath='{.status.networkType}' 
      OpenShiftSDN 
      $ oc patch Network.config.openshift.io cluster --type='merge' --patch '{"metadata":{"annotations":{"unsupported-red-hat-internal-testing": "true"}}}' network.config.openshift.io/cluster patched 
      $ oc patch Network.config.openshift.io cluster --type='merge' --patch '{"metadata":{"annotations":{"network.openshift.io/network-type-migration":""}},"spec":{"networkType":"OVNKubernetes"}}' network.config.openshift.io/cluster patched 
      --------------------------------------
      Executing: oc get co   --no-headers | grep -v '.True.*False.*False'
      network                                    4.16.0-0.nightly-2024-03-11-041450   True   True    True    7h54m   DaemonSet "/openshift-ovn-kubernetes/ovnkube-node" rollout is not making progress - pod ovnkube-node-gr9bs is in CrashLoopBackOff State...
      --------------------------------------
      Executing: oc get pod  --no-headers -n openshift-ovn-kubernetes | grep -Ev 'Running|Completed'
      ovnkube-node-gr9bs                      7/9   CrashLoopBackOff   41 (2m8s ago)    86m
      ovnkube-node-kvbft                      7/9   CrashLoopBackOff   41 (2m10s ago)   86m
      ovnkube-node-t65rv                      7/9   CrashLoopBackOff   41 (2m ago)      86m
      ovnkube-node-vlhpd                      7/9   CrashLoopBackOff   41 (119s ago)    86m
      ovnkube-node-w7hg5                      7/9   CrashLoopBackOff   41 (103s ago)    86m
      ovnkube-node-xsgj2                      7/9   CrashLoopBackOff   41 (116s ago)    86m

      Expected results:

      Migration pass

      Additional info:

      must-gather1 for cluster one:
      https://people.redhat.com/~weliang/must-gather1.tar.gz
      must-gather2 for cluster two:
      https://people.redhat.com/~weliang/must-gather2.tar.gz
       
      Addition information:
      4.13 SDN upgrade all the way to 4.15 SDN
      4.15 SDN2OVN migration pass when manually to oc new-project dedicated-admin

            pliurh Peng Liu
            weliang1@redhat.com Weibin Liang
            Weibin Liang Weibin Liang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: