Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-20336

Upgrade from 4.13.13 to 4.14rc2 failed at 250 nodes.

    XMLWordPrintable

Details

    • No
    • SDN Sprint 243, SDN Sprint 244, SDN Sprint 245, SDN Sprint 246, SDN Sprint 247, SDN Sprint 248, SDN Sprint 249, SDN Sprint 250
    • 8
    • Rejected
    • False
    • Hide

      None

      Show
      None

    Description

      Description of problem:
      While upgrading a loaded 250 node ROSA cluster from 4.13.13 to 4.14.rc2 the cluster failed to upgrade and was stuck at when network operator was trying
      to upgrade.
      Around 20 multus pods were in CrashLookpack state with the log

      oc logs multus-4px8t
2023-10-10T00:54:34+00:00 [cnibincopy] Successfully copied files in /usr/src/multus-cni/rhel9/bin/ to /host/opt/cni/bin/upgrade_6dcb644a-4164-42a5-8f1e-4ae2c04dc315
2023-10-10T00:54:34+00:00 [cnibincopy] Successfully moved files in /host/opt/cni/bin/upgrade_6dcb644a-4164-42a5-8f1e-4ae2c04dc315 to /host/opt/cni/bin/
2023-10-10T00:54:34Z [verbose] multus-daemon started
2023-10-10T00:54:34Z [verbose] Readiness Indicator file check
2023-10-10T00:55:19Z [error] have you checked that your default network is ready? still waiting for readinessindicatorfile @ /host/run/multus/cni/net.d/10-ovn-kubernetes.conf. pollimmediate error: timed out waiting for the condition

      Attachments

        Issue Links

          is depended on by

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-29230 Upgrade from 4.13.13 to 4.14rc2 failed at 250 nodes.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed
          links to

          GitHub openshift/ovn-kubernetes#2057: OCPBUGS-20336,OCPBUGS-28558: [DownstreamMerge] 7 Feb 2024

          Web Link RHEA-2024:0041 OpenShift Container Platform 4.16.z bug fix update

          Web Link Separate timeout for handler sync from informer sync and do not resync services during node tracker startup

          Activity

            People

              rravaiol@redhat.com Riccardo Ravaioli
              mohit-sheth Mohit Jitendra Sheth
              Mohit Jitendra Sheth Mohit Jitendra Sheth
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: