Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-7173

[OVN] DHCP timeouts on Azure arm64, install fails

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • 4.13
    • RHCOS
    • Important
    • None
    • 3
    • Rejected
    • False
    • Hide

      None

      Show
      None
    • Hide
      * Previously, on Azure, the SR-IOV interface was configured by NetworkManager during boot because the udev rule that marks it as `NM_UNMANAGED` wasn't in the `initramfs` files. With this update, the udev rule is now in the `initramfs` files and the SR-IOV interface should always be unmanaged by NetworkManager. (link:https://issues.redhat.com/browse/OCPBUGS-7173[*OCPBUGS-7173*])
      Show
      * Previously, on Azure, the SR-IOV interface was configured by NetworkManager during boot because the udev rule that marks it as `NM_UNMANAGED` wasn't in the `initramfs` files. With this update, the udev rule is now in the `initramfs` files and the SR-IOV interface should always be unmanaged by NetworkManager. (link: https://issues.redhat.com/browse/OCPBUGS-7173 [* OCPBUGS-7173 *])
    • Bug Fix
    • Done

      Description of problem:

      CI job has failed twice due to DHCP failures

      periodic-ci-openshift-openshift-tests-private-release-4.12-arm64-stable-azure-ipi-disconnected-fullyprivate

      NetworkManager[1411] <info>  [1672699601.8899] dhcp4 (br-ex): canceled DHCP transaction
NetworkManager[1411] <info>  [1672699601.8901] device (br-ex): released from master device br-ex
NetworkManager[1411] <warn>  [1672699601.8903] device (br-ex): Activation: failed for connection 'ovs-if-br-ex'
NetworkManager[1411] <info>  [1672699601.8910] device (br-ex): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
NetworkManager[1411] <info>  [1672699601.8914] device (br-ex): state change: disconnected -> unmanaged (reason 'user-requested', sys-iface-state: 'managed')

ERROR: Cannot bring up connection ovs-if-br-ex after 10 attempts

      Version-Release number of selected component (if applicable):

      
4.12.0-0.nightly-arm64-2023-01-02-175115

      How reproducible:

      
2 times

      Steps to Reproduce:

      1.  periodic-ci-openshift-openshift-tests-private-release-4.12-arm64-stable-azure-ipi-disconnected-fullyprivate-p2-f14
2.
3.

      Actual results:

      DHCP fails on one master, OVN pod fails in CrashLoopBackOff

      
ERROR: Cannot bring up connection ovs-if-br-ex after 10 attempts

      Expected results:

      Successful install

      Additional info:

      Failed jobs

      https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-arm64-stable-azure-ipi-disconnected-fullyprivate-p2-f14/1609512728848764928

      https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-arm64-nightly-azure-ipi-ovn-ipsec-p2-f14/1610036487733121024

      Failed syslogs

      https://gcsweb-qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-arm64-stable-azure-ipi-disconnected-fullyprivate-p2-f14/1609512728848764928/artifacts/azure-ipi-disconnected-fullyprivate-p2-f14/gather-extra/artifacts/nodes/ci-op-whfndg5t-ea48b-2lw7f-worker-northcentralus-gg848/journal

      https://gcsweb-qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-arm64-nightly-azure-ipi-ovn-ipsec-p2-f14/1610036487733121024/artifacts/azure-ipi-ovn-ipsec-p2-f14/gather-extra/artifacts/nodes/ci-op-6cj504gm-14224-q4pns-master-1/journal

      [OCPQE-13424]

              rhn-gps-dmabe Dusty Mabe
              rbrattai@redhat.com Ross Brattain
              Anurag Saxena Anurag Saxena
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: