Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-34430

bond0 loses DHCP address when Open vSwitch Bridge device is added

XMLWordPrintable

    • Important
    • No
    • Rejected
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      This is different to https://issues.redhat.com/browse/OCPBUGS-18716 - the bond mac is not changing and we tested with 4.16-rc2

      When the server first boots, ping works for 2 or 3 intervals. As soon as configure-ovs.sh runs and starts changing devices, it dies.

      We see this with the initial lease:

      May 24 13:26:05 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557165.1741] dhcp4 (bond0): state changed new lease, address=10.3.42.112

      This is what the network looks like over time during the startup:

      The mac addresses on enp1s0 and enp2s0 get flipped when bond0 is disconnected during the OVS port creation and we can no longer get an IP from DHCP. It is unclear if the mac flip is causing DHCP to fail or if the disconnect is and it doesn't retry.

      The new port devices are created which trigger bond0 to disconnect

      May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.2062] manager: (br-ex): new Open vSwitch Bridge device (/org/freedesktop/NetworkManager/Devices/5)
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.2071] audit: op="connection-add" uuid="8bc82602-d03d-451d-b21e-7d075fec60d4" name="br-ex" pid=3329 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.2557] manager: (bond0): new Open vSwitch Port device (/org/freedesktop/NetworkManager/Devices/6)
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.2558] audit: op="connection-add" uuid="74f877d9-d123-4645-8d05-7a6c766317b0" name="ovs-port-phys0" pid=3338 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.2977] manager: (br-ex): new Open vSwitch Port device (/org/freedesktop/NetworkManager/Devices/7)
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.2980] audit: op="connection-add" uuid="1650b7d0-f161-432f-a34e-e2d062a94fbe" name="ovs-port-br-ex" pid=3347 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.4040] audit: op="connection-add" uuid="e62dce43-e277-410c-93b4-ab91463f6237" name="ovs-if-phys0" pid=3368 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.7129] audit: op="connection-add" uuid="8d4a806b-5eaf-44f9-a539-19682857728a" name="enp1s0-slave-ovs-clone" pid=3449 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.7418] audit: op="connection-update" uuid="8d4a806b-5eaf-44f9-a539-19682857728a" name="enp1s0-slave-ovs-clone" args="connection.master,connection.timestamp" pid=3456 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.7562] audit: op="connection-update" uuid="8d4a806b-5eaf-44f9-a539-19682857728a" name="enp1s0-slave-ovs-clone" args="connection.autoconnect-priority" pid=3460 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.7705] audit: op="connection-update" uuid="8d4a806b-5eaf-44f9-a539-19682857728a" name="enp1s0-slave-ovs-clone" args="connection.autoconnect" pid=3464 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.8510] audit: op="connection-add" uuid="75c30fef-d073-4d21-ab8d-e15ccb58b655" name="enp2s0-slave-ovs-clone" pid=3489 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.8787] audit: op="connection-update" uuid="75c30fef-d073-4d21-ab8d-e15ccb58b655" name="enp2s0-slave-ovs-clone" args="connection.master,connection.timestamp" pid=3496 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.8966] audit: op="connection-update" uuid="75c30fef-d073-4d21-ab8d-e15ccb58b655" name="enp2s0-slave-ovs-clone" args="connection.autoconnect-priority" pid=3500 uid=0 result="success"
May 24 13:26:26 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557186.9145] audit: op="connection-update" uuid="75c30fef-d073-4d21-ab8d-e15ccb58b655" name="enp2s0-slave-ovs-clone" args="connection.autoconnect" pid=3504 uid=0 result="success"
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.1986] manager: (br-ex): new Open vSwitch Interface device (/org/freedesktop/NetworkManager/Devices/8)
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.1989] audit: op="connection-add" uuid="f9514349-d72a-4194-9d37-3ab84c548c9f" name="ovs-if-br-ex" pid=3563 uid=0 result="success"
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.3272] audit: op="connection-update" uuid="8d4a806b-5eaf-44f9-a539-19682857728a" name="enp1s0-slave-ovs-clone" args="connection.autoconnect" pid=3594 uid=0 result="success"
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.3653] audit: op="connection-update" uuid="75c30fef-d073-4d21-ab8d-e15ccb58b655" name="enp2s0-slave-ovs-clone" args="connection.autoconnect" pid=3602 uid=0 result="success"
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4274] agent-manager: agent[668e740d9395eb51,:1.124/nmcli-connect/0]: agent registered
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4283] device (br-ex): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external')
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4288] device (br-ex): state change: unavailable -> disconnected (reason 'user-requested', sys-iface-state: 'managed')
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4291] device (br-ex): Activation: starting connection 'br-ex' (8bc82602-d03d-451d-b21e-7d075fec60d4)
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4292] audit: op="connection-activate" uuid="8bc82602-d03d-451d-b21e-7d075fec60d4" name="br-ex" pid=3618 uid=0 result="success"
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4293] device (bond0): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external')
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4297] device (bond0): state change: unavailable -> disconnected (reason 'user-requested', sys-iface-state: 'managed')

      This leads to NM CONNECTED_LOCAL which indicates no external network:

      May 24 13:27:13 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557233.6921] manager: NetworkManager state is now CONNECTED_LOCAL

      You can see in the script debug, the routes are now empty:

      1255 May 24 13:34:48 lab-int-poc-master-1 configure-ovs.sh[3135]: ++ ip route show
1256 May 24 13:34:48 lab-int-poc-master-1 configure-ovs.sh[3135]: ++ ip -6 route show
1257 May 24 13:34:48 lab-int-poc-master-1 configure-ovs.sh[6754]: ::1 dev lo proto kernel metric 256 pref medium

      This cancels or causes the DHCP transaction to fail:

      May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4822] dhcp4 (bond0): canceled DHCP transaction
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4823] dhcp4 (bond0): activation: beginning transaction (no timeout)
May 24 13:26:27 lab-int-poc-master-1 NetworkManager[2193]: <info>  [1716557187.4823] dhcp4 (bond0): state changed no lease

      This also causes the mac's to flip:

      May 24 13:26:27 lab-int-poc-master-1 kernel: bond0: (slave enp1s0): the permanent HWaddr of slave - 02:1b:30:00:00:08 - is still in use by bond - set the HWaddr of slave to a different address to avoid conflicts

      You see configure-ovs then fail activating br-ex due to no IP:

      May 24 13:26:28 lab-int-poc-master-1 configure-ovs.sh[4316]: ++ nmcli -g GENERAL.STATE conn show ovs-if-br-ex
May 24 13:26:28 lab-int-poc-master-1 configure-ovs.sh[3135]: + local active_state=
May 24 13:26:28 lab-int-poc-master-1 configure-ovs.sh[3135]: + '[' '' == activated ']'
May 24 13:26:28 lab-int-poc-master-1 configure-ovs.sh[3135]: + for i in {1..10}
May 24 13:26:28 lab-int-poc-master-1 configure-ovs.sh[3135]: + echo 'Attempt 1 to bring up connection ovs-if-br-ex'
May 24 13:26:28 lab-int-poc-master-1 configure-ovs.sh[3135]: Attempt 1 to bring up connection ovs-if-br-ex
May 24 13:26:28 lab-int-poc-master-1 configure-ovs.sh[3135]: + nmcli conn up ovs-if-br-ex
May 24 13:27:13 lab-int-poc-master-1 configure-ovs.sh[4326]: Error: Connection activation failed: IP configuration could not be reserved (no available address, timeout, etc.)
May 24 13:27:13 lab-int-poc-master-1 configure-ovs.sh[4326]: Hint: use 'journalctl -xe NM_CONNECTION=f9514349-d72a-4194-9d37-3ab84c548c9f + NM_DEVICE=br-ex' to get more details.

      Eventually it fails and reverts and the network comes back on bond0 without br-ex:

      1794 May 24 13:34:49 lab-int-poc-master-1 configure-ovs.sh[3135]: ++ echo 'OVS configuration successfully reverted'
1795 May 24 13:34:49 lab-int-poc-master-1 configure-ovs.sh[3135]: OVS configuration successfully reverted
1796 May 24 13:34:49 lab-int-poc-master-1 configure-ovs.sh[3135]: ++ reload_profiles_nm bond0 ''

1823 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[3135]: ++ ip -d address show
1824 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]: 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
1825 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 promiscuity 0 minmtu 0 maxmtu 0 numtxqueues 1 numrxqueues 1 gso_max_size 65536 gso_max_segs 65535      tso_max_size 524280 tso_max_segs 65535 gro_max_size 65536
1826 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     inet 127.0.0.1/8 scope host lo
1827 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:        valid_lft forever preferred_lft forever
1828 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     inet6 ::1/128 scope host
1829 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:        valid_lft forever preferred_lft forever
1830 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]: 2: enp1s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
1831 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     link/ether 02:1b:30:00:00:08 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 1500
1832 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     bond_slave state ACTIVE mii_status UP link_failure_count 0 perm_hwaddr 02:1b:30:00:00:08 queue_id 0 numtxqueues 6 numrxqueues 6 gso_max_size 65536 gso_m     ax_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536 parentbus virtio parentdev virtio0
1833 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]: 3: enp2s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
1834 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     link/ether 02:1b:30:00:00:15 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 1500
1835 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     bond_slave state ACTIVE mii_status UP link_failure_count 0 perm_hwaddr 02:1b:30:00:00:15 queue_id 0 numtxqueues 6 numrxqueues 6 gso_max_size 65536 gso_m     ax_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536 parentbus virtio parentdev virtio1
1836 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]: 19: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
1837 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     link/ether 02:1b:30:00:00:08 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535
1838 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     bond mode balance-alb active_slave enp1s0 miimon 140 updelay 0 downdelay 0 peer_notify_delay 0 use_carrier 1 arp_interval 0 arp_missed_max 2 arp_validat     e none arp_all_targets any primary_reselect always fail_over_mac none xmit_hash_policy layer2 resend_igmp 1 num_grat_arp 1 all_slaves_active 0 min_links 0 lp_interval 1 packets_per_slave 1 lacp_active on lacp_rate slow ad_s     elect stable tlb_dynamic_lb 1 numtxqueues 16 numrxqueues 16 gso_max_size 65536 gso_max_segs 65535 tso_max_size 65536 tso_max_segs 65535 gro_max_size 65536
1839 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:     inet 10.3.42.112/24 brd 10.3.42.255 scope global dynamic noprefixroute bond0
1840 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7583]:        valid_lft 2591990sec preferred_lft 2591990sec
1841 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[3135]: ++ ip route show
1842 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7584]: default via 10.3.42.1 dev bond0 proto dhcp src 10.3.42.112 metric 300
1843 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[7584]: 10.3.42.0/24 dev bond0 proto kernel scope link src 10.3.42.112 metric 300
1844 May 24 13:34:59 lab-int-poc-master-1 configure-ovs.sh[3135]: ++ ip -6 route show

      So we have bond0 and br-ex with no IP and the slave interfaces with flipped macs:

      [core@ocp-udc-lab-int-4-master-0: ip a 

1: lo: <LOOPBACK, UP, LOUER UP> ntu 65536 noqueue state UMKHOUN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.18 scope host lo
       valid_Ift forever preferred_Ift forever 
    inet6 :: 1/128 scope host
       valid_Ift forever preferred_Ift forever
2: enp1s0: <BROADCAST, MULTICAST ,SLAUE, UP, LOWER_UP> ntu 1500 qdisc ng naster bond® state UP group default glen 1000 
    link/ether 02:1b:30:00:00:17 brd ff:ff:ff:ff:ff:ff pernaddr 02:1b:30:00:00:06
3: enp2s0: <BROADCAST, MULTICAST, SLAUE, UP, LOUER_UP> ntu 1500 qdisc ng naster bond® state UP group default qlen 1000
    link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff pernaddr 02:1b:30:00:00:17
5: bondO: <BROADCAST,HULTICAST, MASTER,UP, LOWER UP> ntu 1500 disc noqueue naster ous-systen state UP group default qlen 1000 
    link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff
7: ovs-systen: <BROADCAST, MULTICAST> ntu 1500 qdisc noop state DOUN group default qlen 1000
    link/ether 86:31:65:8e:df:bb brd ffiffiff:ff:ff:ff
8: br-ex: <BROADCAST, HULTICAST,UP ,LOUER UP> ntu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 
    link/ether 02:16:30:00:00:06 brd ff:ff:ff:ff:ff:ff

      After 20 seconds we restart openvswitch which reverts the config, which fixes the mac addresses and gets our DHCP IP back on bond0

      31.5233321 configure-ous.shf1740): OVS configuration successfully reverted
31.524757] configure-ous.sh[1740]: ** reload_profiles_nn bond0 "'
31.526167] configure-ous.shf1740J: ** '[' 1 -eq 0 ']'
31.5274971 configure-ous.shl1740J: ** mncli connection reload
31.528819] configure-ous.sh[1740]: ** sleep 10

[core@ocp-udc-lab-int-4-naster-0: ip a
1: lo: <L0OPBACK,UP,LOUER_UP> ntu 65536 qdisc noqueue state UMKNOUN group default qien 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
      inet 127.0.0.1/8 scope host lo
         valid_lft forever preferred_lft forever
      inet6 ::1/128 scope host 
          valid lft forever preferred_lft forever
2: enp1s0: <BROADCAST, MULTICAST, SLAVE, UP,LOVER_UP> ntu 1500 qdisc ny naster bondO state UP group default qlen 1000
      link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff
3: enp2s0: <BROADCAST, MULTICAST, SLAVE, UP, LOWER_UP> ntu 1500 qdisc nq naster bondO state UP group default qlen 1000
      link/ether 02:1b:30:00:00:17 brd ff:ff:ff:ff:ff:ff
11: bond0: <BROADCAST, MULTICAST, MASTER,UP,LOUER_UP> ntu 1500 qdisc noqueue state UP group default qlen 1000
      link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff
       inet 10.3.42.228/24 brd 10.3.42.255 scope global dynamic noprefixroute bond0
          valid_lft 2591998sec preferred_lft 2591998sec

      Restarting NetworkManager again breaks things by causing the MACs to flip.

      configure-ous.sh[4327]: + for for 1 in (1..10)
configure-ous.sh[4327]: * echo 'Attempt 1 to bring up connection ovs-if-br-ex'
configure-ous.shI4327]: Attenpt 1 to bring up connection ovs-if-br-ex
configure-ous.sh[1327]: + nmcli conn up ovs-if-br-ex

[core@ocp-udc-lab-int-4-naster-0: ip a

1: lo: <LOOPBACK,UP ,LOUER_UP> ntu 65536 qdisc noqueue state UNKNOUN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_Ift forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST, MULTICAST,SLAVE, UP ,LOWER_UP> ntu 1500 qdisc nq naster bond® state UP group default qlen 1000 
      link/ether 02:1b:30:00:00:17 brd ff:ff:ff:ff:ff:ff permaddr 02:1b:30:00:00:06
3: enp2s0: <BROADCAST, HULTICAST, SLAVE,UP, LOWER_UP> ntu 1500 qdisc ny naster bondo state UP group default qlen 1000
      link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff permaddr 02:1b:30:00:00:17
11: bond0: BROADCAST,MULTICAST,MASTER,UP, LOUER UP> ,tu 1500 qdisc noqueue naster ous-systen state UP group default glen 1000
      link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff
13: ovs-systen: <BROADCAST, MULTICAST> ntu 1500 qdisc noop state DOWN group default qlen 1000
      link/ether ca:11:16:05:ac:08 brd ff:ff:ff:ff:ff:ff
14: br-ex: <BROADCAST, HULTICAST,UP ,LOUER UP> ntu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 
    link/ether 02:16:30:00:00:06 brd ff:ff:ff:ff:ff:ff

      After a 10s sleep, we clean the br-ex flows and restart both NM and OVS at the same time:

      sudo ovs-ofctl del-flows br-ex
sudo systemctl restart NetworkManager openvswitch

      Which brings us into the final good state with br-ex having the correct IP:

      1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff
3: enp2s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 02:1b:30:00:00:17 brd ff:ff:ff:ff:ff:ff
17: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
    link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff
18: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether ca:ae:31:b8:80:b7 brd ff:ff:ff:ff:ff:ff
19: br-ex: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 02:1b:30:00:00:06 brd ff:ff:ff:ff:ff:ff
    inet 10.3.42.228/24 brd 10.3.42.255 scope global dynamic noprefixroute br-ex
       valid_lft 2591907sec preferred_lft 2591907sec

      The nmstate config looks like this, but we have tried a few different things

      interfaces:
- name: bond0
  type: bond
  lldp:
    enabled: true
  mac-address: "02:1b:30:00:00:06"
  state: up
  ipv4:
    dhcp: true
    enabled: true
  ipv6:
    enabled: false
  link-aggregation:
    mode: balance-alb
    options:
      miimon: '140'
    port:
    - enp1s0
    - enp2s0
- name: enp1s0
  type: ethernet
  state: up
  mac-address: "02:1b:30:00:00:06"
- name: enp2s0
  type: ethernet
  state: up
  mac-address: "02:1b:30:00:00:17"

      Version-Release number of selected component (if applicable):

      4.15.13 and 4.16-rc2

      How reproducible:
      Always

      Steps to Reproduce:

      1. 3 node Baremetal or VMs via Assisted Installer with nmstate configured bond mode6

      2.

      3.

      Actual results:
      Installation Failure on configure-ovs.sh due to a lack of IP

      Expected results:
      Successful install

      Additional info:

      Affected Platforms:

      Is it an customer issue / SD

            bnemec@redhat.com Benjamin Nemec
            rhn-support-mrobson Matt Robson
            Qiong Wang Qiong Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: