Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-3127

nodeip-configuration retries forever on network failure, blocking ovs-configuration, spamming syslog

    XMLWordPrintable

Details

    • Important
    • Rejected
    • Hide

      None

      Show
      None

    Description

      Description of problem:

      When nodeip-configuration fails it log spams syslog hindering debug.
      
      libvirt IPI OVN bonding active-backup fail_over_mac=0.  
      
      When ovs-configuration fails or we somehow end up with no IPs, nodeip-configuration constantly syslog spams.
      
      
      

      Version-Release number of selected component (if applicable):

      
      4.12.0-0.nightly-2022-10-25-121937
      

      How reproducible:

      Always
      

      Steps to Reproduce:

      1. Somehow break the network, link down all links or disable DHCP servers.
      2. System has no IP addresses.
      3. journalctl -f
      
      

      Actual results:

      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered address fe80::1825:a3ff:fe21:2caf/64"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="retrieved Address map map[0xc00039b7a0:[127.0.0.1/8 lo ::1/128] 0xc00039b8c0:[192.0.2.42/24 enp4s0]]"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Checking whether address 192.0.2.42/24 enp4s0 contains VIP 192.168.123.5"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Checking whether address 127.0.0.1/8 lo contains VIP 192.168.123.5"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered route {Ifindex: 2 Dst: 192.0.2.0/24 Src: 192.0.2.42 Gw: <nil> Flags: [] Table: 254}"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered route {Ifindex: 1 Dst: ::1/128 Src: <nil> Gw: <nil> Flags: [] Table: 254}"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered route {Ifindex: 7 Dst: fe80::/64 Src: <nil> Gw: <nil> Flags: [] Table: 254}"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Retrieved route map map[]"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered address fe80::1825:a3ff:fe21:2caf/64"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="retrieved Address map map[0xc000266480:[127.0.0.1/8 lo ::1/128] 0xc0002665a0:[192.0.2.42/24 enp4s0]]"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered route {Ifindex: 2 Dst: 192.0.2.0/24 Src: 192.0.2.42 Gw: <nil> Flags: [] Table: 254}"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered route {Ifindex: 1 Dst: ::1/128 Src: <nil> Gw: <nil> Flags: [] Table: 254}"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Ignoring filtered route {Ifindex: 7 Dst: fe80::/64 Src: <nil> Gw: <nil> Flags: [] Table: 254}"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=debug msg="Retrieved route map map[]"
      Nov 02 20:49:49 master-0-2 bash[2059]: time="2022-11-02T20:49:49Z" level=error msg="Failed to find a suitable node IP"
      
      
      journalctl | grep -c -F 'level=error msg="Failed to find a suitable node IP"'
      32278
      
      

      Expected results:

      
      Exponential back-off?  Some other kind of failure mode that doesn't fill journald.
      
      

      Additional info:

      
      

      Attachments

        Activity

          People

            rhn-support-dougsland Douglas Landgraf
            rbrattai@redhat.com Ross Brattain
            Ross Brattain Ross Brattain
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: