Uploaded image for project: 'Fast Datapath Product'
  1. Fast Datapath Product
  2. FDP-2564

QE verification: [dpdkbonding] next rebalance status flapping too slow

    • False
    • Hide

      None

      Show
      None
    • False
    • Hide

      ( ) The bug has been reproduced and verified by QE members
      ( ) Test coverage has been added to downstream CI
      ( ) For new feature, failed test plans have bugs added as children to the epic
      ( ) The bug is cloned to any relevant release that we support and/or is needed

      Show
      ( ) The bug has been reproduced and verified by QE members ( ) Test coverage has been added to downstream CI ( ) For new feature, failed test plans have bugs added as children to the epic ( ) The bug is cloned to any relevant release that we support and/or is needed
    • None
    • rhel-net-ovs-dpdk

      This ticket is tracking the QE verification effort for the solution to the problem described below.
      Description:
      after add ovs-vsctl set Open_vSwitch . other_config:max-idle=3600000 and ovs-vsctl set Open_vSwitch . other_config:max-revalidator=3600000. The LACP rebalance didn't show as well. 'next rebalance' displays an illegal negative number and is very large.

      ovs version:

      1. rpm -qa | grep openvswitch
        openvswitch-selinux-extra-policy-1.0-34.el9fdp.noarch
        openvswitch3.2-3.2.0-32.el9fdp.x86_64
        python3-openvswitch3.2-3.2.0-32.el9fdp.x86_64
        openvswitch3.2-test-3.2.0-32.el9fdp.noarch

      kernel version:
      5.14.0-362.8.1.el9_3.x86_64

      test nic:

      ethtool -i ens1f0np0
      driver: mlx5_core
      version: 5.14.0-362.8.1.el9_3.x86_64
      firmware-version: 16.34.1002 (MT_0000000080)
      expansion-rom-version:
      bus-info: 0000:12:00.0
      supports-statistics: yes
      supports-test: yes
      supports-eeprom-access: no
      supports-register-dump: no
      supports-priv-flags: yes

      ethtool -i ens1f1np1
      driver: mlx5_core
      version: 5.14.0-362.8.1.el9_3.x86_64
      firmware-version: 16.34.1002 (MT_0000000080)
      expansion-rom-version:
      bus-info: 0000:12:00.1
      supports-statistics: yes
      supports-test: yes
      supports-eeprom-access: no
      supports-register-dump: no
      supports-priv-flags: yes

      cat /sys/class/net/ens1f0np0/device/numa_node
      0

      numactl --hardware
      available: 2 nodes (0-1)
      node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
      node 0 size: 63812 MB
      node 0 free: 30229 MB
      node 1 cpus: 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39
      node 1 size: 62455 MB
      node 1 free: 31108 MB
      node distances:
      node 0 1
      0: 10 21
      1: 21 10

      test step:

      systemctl start openvswitch
      ovs-appctl vlog/set console:lacp:dbg syslog:lacp:dbg file:lacp:dbg
      ovs-appctl vlog/set console:bond:dbg syslog:bond:dbg file:bond:dbg
      ovs-vsctl set Open_vSwitch . 'other_config={}'
      ovs-vsctl set Open_vSwitch . other_config:dpdk-socket-mem=4096,4096

      ovs-vsctl set Open_vSwitch . other_config:pmd-cpu-mask=0x7f800

      ovs-vsctl set Open_vSwitch . other_config:dpdk-lcore-mask=0x400
      ovs-vsctl set Open_vSwitch . other_config:dpdk-init=true
      ovs-vsctl --if-exists del-br ovsbr0
      ovs-vsctl --may-exist add-br ovsbr0 – set bridge ovsbr0 datapath_type=netdev
      ovs-vsctl add-bond ovsbr0 balance-tcp ens1f1np1 ens1f0np0 lacp=active bond_mode=balance-tcp \
      – set Interface ens1f1np1 type=dpdk options:dpdk-devargs=class=eth,mac=04:3f:72:b0:35:32 options:rx-steering=rss+lacp \
      – set Interface ens1f0np0 type=dpdk options:dpdk-devargs=class=eth,mac=04:3f:72:b0:35:33 options:rx-steering=rss+lacp
      ovs-vsctl set Open_vSwitch . other_config:max-idle=3600000
      ovs-vsctl set Open_vSwitch . other_config:max-revalidator=3600000

      ovs-vsctl show
      f8dc5c40-cc3b-4901-8e3a-4b45cf72cfe5
      Bridge ovsbr0
      datapath_type: netdev
      Port balance-tcp
      Interface ens1f1np1
      type: dpdk
      options: {dpdk-devargs="class=eth,mac=04:3f:72:b0:35:32", rx-steering="rss+lacp"}

      Interface ens1f0np0
      type: dpdk
      options:

      {dpdk-devargs="class=eth,mac=04:3f:72:b0:35:33", rx-steering="rss+lacp"}

      Port ovsbr0
      Interface ovsbr0
      type: internal
      ovs_version: "3.2.2"

      ovs-vsctl list Open_vSwitch .
      _uuid : 94a4eafd-a60e-4b55-a525-a342cf1b0eca
      bridges : [390f2c3b-0612-40cf-b2c6-3a7b6e158f9d]
      cur_cfg : 8
      datapath_types : [netdev, system]
      datapaths : {}
      db_version : "8.4.0"
      dpdk_initialized : true
      dpdk_version : "DPDK 22.11.1"
      external_ids :

      {hostname=hp-dl388g10-03.rhts.eng.pek2.redhat.com, rundir="/var/run/openvswitch", system-id="ca8aa5e9-866f-49a6-9b6a-958f5bec420a"}

      iface_types : [bareudp, dpdk, dpdkvhostuser, dpdkvhostuserclient, erspan, geneve, gre, gtpu, internal, ip6erspan, ip6gre, lisp, patch, srv6, stt, system, tap, vxlan]
      manager_options : []
      next_cfg : 8
      other_config :

      {dpdk-init="true", dpdk-lcore-mask="0x400", dpdk-socket-mem="4096,4096", max-idle="3600000", max-revalidator="3600000", pmd-cpu-mask="0x7f800"}

      ovs_version : "3.2.2"
      ssl : []
      statistics : {}
      system_type : rhel
      system_version : "9.3"

      expect result: use ovs-appctl bond/show will check 'next rebalance' status work as well

      actual result:'next rebalance' displays an illegal negative number and is very large

      ovs-appctl bond/show
      ---- balance-tcp ----
      bond_mode: balance-tcp
      bond may use recirculation: yes, Recirc-ID : 1
      bond-hash-basis: 0
      lb_output action: enabled, bond-id: 1
      updelay: 0 ms
      downdelay: 0 ms
      next rebalance: -19274 ms
      lacp_status: negotiated
      lacp_fallback_ab: false
      active-backup primary: <none>
      active member mac: 04:3f:72:b0:35:33(ens1f0np0)

      member ens1f0np0: enabled
      active member
      may_enable: true

      member ens1f1np1: enabled
      may_enable: true

              ovsdpdk-triage ovsdpdk triage
              nstbot NST Bot
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: