Uploaded image for project: 'Fast Datapath Product'
  1. Fast Datapath Product
  2. FDP-818

ixgbe card: the NIC Link is Down when change the mtu of vf dpdk port

XMLWordPrintable

    • 13
    • False
    • Hide

      None

      Show
      None
    • False
    • Hide

      Given an OVS setup with DPDK and an ixgbe network card, 

      When the MTU of a VF DPDK port is changed to any valid value, 

      Then, the NIC link should remain up and stable
      without interruption and the new MTU should be successfully applied to the VF DPDK port.

      Show
      Given an OVS setup with DPDK and an ixgbe network card,  When the MTU of a VF DPDK port is changed to any valid value,  Then, the NIC link should remain up and stable without interruption and the new MTU should be successfully applied to the VF DPDK port.
    • rhel-sst-network-fastdatapath
    • ssg_networking
    • OVS/DPDK - FDP 25A
    • Moderate

      [Imported from FD-2840]

      Description of problem:
      ixgbe card: the NIC Link is Down when change the mtu of vf dpdk port

      Version-Release number of selected component (if applicable):
      [root@dell-per750-37 ~]# uname -r
      4.18.0-477.10.1.el8_8.x86_64
      [root@dell-per750-37 ~]# rpm -qa|grep openvswitch
      openvswitch-selinux-extra-policy-1.0-30.el8fdp.noarch
      openvswitch2.17-2.17.0-80.el8fdp.x86_64

      How reproducible:

      Steps to Reproduce:
      1. create two vfs for pf
      echo 2 > /sys/devices/pci0000:16/0000:16:02.0/0000:17:00.0/sriov_numvfs
      2.driverctl -v set-override 0000:17:10.2 vfio-pci
      3. ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-socket-mem=1024,1024
      ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-init=true
      ovs-vsctl set Open_vSwitch . other_config:pmd-cpu-mask=0x44000000004400000000
      ovs-vsctl add-br ovsbr0 – set bridge ovsbr0 datapath_type=netdev
      ovs-vsctl add-port ovsbr0 dpdk0 – set Interface dpdk0 type=dpdk type=dpdk options:dpdk-devargs=0000:17:10.2
      4. configure the pf mtu to 2000 or 9000
      ip link set ens2f0 mtu 2000

      Actual results:

      [root@dell-per750-37 ~]# ovs-vsctl show
      07f1710a-93a2-476c-98f0-7ef4c7a898b5
      Bridge ovsbr0
      datapath_type: netdev
      Port ovsbr0
      Interface ovsbr0
      type: internal
      Port dpdk0
      Interface dpdk0
      type: dpdk
      options:

      {dpdk-devargs="0000:17:10.2"}

      error: "could not add network device dpdk0 to ofproto (Invalid argument)"
      ovs_version: "2.17.6"

      dmesg ouput
      [ 5425.205958] device ovs-netdev entered promiscuous mode
      [ 5425.243061] device ovsbr0 entered promiscuous mode
      [ 5429.530211] ixgbe 0000:17:00.0 ens2f0: VF Reset msg received from vf 1
      [ 5444.975287] ixgbe 0000:17:00.0 ens2f0: Setting MTU > 1500 will disable legacy VFs
      [ 5444.977145] ixgbevf 0000:17:10.0: NIC Link is Down
      [ 5447.233083] ixgbe 0000:17:00.0 ens2f0: detected SFP+: 3
      [ 5447.388003] ixgbe 0000:17:00.0 ens2f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX
      [ 5452.328178] ixgbe 0000:17:00.0 ens2f0: VF Reset msg received from vf 0
      [ 5452.351624] ixgbevf 0000:17:10.0: NIC Link is Up 10 Gbps
      [ 6451.060353] ixgbevf 0000:17:10.0: NIC Link is Down
      [ 6453.348250] ixgbe 0000:17:00.0 ens2f0: detected SFP+: 3
      [ 6453.702885] ixgbe 0000:17:00.0 ens2f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

      ovs log
      [root@dell-per750-37 ~]# tail -f /var/log/openvswitch/ovs-vswitchd.log
      2023-05-08T07:06:36.488Z|00001|ovs_rcu(urcu2)|WARN|blocked 1001 ms waiting for main to quiesce
      2023-05-08T07:06:36.542Z|00080|dpdk|ERR|eth_ixgbevf_dev_init(): VF Initialization Failure: -15
      2023-05-08T07:06:36.542Z|00081|netdev_dpdk|INFO|Virtual function detected, HW_CRC_STRIP will be enabled
      2023-05-08T07:06:36.542Z|00082|netdev_dpdk|ERR|Interface dpdk0 MTU (1500) setup error: Invalid argument
      2023-05-08T07:06:36.542Z|00083|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:1 lsc interrupt mode:false) configure error: Invalid argument
      2023-05-08T07:06:36.542Z|00084|dpif_netdev|ERR|Failed to set interface dpdk0 new configuration
      2023-05-08T07:06:37.487Z|00002|ovs_rcu(urcu2)|WARN|blocked 2000 ms waiting for main to quiesce
      2023-05-08T07:06:37.541Z|00085|timeval|WARN|Unreasonably long 2233ms poll interval (1ms user, 4ms system)
      2023-05-08T07:06:37.541Z|00086|timeval|WARN|context switches: 2405 voluntary, 0 involuntary
      2023-05-08T07:06:37.541Z|00087|coverage|INFO|Event coverage, avg rate over last: 5 seconds, last minute, last hour, hash=69adbbab:
      2023-05-08T07:06:37.541Z|00088|coverage|INFO|bridge_reconfigure 0.0/sec 0.117/sec 0.0025/sec total: 9
      2023-05-08T07:06:37.541Z|00089|coverage|INFO|ofproto_flush 0.0/sec 0.017/sec 0.0003/sec total: 1
      2023-05-08T07:06:37.541Z|00090|coverage|INFO|ofproto_update_port 0.0/sec 0.050/sec 0.0008/sec total: 4
      2023-05-08T07:06:37.541Z|00091|coverage|INFO|rev_reconfigure 0.0/sec 0.133/sec 0.0022/sec total: 8
      2023-05-08T07:06:37.541Z|00092|coverage|INFO|rev_port_toggled 0.0/sec 0.017/sec 0.0003/sec total: 1
      2023-05-08T07:06:37.541Z|00093|coverage|INFO|rev_flow_table 0.0/sec 0.017/sec 0.0003/sec total: 1
      2023-05-08T07:06:37.541Z|00094|coverage|INFO|rev_mac_learning 0.0/sec 0.033/sec 0.0006/sec total: 2
      2023-05-08T07:06:37.541Z|00095|coverage|INFO|xlate_actions 0.2/sec 0.450/sec 0.0075/sec total: 27
      2023-05-08T07:06:37.541Z|00096|coverage|INFO|ccmap_shrink 0.0/sec 0.400/sec 0.0067/sec total: 24
      2023-05-08T07:06:37.541Z|00097|coverage|INFO|cmap_expand 0.0/sec 2.300/sec 0.0442/sec total: 159
      2023-05-08T07:06:37.541Z|00098|coverage|INFO|cmap_shrink 0.0/sec 2.033/sec 0.0369/sec total: 135
      2023-05-08T07:06:37.541Z|00099|coverage|INFO|dpif_port_add 0.0/sec 0.033/sec 0.0006/sec total: 2
      2023-05-08T07:06:37.541Z|00100|coverage|INFO|dpif_port_del 0.0/sec 0.000/sec 0.0000/sec total: 1
      2023-05-08T07:06:37.541Z|00101|coverage|INFO|dpif_flow_flush 0.0/sec 0.017/sec 0.0003/sec total: 1
      2023-05-08T07:06:37.541Z|00102|coverage|INFO|dpif_flow_get 0.0/sec 0.400/sec 0.0067/sec total: 24
      2023-05-08T07:06:37.541Z|00103|coverage|INFO|dpif_flow_put 0.0/sec 0.417/sec 0.0069/sec total: 25
      2023-05-08T07:06:37.541Z|00104|coverage|INFO|dpif_flow_del 0.0/sec 0.433/sec 0.0072/sec total: 28
      2023-05-08T07:06:37.541Z|00105|coverage|INFO|dpif_execute 0.0/sec 0.100/sec 0.0017/sec total: 6
      2023-05-08T07:06:37.541Z|00106|coverage|INFO|flow_extract 0.0/sec 0.067/sec 0.0011/sec total: 4
      2023-05-08T07:06:37.541Z|00107|coverage|INFO|miniflow_malloc 0.0/sec 3.517/sec 0.0708/sec total: 255
      2023-05-08T07:06:37.541Z|00108|coverage|INFO|hmap_pathological 0.0/sec 0.000/sec 0.0003/sec total: 1
      2023-05-08T07:06:37.541Z|00109|coverage|INFO|hmap_expand 17.6/sec 15.950/sec 0.4053/sec total: 1522
      2023-05-08T07:06:37.541Z|00110|coverage|INFO|hmap_shrink 0.0/sec 0.017/sec 0.0003/sec total: 2
      2023-05-08T07:06:37.541Z|00111|coverage|INFO|mac_learning_learned 0.0/sec 0.033/sec 0.0006/sec total: 2
      2023-05-08T07:06:37.541Z|00112|coverage|INFO|netdev_received 0.4/sec 0.217/sec 0.0036/sec total: 13
      2023-05-08T07:06:37.541Z|00113|coverage|INFO|netdev_sent 0.4/sec 0.217/sec 0.0036/sec total: 13
      2023-05-08T07:06:37.541Z|00114|coverage|INFO|netdev_get_stats 0.4/sec 0.200/sec 0.0033/sec total: 14
      2023-05-08T07:06:37.541Z|00115|coverage|INFO|txn_unchanged 0.0/sec 0.317/sec 0.0072/sec total: 26
      2023-05-08T07:06:37.541Z|00116|coverage|INFO|txn_incomplete 0.2/sec 0.200/sec 0.0033/sec total: 13
      2023-05-08T07:06:37.541Z|00117|coverage|INFO|txn_success 0.2/sec 0.117/sec 0.0019/sec total: 8
      2023-05-08T07:06:37.541Z|00118|coverage|INFO|poll_create_node 207.6/sec 133.367/sec 2.2608/sec total: 9125
      2023-05-08T07:06:37.541Z|00119|coverage|INFO|poll_zero_timeout 0.8/sec 1.450/sec 0.0242/sec total: 150
      2023-05-08T07:06:37.541Z|00120|coverage|INFO|seq_change 17387.2/sec 8497.167/sec 141.6658/sec total: 547560
      2023-05-08T07:06:37.541Z|00121|coverage|INFO|pstream_open 0.0/sec 0.033/sec 0.0008/sec total: 3
      2023-05-08T07:06:37.541Z|00122|coverage|INFO|stream_open 0.0/sec 0.000/sec 0.0003/sec total: 1
      2023-05-08T07:06:37.541Z|00123|coverage|INFO|util_xalloc 573.2/sec 498.433/sec 10.7817/sec total: 41779
      2023-05-08T07:06:37.541Z|00124|coverage|INFO|netdev_set_policing 0.0/sec 0.033/sec 0.0006/sec total: 2
      2023-05-08T07:06:37.541Z|00125|coverage|INFO|netdev_set_hwaddr 0.0/sec 0.017/sec 0.0003/sec total: 1
      2023-05-08T07:06:37.541Z|00126|coverage|INFO|netdev_get_ethtool 0.0/sec 0.050/sec 0.0008/sec total: 3
      2023-05-08T07:06:37.541Z|00127|coverage|INFO|netlink_received 0.2/sec 10.067/sec 0.2050/sec total: 740
      2023-05-08T07:06:37.541Z|00128|coverage|INFO|netlink_recv_jumbo 0.2/sec 0.100/sec 0.0017/sec total: 7
      2023-05-08T07:06:37.541Z|00129|coverage|INFO|netlink_sent 0.2/sec 9.017/sec 0.1836/sec total: 663
      2023-05-08T07:06:37.541Z|00130|coverage|INFO|nln_changed 0.0/sec 0.350/sec 0.0072/sec total: 26
      2023-05-08T07:06:37.541Z|00131|coverage|INFO|109 events never hit
      2023-05-08T07:06:37.541Z|00132|bridge|INFO|bridge ovsbr0: deleted interface dpdk0 on port 1
      2023-05-08T07:06:37.541Z|00133|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:37.541Z|00134|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:37.541Z|00135|netdev_dpdk|INFO|Virtual function detected, HW_CRC_STRIP will be enabled
      2023-05-08T07:06:37.541Z|00136|netdev_dpdk|ERR|Interface dpdk0 MTU (1500) setup error: Invalid argument
      2023-05-08T07:06:37.541Z|00137|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:1 lsc interrupt mode:false) configure error: Invalid argument
      2023-05-08T07:06:37.541Z|00138|dpif_netdev|ERR|Failed to set interface dpdk0 new configuration
      2023-05-08T07:06:37.541Z|00139|dpif|WARN|netdev@ovs-netdev: failed to add dpdk0 as port: Invalid argument
      2023-05-08T07:06:37.541Z|00140|bridge|WARN|could not add network device dpdk0 to ofproto (Invalid argument)
      2023-05-08T07:06:37.541Z|00141|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:37.542Z|00142|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:37.542Z|00143|netdev_dpdk|INFO|Virtual function detected, HW_CRC_STRIP will be enabled
      2023-05-08T07:06:37.542Z|00144|netdev_dpdk|ERR|Interface dpdk0 MTU (1500) setup error: Invalid argument
      2023-05-08T07:06:37.542Z|00145|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:1 lsc interrupt mode:false) configure error: Invalid argument
      2023-05-08T07:06:37.542Z|00146|dpif_netdev|ERR|Failed to set interface dpdk0 new configuration
      2023-05-08T07:06:37.542Z|00147|dpif|WARN|netdev@ovs-netdev: failed to add dpdk0 as port: Invalid argument
      2023-05-08T07:06:37.542Z|00148|bridge|WARN|could not add network device dpdk0 to ofproto (Invalid argument)
      2023-05-08T07:06:37.542Z|00149|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:37.749Z|00150|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:37.749Z|00151|netdev_dpdk|INFO|Virtual function detected, HW_CRC_STRIP will be enabled
      2023-05-08T07:06:37.749Z|00152|netdev_dpdk|ERR|Interface dpdk0 MTU (1500) setup error: Invalid argument
      2023-05-08T07:06:37.749Z|00153|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:1 lsc interrupt mode:false) configure error: Invalid argument
      2023-05-08T07:06:37.749Z|00154|dpif_netdev|ERR|Failed to set interface dpdk0 new configuration
      2023-05-08T07:06:37.749Z|00155|dpif|WARN|netdev@ovs-netdev: failed to add dpdk0 as port: Invalid argument
      2023-05-08T07:06:37.749Z|00156|bridge|WARN|could not add network device dpdk0 to ofproto (Invalid argument)
      2023-05-08T07:06:37.749Z|00157|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:43.608Z|00158|dpdk|INFO|Device with port_id=0 already stopped
      2023-05-08T07:06:43.608Z|00159|netdev_dpdk|INFO|Virtual function detected, HW_CRC_STRIP will be enabled
      2023-05-08T07:06:43.608Z|00160|netdev_dpdk|ERR|Interface dpdk0 MTU (1500) setup error: Invalid argument
      2023-05-08T07:06:43.608Z|00161|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:1 lsc interrupt mode:false) configure error: Invalid argument
      2023-05-08T07:06:43.608Z|00162|dpif_netdev|ERR|Failed to set interface dpdk0 new configuration
      2023-05-08T07:06:43.608Z|00163|dpif|WARN|netdev@ovs-netdev: failed to add dpdk0 as port: Invalid argument
      2023-05-08T07:06:43.608Z|00164|bridge|WARN|could not add network device dpdk0 to ofproto (Invalid argument)
      2023-05-08T07:06:43.608Z|00165|dpdk|INFO|Device with port_id=0 already stopped

      Expected results:
      The the NIC Link status is not changed when change the mtu of vf dpdk port

              rhn-support-ktraynor Kevin Traynor
              mcoqueli@redhat.com Maxime Coquelin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: