Uploaded image for project: 'Fast Datapath Product'
  1. Fast Datapath Product
  2. FDP-2623

Upstream: [spike] ice driver: ovs dpdk pvp 64byte case shows a 40% performance drop When PMD does not use Port/Rx Queue assignment to PMD threads by manual pinning

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • None
    • 5
    • False
    • False
    • Hide

      Please mark each item below with ( / ) if completed or ( x ) if incomplete:
      ( ) Unit test or Integration test case are written and pass successfully


      ( ) The upstream pull request is merged upstream and pass CI

      Show
      Please mark each item below with ( / ) if completed or ( x ) if incomplete: ( ) Unit test or Integration test case are written and pass successfully ( ) The upstream pull request is merged upstream and pass CI
    • rhel-10
    • None
    • rhel-net-ovs-dpdk

      This is tracking the upstream effort needed to deliver the solution to the bug described below.


       Problem Description: Clearly explain the issue.

      ice driver: ovs dpdk pvp 64byte case shows a 40% performance drop When PMD does not use Port/Rx Queue assignment to PMD threads by manual pinning

       Impact Assessment: Describe the severity and impact (e.g., network down,availability of a workaround, etc.).

       Software Versions: Specify the exact versions in use (e.g.,openvswitch3.1-3.1.0-147.el8fdp).

      openvswitch3.5-3.5.1-35.el10fdp
      openvswitch3.6-3.6.0-0.1.el10fdp
      openvswitch3.6-3.6.0-0.2.el9fdp
       

        Issue Type: Indicate whether this is a new issue or a regression (if a regression, state the last known working version).

      The openvswitch3.4-3.4.2-64.el9fdp has no issue.
       

       Reproducibility: Confirm if the issue can be reproduced consistently. If not, describe how often it occurs.

      It can be reproduced most of the time.

       Reproduction Steps: Provide detailed steps or scripts to replicate the issue.

      Run 1q 4pmd ovs dpdk pvp cases, PMD does not use Port/Rx Queue assignment to PMD threads by manual pinning, use trex send traffic with 64byte packet to get the throughtput.
       

       Expected Behavior: Describe what should happen under normal circumstances.

      For ovs3.4, the 1q 4pmd 64byte get about 7.7-8.6mpps, it also should get about 8mpps for ovs3.5.1 and ovs3.6 version.
       

       Observed Behavior: Explain what actually happens.

      The 1q 4pmd 64byte get about 4.6-5.3mpps for ovs3.5.1 and ovs3.6 version.
      Detail test results:
      duration: 60s openvswitch3.4-3.4.2-64.el9fdp 8.6mpps
      https://beaker.engineering.redhat.com/jobs/10989298
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/04/109892/10989298/18586639/194188196/ice_25.html

      duration:60s openvswitch3.4-3.4.2-66.el9fdp:7.7mpps
      https://beaker.engineering.redhat.com/jobs/11503201
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115032/11503201/19304644/199329558/ice_25.html
      pmd usage log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115032/11503201/19304643/199329556/1_4_3_64_0_pmd.log
      ovs log:https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115032/11503201/19304643/199329556/ovs-vswitchd.log

      duration: 60s openvswitch3.5-3.5.1-35.el10fdp: 4.6mpps
      https://beaker.engineering.redhat.com/jobs/11500961
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115009/11500961/19301570/199308875/ice_25.html
      pmd usage log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115009/11500961/19301569/199308873/1_4_3_64_0_pmd.log
      ovs log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115009/11500961/19301569/199308873/ovs-vswitchd.log

      duration: 60s openvswitch3.5-3.5.1-35.el10fdp: 4.6mpps
      https://beaker.engineering.redhat.com/jobs/11430115
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114301/11430115/19197649/198484963/ice_25.html
      pmd usage log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114301/11430115/19197648/198484961/1_4_3_64_0_pmd.log
      ovs log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114301/11430115/19197648/198484961/ovs-vswitchd.log

      duration: 60s openvswitch3.6-3.6.0-0.1.el10fdp: 4.6mpps
      https://beaker.engineering.redhat.com/jobs/11462428
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114624/11462428/19244937/198890293/ice_25.html
      pmd usage log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114624/11462428/19244936/198890292/ovs-vswitchd.log
      ovs log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114624/11462428/19244936/198890292/ovs-vswitchd.log

      duration: 60s openvswitch3.6-3.6.0-0.2.el9fdp 4.6mpps
      https://beaker.engineering.redhat.com/jobs/11456314
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114563/11456314/19236346/198825576/ice_25.html
      pmd usage log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114563/11456314/19236345/198825575/1_4_3_64_0_pmd.log
      ovs log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114563/11456314/19236345/198825575/ovs-vswitchd.log

      For openvswitch3.5-3.5.1-42.el9fdp, it can achieve normal performance.
      duration:60s openvswitch3.5-3.5.1-42.el9fdp:7.4mpps
      https://beaker.engineering.redhat.com/jobs/11503207
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115032/11503207/19304651/199329570/ice_25.html
      pmd usage log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115032/11503207/19304650/199329568/1_4_3_64_0_pmd.log
      ovs log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/08/115032/11503207/19304650/199329568/ovs-vswitchd.log

      duration:60s openvswitch3.5-3.5.1-42.el9fdp:7.7mpps
      https://beaker.engineering.redhat.com/jobs/11437358
      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114373/11437358/19208612/198571704/ice_25.html
      pmd usage log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114373/11437358/19208611/198571702/1_4_3_64_0_pmd.log
      ovs log: https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2025/07/114373/11437358/19208611/198571702/ovs-vswitchd.log

       Troubleshooting Actions: Outline the steps taken to diagnose or resolve the issue so far.

      It has no this issue for i40e card. and it only exist on 64byte cases.
       

       Logs: If you collected logs please provide them (e.g. sos report, /var/log/openvswitch/* , testpmd console)


              ovsdpdk-triage ovsdpdk triage
              nstbot NST Bot
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: