Description of problem:

Version-Release numemphasized textber of selected component (if applicable):
rhel9.5, rhel9.2, rhel9.4
[root@netqe24 ~]# uname -r
5.14.0-284.66.1.el9_2.x86_64
[root@dell-per730-56 ~]# uname -r
5.14.0-427.18.1.el9_4.x86_64
[root@dell-per730-56 ~]# uname -r
5.14.0-452.el9.x86_64

[root@netqe24 ~]# rpm -qa|grep dpdk
dpdk-23.11-1.el9.x86_64
dpdk-tools-23.11-1.el9.x86_64

How reproducible:

Run ovs dpdk vhostuser 4queue 8pmd vlan case.
Steps to Reproduce:
1. create one vf for two pfs
2. start testpmd with the two vfs
dpdk-testpmd -l 0-2 -n 1 --socket-mem 1024 -a 0000:04:00.2 -a 0000:04:01.2 – -i --forward-mode=mac --burst=32 --rxd=4096 --txd=4096 --max-pkt-len=9200 --mbuf-size=9728 --nb-cores=2 --rxq=1 --txq=1 --eth-peer=0,00:00:00:00:00:01 --eth-peer=1,00:00:00:00:00:02 --mbcache=512 --auto-start

3. send traffic on T-rex server
./binary-search.py --traffic-generator=trex-txrx --frame-size=64 --num-flows=1024 --max-loss-pct=0 --search-runtime=10 --validation-runtime=60 --rate-tolerance=10 --runtime-tolerance=10 --rate=25 --rate-unit=% --duplicate-packet-failure=retry-to-fail --negative-packet-loss=retry-to-fail --warmup-trial --warmup-trial-runtime=10 --rate=25 --rate-unit=% --one-shot=0 --use-src-ip-flows=1 --use-dst-ip-flows=1 --use-src-mac-flows=0 --use-dst-mac-flows=0 --src-macs=00:00:00:00:00:01,00:00:00:00:00:02 --dst-macs=00:de:ad:01:01:01,00:de:ad:02:02:02 --send-teaching-measurement --send-teaching-warmup --teaching-warmup-packet-type=generic --teaching-warmup-packet-rate=1000 --use-src-ip-flows=1 --use-dst-ip-flows=1 --use-src-mac-flows=1 --use-dst-mac-flows=0 --use-device-stats

Actual results:
It got very low performance(1.1mpps) sometimes.
sriov vf: 1.1mpps
https://beaker.engineering.redhat.com/jobs/9346329
https://beaker-archive.host.prod.eng.bos.redhat.com/beaker-logs/2024/05/93463/9346329/16229583/178306653/mlx5_100.html
sriov vf: 37mpps
https://beaker.engineering.redhat.com/jobs/9346166
https://beaker-archive.host.prod.eng.bos.redhat.com/beaker-logs/2024/05/93461/9346166/16229346/178304713/mlx5_100.html
rhel9.2 sriov vf: 1.1mpps
https://beaker.engineering.redhat.com/jobs/9346007
https://beaker-archive.host.prod.eng.bos.redhat.com/beaker-logs/2024/05/93460/9346007/16229123/178303107/mlx5_100.html

Expected results:
It should always got the normal result(37mpps).