Loading...

XML

Word

Printable

Type: Bug
Resolution: Unresolved
Priority: Undefined
Fix Version/s: None
Affects Version/s: 4.15
Component/s: Networking / SR-IOV
Labels:
None

Activity Type:
Quality / Stability / Reliability
Blocked:
False
Blocked Reason:

Hide

None

Show
None
Story Points:
None
Severity:
Important
Regression:
No

Target Backport Versions:
None
Target Version:
None
Release Blocker:
None
Sprint:
None

SFDC Cases Counter:
SFDC Cases Open:
SFDC Cases Links:

Release Note Status:
None
Release Note Type:
None
Release Note Text:
None

Escape Reason:
None
Escape Impact:
None
Corrective Measures:
None
SDLC stage when should've been found:
None

Description of problem:

 On 4.15 nightly, enable hardware offload and configure sriovoffload policy, NAD and creating pods with VF as default network. Check worker nodes with command "ls /sys/class/net -al" and can not see the VF reps.
But pod-to-pod traffic can pass.

Version-Release number of selected component (if applicable):

    4.15

How reproducible:

    always

Steps to Reproduce:

    1. Configure hardware offload following steps in https://docs.openshift.com/container-platform/4.14/networking/hardware_networks/configuring-hardware-offloading.html
    2. creating pods with VF as default network
    3. check on worker nodes, there're no VF reps whose names are the first several bits of pods sandboxID, and no intefaces like ens1f0v0, ens1f0v1, etc (ens1f0np0 is the default network pf).

sh-5.1# crictl ps | grep iperf
f40e570193aae       e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e                                                              18 minutes ago      Running             iperf-client                         0                   8ef10946f12cf       iperf-rc-bc76q
e74a32c21c1d5       e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e                                                              18 minutes ago      Running             iperf-client                         0                   0759d1449a2c2       iperf-rc-7f6zv
f97aef37b3f22       e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e                                                              16 hours ago        Running             iperf-server-ovn-1                   0                   ece6e9f3623a8       iperf-server-ovn-1
4b492595dcaa3       e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e                                                              16 hours ago        Running             iperf-server                         0                   0baa434aa9791       iperf-server
sh-5.1# 
sh-5.1# 
sh-5.1# 
sh-5.1# ls /sys/class/net | grep 8ef10946f12cf
sh-5.1# 
sh-5.1# 
sh-5.1# ls /sys/class/net | grep ens1f0       
ens1f0np0
sh-5.1# 
sh-5.1# 
sh-5.1# ls /sys/class/net -al          
total 0
drwxr-xr-x.  2 root root 0 Jan 17 01:30 .
drwxr-xr-x. 78 root root 0 Jan 16 09:01 ..
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 01ce167e5597656 -> ../../devices/virtual/net/01ce167e5597656
lrwxrwxrwx.  1 root root 0 Jan 16 19:55 49a1870bf49804e -> ../../devices/virtual/net/49a1870bf49804e
lrwxrwxrwx.  1 root root 0 Jan 16 09:40 88b6619f71391bf -> ../../devices/virtual/net/88b6619f71391bf
lrwxrwxrwx.  1 root root 0 Jan 16 09:39 br-001 -> ../../devices/virtual/net/br-001
lrwxrwxrwx.  1 root root 0 Jan 16 09:03 br-ex -> ../../devices/virtual/net/br-ex
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 br-int -> ../../devices/virtual/net/br-int
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 c76d38e8cc7b2d7 -> ../../devices/virtual/net/c76d38e8cc7b2d7
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 d5d2bd2ce9a0922 -> ../../devices/virtual/net/d5d2bd2ce9a0922
lrwxrwxrwx.  1 root root 0 Jan 16 09:39 d9ffddfd6eb877c -> ../../devices/virtual/net/d9ffddfd6eb877c
lrwxrwxrwx.  1 root root 0 Jan 16 09:22 ece6e9f3623a801 -> ../../devices/virtual/net/ece6e9f3623a801
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 eno1 -> ../../devices/pci0000:17/0000:17:03.0/0000:18:00.0/net/eno1
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 eno2 -> ../../devices/pci0000:17/0000:17:03.0/0000:18:00.1/net/eno2
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 eno3 -> ../../devices/pci0000:17/0000:17:02.0/0000:19:00.0/net/eno3
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 eno4 -> ../../devices/pci0000:17/0000:17:02.0/0000:19:00.1/net/eno4
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens1f0np0 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/ens1f0np0
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens1f1np1 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.1/net/ens1f1np1
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 ens1f1v0 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.5/net/ens1f1v0
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 ens1f1v1 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.6/net/ens1f1v1
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 ens1f1v2 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.7/net/ens1f1v2
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens2f0 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/net/ens2f0
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 ens2f0v0 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:01.0/net/ens2f0v0
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 ens2f0v1 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:01.1/net/ens2f0v1
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens2f1 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:00.1/net/ens2f1
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens4f0np0 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/net/ens4f0np0
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens4f1np1 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:00.1/net/ens4f1np1
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 ens4f1v0 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:03.0/net/ens4f1v0
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 ens4f1v1 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:03.1/net/ens4f1v1
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens5f0 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.0/net/ens5f0
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens5f1 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.1/net/ens5f1
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens5f2 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.2/net/ens5f2
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ens5f3 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.3/net/ens5f3
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 eth0 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/eth0
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 eth1 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/eth1
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 eth2 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/eth2
lrwxrwxrwx.  1 root root 0 Jan 16 09:04 fb3c904c30466d6 -> ../../devices/virtual/net/fb3c904c30466d6
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 genev_sys_6081 -> ../../devices/virtual/net/genev_sys_6081
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 lo -> ../../devices/virtual/net/lo
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ovn-k8s-mp0 -> ../../devices/virtual/net/ovn-k8s-mp0
lrwxrwxrwx.  1 root root 0 Jan 16 09:02 ovs-system -> ../../devices/virtual/net/ovs-system
lrwxrwxrwx.  1 root root 0 Jan 16 09:39 veth9f263a7c -> ../../devices/virtual/net/veth9f263a7c
lrwxrwxrwx.  1 root root 0 Jan 16 09:40 vethc90bcb37 -> ../../devices/virtual/net/vethc90bcb37
sh-5.1#

Actual results:

    no vf reps and vf interfaces in /sys/class/net

Expected results:

    should see vf reps and vf interfaces

Additional info:

    # oc version
Client Version: 4.15.0-0.nightly-2024-01-13-113745
Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
Server Version: 4.15.0-0.nightly-2024-01-13-113745
Kubernetes Version: v1.28.5+c84a6b8

# oc get csv -n openshift-sriov-network-operator 
NAME                                          DISPLAY                          VERSION               REPLACES                                     PHASE
ingress-node-firewall.v4.15.0-202401152249    Ingress Node Firewall Operator   4.15.0-202401152249   ingress-node-firewall.v4.15.0-202401121302   Succeeded
metallb-operator.v4.15.0-202401151551         MetalLB Operator                 4.15.0-202401151551   metallb-operator.v4.15.0-202401121302        Succeeded
sriov-network-operator.v4.15.0-202401121302   SR-IOV Network Operator          4.15.0-202401121302                                                Succeeded

# oc rsh iperf-rc-7q546 ls -al /sys/class/net/eth0/device/driver
lrwxrwxrwx    1 root     root             0 Jan 17 02:00 /sys/class/net/eth0/device/driver -> ../../../../bus/pci/drivers/mlx5_core

Assignee:: Zhanqi Zhao

Reporter:: Ying Wang

Need Info From:: None

Contributors:: None

QA Contact:: Zhanqi Zhao

Doc Contact:: None

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Created:: 2024/01/17 1:50 AM

Updated:: 2025/07/24 5:28 AM

Details

Description

Attachments

Easy Agile Planning Poker

Activity

People

Dates

Hide