-
Bug
-
Resolution: Unresolved
-
Undefined
-
None
-
4.15
-
None
-
Quality / Stability / Reliability
-
False
-
-
None
-
Important
-
No
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Description of problem:
On 4.15 nightly, enable hardware offload and configure sriovoffload policy, NAD and creating pods with VF as default network. Check worker nodes with command "ls /sys/class/net -al" and can not see the VF reps. But pod-to-pod traffic can pass.
Version-Release number of selected component (if applicable):
4.15
How reproducible:
always
Steps to Reproduce:
1. Configure hardware offload following steps in https://docs.openshift.com/container-platform/4.14/networking/hardware_networks/configuring-hardware-offloading.html
2. creating pods with VF as default network
3. check on worker nodes, there're no VF reps whose names are the first several bits of pods sandboxID, and no intefaces like ens1f0v0, ens1f0v1, etc (ens1f0np0 is the default network pf).
sh-5.1# crictl ps | grep iperf
f40e570193aae e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e 18 minutes ago Running iperf-client 0 8ef10946f12cf iperf-rc-bc76q
e74a32c21c1d5 e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e 18 minutes ago Running iperf-client 0 0759d1449a2c2 iperf-rc-7f6zv
f97aef37b3f22 e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e 16 hours ago Running iperf-server-ovn-1 0 ece6e9f3623a8 iperf-server-ovn-1
4b492595dcaa3 e6a61d6c01f52ee26afd455b982651876532dcba31a607495de5eb9f5567db4e 16 hours ago Running iperf-server 0 0baa434aa9791 iperf-server
sh-5.1#
sh-5.1#
sh-5.1#
sh-5.1# ls /sys/class/net | grep 8ef10946f12cf
sh-5.1#
sh-5.1#
sh-5.1# ls /sys/class/net | grep ens1f0
ens1f0np0
sh-5.1#
sh-5.1#
sh-5.1# ls /sys/class/net -al
total 0
drwxr-xr-x. 2 root root 0 Jan 17 01:30 .
drwxr-xr-x. 78 root root 0 Jan 16 09:01 ..
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 01ce167e5597656 -> ../../devices/virtual/net/01ce167e5597656
lrwxrwxrwx. 1 root root 0 Jan 16 19:55 49a1870bf49804e -> ../../devices/virtual/net/49a1870bf49804e
lrwxrwxrwx. 1 root root 0 Jan 16 09:40 88b6619f71391bf -> ../../devices/virtual/net/88b6619f71391bf
lrwxrwxrwx. 1 root root 0 Jan 16 09:39 br-001 -> ../../devices/virtual/net/br-001
lrwxrwxrwx. 1 root root 0 Jan 16 09:03 br-ex -> ../../devices/virtual/net/br-ex
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 br-int -> ../../devices/virtual/net/br-int
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 c76d38e8cc7b2d7 -> ../../devices/virtual/net/c76d38e8cc7b2d7
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 d5d2bd2ce9a0922 -> ../../devices/virtual/net/d5d2bd2ce9a0922
lrwxrwxrwx. 1 root root 0 Jan 16 09:39 d9ffddfd6eb877c -> ../../devices/virtual/net/d9ffddfd6eb877c
lrwxrwxrwx. 1 root root 0 Jan 16 09:22 ece6e9f3623a801 -> ../../devices/virtual/net/ece6e9f3623a801
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 eno1 -> ../../devices/pci0000:17/0000:17:03.0/0000:18:00.0/net/eno1
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 eno2 -> ../../devices/pci0000:17/0000:17:03.0/0000:18:00.1/net/eno2
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 eno3 -> ../../devices/pci0000:17/0000:17:02.0/0000:19:00.0/net/eno3
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 eno4 -> ../../devices/pci0000:17/0000:17:02.0/0000:19:00.1/net/eno4
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens1f0np0 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/ens1f0np0
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens1f1np1 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.1/net/ens1f1np1
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 ens1f1v0 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.5/net/ens1f1v0
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 ens1f1v1 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.6/net/ens1f1v1
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 ens1f1v2 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.7/net/ens1f1v2
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens2f0 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/net/ens2f0
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 ens2f0v0 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:01.0/net/ens2f0v0
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 ens2f0v1 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:01.1/net/ens2f0v1
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens2f1 -> ../../devices/pci0000:5d/0000:5d:02.0/0000:5e:00.1/net/ens2f1
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens4f0np0 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/net/ens4f0np0
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens4f1np1 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:00.1/net/ens4f1np1
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 ens4f1v0 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:03.0/net/ens4f1v0
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 ens4f1v1 -> ../../devices/pci0000:ae/0000:ae:00.0/0000:af:03.1/net/ens4f1v1
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens5f0 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.0/net/ens5f0
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens5f1 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.1/net/ens5f1
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens5f2 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.2/net/ens5f2
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ens5f3 -> ../../devices/pci0000:85/0000:85:00.0/0000:86:00.3/net/ens5f3
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 eth0 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/eth0
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 eth1 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/eth1
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 eth2 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/eth2
lrwxrwxrwx. 1 root root 0 Jan 16 09:04 fb3c904c30466d6 -> ../../devices/virtual/net/fb3c904c30466d6
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 genev_sys_6081 -> ../../devices/virtual/net/genev_sys_6081
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 lo -> ../../devices/virtual/net/lo
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ovn-k8s-mp0 -> ../../devices/virtual/net/ovn-k8s-mp0
lrwxrwxrwx. 1 root root 0 Jan 16 09:02 ovs-system -> ../../devices/virtual/net/ovs-system
lrwxrwxrwx. 1 root root 0 Jan 16 09:39 veth9f263a7c -> ../../devices/virtual/net/veth9f263a7c
lrwxrwxrwx. 1 root root 0 Jan 16 09:40 vethc90bcb37 -> ../../devices/virtual/net/vethc90bcb37
sh-5.1#
Actual results:
no vf reps and vf interfaces in /sys/class/net
Expected results:
should see vf reps and vf interfaces
Additional info:
# oc version Client Version: 4.15.0-0.nightly-2024-01-13-113745 Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3 Server Version: 4.15.0-0.nightly-2024-01-13-113745 Kubernetes Version: v1.28.5+c84a6b8 # oc get csv -n openshift-sriov-network-operator NAME DISPLAY VERSION REPLACES PHASE ingress-node-firewall.v4.15.0-202401152249 Ingress Node Firewall Operator 4.15.0-202401152249 ingress-node-firewall.v4.15.0-202401121302 Succeeded metallb-operator.v4.15.0-202401151551 MetalLB Operator 4.15.0-202401151551 metallb-operator.v4.15.0-202401121302 Succeeded sriov-network-operator.v4.15.0-202401121302 SR-IOV Network Operator 4.15.0-202401121302 Succeeded # oc rsh iperf-rc-7q546 ls -al /sys/class/net/eth0/device/driver lrwxrwxrwx 1 root root 0 Jan 17 02:00 /sys/class/net/eth0/device/driver -> ../../../../bus/pci/drivers/mlx5_core