-
Bug
-
Resolution: Unresolved
-
Normal
-
None
-
4.21
-
None
-
Quality / Stability / Reliability
-
False
-
-
None
-
None
-
None
-
x86_64
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
[OCP][SRIOV][CNI] does not support AMD Turin
hp-3m1d2b1014.anl.eng.bos2.dc.redhat.com
43:00.0 Ethernet controller: Mellanox Technologies MT2892 Family [ConnectX-6 Dx]
43:00.1 Ethernet controller: Mellanox Technologies MT2892 Family [ConnectX-6 Dx]
6: ens6f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether b8:ce:f6:cc:a3:7c brd ff:ff:ff:ff:ff:ff
altname enp67s0f0np0
7: ens6f1np1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether b8:ce:f6:cc:a3:7d brd ff:ff:ff:ff:ff:ff
altname enp67s0f1np1
[root@hp-3m1d2b1014 ~]# lspci -s 0000:43:00.0 -vvv
43:00.0 Ethernet controller: Mellanox Technologies MT2892 Family [ConnectX-6 Dx]
Subsystem: Mellanox Technologies Device 0058
Physical Slot: 6
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 282
NUMA node: 0
IOMMU group: 73
Region 0: Memory at 9e000000 (64-bit, prefetchable) [size=32M]
Capabilities: [60] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 75.000W
DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq-
RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 512 bytes, MaxReadReq 4096 bytes
DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM not supported
ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 16GT/s (ok), Width x16 (ok)
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABC, TimeoutDis+ NROPrPrP- LTR-
10BitTagComp+ 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
FRS- TPHComp- ExtTPHComp-
AtomicOpsCap: 32bit- 64bit- 128bitCAS-
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled,
AtomicOpsCtl: ReqEn+
LnkCap2: Supported Link Speeds: 2.5-16GT/s, Crosslink- Retimer+ 2Retimers+ DRS-
LnkCtl2: Target Link Speed: 16GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+ EqualizationPhase1+
EqualizationPhase2+ EqualizationPhase3+ LinkEqualizationRequest-
Retimer- 2Retimers- CrosslinkRes: unsupported
Capabilities: [48] Vital Product Data
Product Name: ConnectX-6 DX 2-port 100GbE QSFP56 PCIe Adapter
Read-only fields:
[PN] Part number: 0F6FXM
[EC] Engineering changes: A01
[MN] Manufacture ID: 1028
[SN] Serial number: TW0F6FXM7873516IT02P
[VA] Vendor specific: DSV1028VPDR.VER2.2
[VB] Vendor specific: FFV22.32.20.04
[VC] Vendor specific: NPY2
[VD] Vendor specific: PMTD
[VE] Vendor specific: NMVMellanox Technologies, Inc.
[VF] Vendor specific: DTINIC
[VG] Vendor specific: DCM1001FFFFFF2101FFFFFF
[VH] Vendor specific: L1D0
[VU] Vendor specific: TW0F6FXM7873516IT02PMLNXS0D0F0
[RV] Reserved: checksum good, 0 byte(s) reserved
End
Capabilities: [9c] MSI-X: Enable+ Count=64 Masked-
Vector table: BAR=0 offset=00002000
PBA: BAR=0 offset=00003000
Capabilities: [c0] Vendor Specific Information: Len=18 <?>
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0-,D1-,D2-,D3hot-,D3cold+)
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [100 v1] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UESvrt: DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt+ RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
CEMsk: RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+
AERCap: First Error Pointer: 04, ECRCGenCap+ ECRCGenEn+ ECRCChkCap+ ECRCChkEn+
MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
HeaderLog: 00000000 00000000 00000000 00000000
Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
ARICap: MFVC- ACS-, Next Function: 1
ARICtl: MFVC- ACS-, Function Group: 0
Capabilities: [180 v1] Single Root I/O Virtualization (SR-IOV)
IOVCap: Migration-, Interrupt Message Number: 000
IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy+
IOVSta: Migration-
Initial VFs: 127, Total VFs: 127, Number of VFs: 0, Function Dependency Link: 00
VF offset: 2, stride: 1, Device ID: 101e
Supported Page Size: 000007ff, System Page Size: 00000001
Region 0: Memory at 0000303d28100000 (64-bit, prefetchable)
VF Migration: offset: 00000000, BIR: 0
Capabilities: [1c0 v1] Secondary PCI Express
LnkCtl3: LnkEquIntrruptEn- PerformEqu-
LaneErrStat: 0
Capabilities: [230 v1] Access Control Services
ACSCap: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
Capabilities: [320 v1] Lane Margining at the Receiver <?>
Capabilities: [370 v1] Physical Layer 16.0 GT/s <?>
Capabilities: [420 v1] Data Link Feature <?>
Kernel driver in use: mlx5_core
Kernel modules: mlx5_core
[root@hp-3m1d2b1014 ~]# ethtool -i ens6f0np0
driver: mlx5_core
version: 5.14.0-603.el9.x86_64
firmware-version: 22.32.2004 (DEL0000000027)
expansion-rom-version:
bus-info: 0000:43:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes
How reproducible:{code:none} Always
Steps to Reproduce:
Here is the job link https://beaker.engineering.redhat.com/jobs/11565863 :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: oc_container_spoofchk_on :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: x86_64 :: [ 07:37:49 ] :: [ BEGIN ] :: Running 'oc_container_spoofchk_on' oc_container_spoofchk_on()... ++ [[ spoof checking == mtu ]] ++ ip li set ens6f0np0 mtu 1500 ++ ip li set ens6f1np1 mtu 1500 ++ set +x Start Creating 1 VF of ens6f0np0, driver is mlx5_core PF PCI: 0000:43:00.0 package install is not installed Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use "rhc" or "subscription-manager" to register. Last metadata expiration check: 0:08:39 ago on Thu 21 Aug 2025 07:29:15 AM EDT. No match for argument: install Error: Unable to find a match: install package mstflint is not installed Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use "rhc" or "subscription-manager" to register. Last metadata expiration check: 0:08:40 ago on Thu 21 Aug 2025 07:29:15 AM EDT. Dependencies resolved. ================================================================================ Package Architecture Version Repository Size ================================================================================ Installing: mstflint x86_64 4.30.0-1.el9 beaker-AppStream 3.7 M Transaction Summary ================================================================================ Install 1 Package Total download size: 3.7 M Installed size: 23 M Downloading Packages: mstflint-4.30.0-1.el9.x86_64.rpm 13 MB/s | 3.7 MB 00:00 -------------------------------------------------------------------------------- Total 12 MB/s | 3.7 MB 00:00 Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Installing : mstflint-4.30.0-1.el9.x86_64 1/1 Running scriptlet: mstflint-4.30.0-1.el9.x86_64 1/1 Verifying : mstflint-4.30.0-1.el9.x86_64 1/1 Installed products updated. Installed: mstflint-4.30.0-1.el9.x86_64 Complete! SRIOV_EN True(1) 6: ens6f0np0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether b8:ce:f6:cc:a3:7c brd ff:ff:ff:ff:ff:ff promiscuity 0 allmulti 0 minmtu 68 maxmtu 9978 numtxqueues 768 numrxqueues 63 gso_max_size 65536 gso_max_segs 65535 tso_max_size 524280 tso_max_segs 65535 gro_max_size 65536 gso_ipv4_max_size 65536 gro_ipv4_max_size 65536 portname p0 switchid 7ca3cc0003f6ceb8 parentbus pci parentdev 0000:43:00.0 vf 0 link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state auto, trust off, query_rss off altname enp67s0f0np0 Complete creating VF 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2: ens21f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:c0:aa brd ff:ff:ff:ff:ff:ff altname enp163s0f0np0 3: ens21f1np1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:c0:ab brd ff:ff:ff:ff:ff:ff altname enp163s0f1np1 4: ens22f0np0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:bb:f4 brd ff:ff:ff:ff:ff:ff altname enp97s0f0np0 5: ens22f1np1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:bb:f5 brd ff:ff:ff:ff:ff:ff altname enp97s0f1np1 6: ens6f0np0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether b8:ce:f6:cc:a3:7c brd ff:ff:ff:ff:ff:ff vf 0 link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state auto, trust off, query_rss off altname enp67s0f0np0 7: ens6f1np1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether b8:ce:f6:cc:a3:7d brd ff:ff:ff:ff:ff:ff altname enp67s0f1np1 8: ens6f0v0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether be:92:6b:3c:53:aa brd ff:ff:ff:ff:ff:ff altname enp67s0f0v0 ++ [[ mlx5_core == cxgb4 ]] +++ awk '{print $2}' +++ grep bus-info +++ ethtool -i ens6f0np0 ++ local pf_bus_info=0000:43:00.0 ++ set +x 0000:43:00.2 Current VF name ens6f0v0 ++ [[ mlx5_core == cxgb4 ]] +++ ls /sys/bus/pci/devices/0000:43:00.0/net/ ++ local pf_name=ens6f0np0 ++ ip li set ens6f0np0 vf 0 mac 52:54:00:11:8f:ee ++ sleep 1 ++ ip li set ens6f0v0 address 52:54:00:11:8f:ee ++ ip li 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2: ens21f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:c0:aa brd ff:ff:ff:ff:ff:ff altname enp163s0f0np0 3: ens21f1np1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:c0:ab brd ff:ff:ff:ff:ff:ff altname enp163s0f1np1 4: ens22f0np0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:bb:f4 brd ff:ff:ff:ff:ff:ff altname enp97s0f0np0 5: ens22f1np1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 8c:84:74:92:bb:f5 brd ff:ff:ff:ff:ff:ff altname enp97s0f1np1 6: ens6f0np0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether b8:ce:f6:cc:a3:7c brd ff:ff:ff:ff:ff:ff vf 0 link/ether 52:54:00:11:8f:ee brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state auto, trust off, query_rss off altname enp67s0f0np0 7: ens6f1np1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether b8:ce:f6:cc:a3:7d brd ff:ff:ff:ff:ff:ff altname enp67s0f1np1 8: ens6f0v0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 52:54:00:11:8f:ee brd ff:ff:ff:ff:ff:ff altname enp67s0f0v0 ++ sleep 1 ++ sed -i s/%VF_ID%/0000:43:00.2/g /etc/cni/net.d/1-sriov-net-attach-def.conf ++ sed -i s/%feature_setup%/on/g /etc/cni/net.d/1-sriov-net-attach-def.conf ++ cat /etc/cni/net.d/1-sriov-net-attach-def.conf { "cniVersion":"0.3.1", "name":"sriov-net", "type":"sriov", "spoofchk": "on", "ipam": { "type":"host-local", "ranges":[ [ { "subnet":"192.168.111.0/24", "rangeStart":"192.168.111.10", "rangeEnd":"192.168.111.11", "routes":[{"dst":"0.0.0.0/0"}], "gateway":"192.168.111.254" } ], [ {"subnet": "2001::0/64"} ] ] }, "deviceID": "0000:43:00.2" } ++ set +x vf_driver is mlx5_core temp_uuid : 9ad53cf7b1654a9e80fc88180 POD_ID is: 4200f7cb33498e0f370f3af072ef9c887cff81f1a5d8268dd4ff10bf173490a9 temp_name : 436b PULL Image start CONTAINER_IMAGE : quay.io/rhn_support_hewang/container-sriov-rhel9-x86_64 Trying to pull quay.io/rhn_support_hewang/container-sriov-rhel9-x86_64:latest... Getting image source signatures Copying blob sha256:184c2824a8a09cf1baa633f9c8ab385074304940103a677e9d1ecd5c33751b14 Copying blob sha256:40049f9dc50417693bf704b63a02d64347b23867b33ac7776be3fae4a2d178b0 Copying config sha256:864d1880a710f7d65adf1417a4cb76d99dd55c902d6573101d5fb89b5b479675 Writing manifest to image destination 864d1880a710f7d65adf1417a4cb76d99dd55c902d6573101d5fb89b5b479675 PULL Image end time="2025-08-21T07:38:44-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" ContainerID : cc9143ff4c60f08e6147de282bc81712a9ca32ce74e3dce5beead6e25628ec7d container_pid : 18803 lrwxrwxrwx. 1 root root 0 Aug 21 07:38 /proc/18803/ns/net -> net:[4026534045] total 0 drwxr-xr-x. 2 root root 60 Aug 21 07:38 . drwxr-xr-x. 42 root root 1160 Aug 21 07:38 .. lrwxrwxrwx. 1 root root 18 Aug 21 07:38 18803 -> /proc/18803/ns/net /var/usr/local/bin/cnitool plugin type="sriov" name="sriov-net" failed (add): failed to settle addresses for "eth0": link eth0 still has tentative addresses after 5000000000 seconds CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES f40ae8be0fa2 localhost/podman-pause:5.4.0-1750848143 10 seconds ago Up 5 seconds 4200f7cb3349-infra cc9143ff4c60 quay.io/rhn_support_hewang/container-sriov-rhel9-x86_64:latest /bin/bash 5 seconds ago Up 5 seconds 436b Device "eth0" does not exist. Cannot get driver information: No such device 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever Cannot get driver information: No such device Container driver is Container is not using the vf driver! Device "eth0" does not exist. Fail to set spoof checking to on 6: ens6f0np0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether b8:ce:f6:cc:a3:7c brd ff:ff:ff:ff:ff:ff vf 0 link/ether 52:54:00:11:8f:ee brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state auto, trust off, query_rss off altname enp67s0f0np0 4200f7cb33498e0f370f3af072ef9c887cff81f1a5d8268dd4ff10bf173490a9 4200f7cb33498e0f370f3af072ef9c887cff81f1a5d8268dd4ff10bf173490a9 Start Creating 0 VF of ens6f0np0, driver is mlx5_core PF PCI: 0000:43:00.0 package install is not installed Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use "rhc" or "subscription-manager" to register. Last metadata expiration check: 0:09:41 ago on Thu 21 Aug 2025 07:29:15 AM EDT. No match for argument: install Error: Unable to find a match: install mstflint-4.30.0-1.el9.x86_64 SRIOV_EN True(1) 6: ens6f0np0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether b8:ce:f6:cc:a3:7c brd ff:ff:ff:ff:ff:ff promiscuity 0 allmulti 0 minmtu 68 maxmtu 9978 numtxqueues 768 numrxqueues 63 gso_max_size 65536 gso_max_segs 65535 tso_max_size 524280 tso_max_segs 65535 gro_max_size 65536 gso_ipv4_max_size 65536 gro_ipv4_max_size 65536 portname p0 switchid 7ca3cc0003f6ceb8 parentbus pci parentdev 0000:43:00.0 altname enp67s0f0np0 Complete creating VF :: [ 07:39:33 ] :: [ FAIL ] :: Command 'oc_container_spoofchk_on' (Expected 0, got 2)
Actual results:
plugin type="sriov" name="sriov-net" failed (add): failed to settle addresses for "eth0": link eth0 still has tentative addresses after 5000000000 seconds
Expected results:
It works fine
Additional info: