SRIOV Fails on Intel XXV710 Interface

SRIOV enablement on Intel XXV710 fails on OCP 4.12.Same configuration is successful in OCP 4.11.

4.12 

Always

1. Deploy managed cluster via ZTP including SRIOV operators and specifying a SRIOV enabled network interface
2. OCP installation is successful
3. SRIOV fails to enable on specified Intel XXV710 interface.

SRIOV fails to start. Errors and logs below.

SRIOV enablement is successful

#oc get sriovnetworknodestates.sriovnetwork.openshift.io -n openshift-sriov-network-operator helix23.lab.eng.tlv2.redhat.com -o yaml
...  
syncStatus: InProgress


# oc logs sriov-network-config-daemon-48px4 -n openshift-sriov-network-operator -c sriov-network-config-daemon

519 02:26:48.257037   11129 utils.go:488] getNetdevMTU(): get MTU for device 0000:3b:00.0
I0519 02:26:48.257108   11129 utils.go:483] tryGetInterfaceName(): name is ens1f0
I0519 02:26:48.257193   11129 utils.go:483] tryGetInterfaceName(): name is ens1f0
I0519 02:26:48.257198   11129 utils.go:509] getNetDevMac(): get Mac for device ens1f0
I0519 02:26:48.257233   11129 utils.go:521] getNetDevLinkSpeed(): get LinkSpeed for device ens1f0
I0519 02:26:48.257277   11129 utils.go:668] getLinkType(): Device 0000:3b:00.0
I0519 02:26:48.257489   11129 utils.go:721] GetNicSriovMode(): device 0000:3b:00.0
W0519 02:26:48.257607   11129 utils.go:128] DiscoverSriovDevices(): unable to get device mode 0000:3b:00.0 "no such device"
I0519 02:26:48.257703   11129 utils.go:488] getNetdevMTU(): get MTU for device 0000:3b:00.1

# lspci -v
3b:00.0 Ethernet controller: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 (rev 02)
    Subsystem: Intel Corporation Ethernet 25G 2P XXV710 Adapter
    Flags: bus master, fast devsel, latency 0, IRQ 129, NUMA node 0, IOMMU group 64
...
    Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
...
    Kernel driver in use: i40e
    Kernel modules: i40e


# dmesg|grep 3b:00
...
[    1.743032] pci_bus 0000:3b: resource 1 [mem 0xadc00000-0xadcfffff]
[    1.743032] pci_bus 0000:3b: resource 2 [mem 0xab000000-0xadafffff 64bit pref]
[    2.335286] pci 0000:3b:00.0: Adding to iommu group 64
[    2.335286] pci 0000:3b:00.1: Adding to iommu group 65
[    2.963952] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db'
[   11.102666] i40e 0000:3b:00.0: fw 9.80.70867 api 1.15 nvm 9.00 0x8000cada 21.5.9 [8086:158b] [8086:0009]
[   11.102670] i40e 0000:3b:00.0: The driver for the device detected a newer version of the NVM image v1.15 than expected v1.9. Please install the most recent version of the network driver.
[   11.609666] i40e 0000:3b:00.0: MAC address: 40:a6:b7:71:b4:c0
[   11.609966] i40e 0000:3b:00.0: FW LLDP is enabled
[   11.636352] i40e 0000:3b:00.0: PCI-Express: Speed 8.0GT/s Width x8
[   11.636905] i40e 0000:3b:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 80 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA