Customer is trying to use Mellanox Technologies MT27800 Family [ConnectX-5] nic that supports InfiniBand mode. They were using the NIC with linkType: eth but when they re-deployed with change to linkType: ib 

The Sriov-Network-Operator is failing to initialize the nic

SR-IOV Operator on OCP v4.10

Very reproducible

1. Install SR-IOV network operator
2. Deploy SriovNetworkNodePolicy with linkType: ib
3. Check if the VFs are up

The VFs aren't intialized & can't see them
[adubey@supportshell-1 03315209]$ cat 0140-sosreport-ocp-w-6-03315209-2022-10-19-aaecksr.tar.xz/sosreport-ocp-w-6-03315209-2022-10-19-aaecksr/sos_commands/networking/ip_-s_-d_link | grep vf
[adubey@supportshell-1 03315209]${code}
Expected results:
{code:none}
The VF should be up with sriov-network-config-daemon-xxxx pod initializing them without errors

They are now specifing numVFs: 8 - Not sure if this can cause issue as upto 128 is allowed for Mellanox nic(s)