When running the SRIOV cnf-gotest automated test cases pods with SRIOV secondary interfaces are failing to deploy with an error SRIOV-CNI failed to load netconf: pci address 0000:86:01.3 is already allocated. We are using the Intel E810 card.

Easily

1. Deploy OCP 4.12.35 on BM cluster with Intel E810 card
2. Create sriovnetworkpolicy and sriovnetwork
3. Apply sriov network to container

FailedCreatePodSandBox 55s  kubelet           Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-7sg9d_sriov-operator-tests_be4fdaa3-1e66-40c3-afe8-a1296da68b41_0(1ee434e29cf874385bde450faf6f67cb5b86444d942506d6bd1dcaba75084095): error adding pod sriov-operator-tests_testpod-7sg9d to CNI network "multus-cni-network": plugin type="multus" name="multus-cni-network" failed (add): [sriov-operator-tests/testpod-7sg9d/be4fdaa3-1e66-40c3-afe8-a1296da68b41:test-sriov-static-custom]: error adding container to network "test-sriov-static-custom": SRIOV-CNI failed to load netconf: pci address 0000:86:01.3 is already allocated 

Expected pod to enter running state

root@worker-0 /]# find /host/var/lib/cni/sriov -ls
...
 37749248      4 -rw-------   1  root     root           51 Oct  2 07:28 /host/var/lib/cni/sriov/pci/0000:86:01.3
...

[root@worker-0 /]# cat /host/var/lib/cni/sriov/pci/0000\:86\:01.3 
/var/run/netns/3ec15511-a387-40e6-a7c6-2de71b7bf880

// found in ovnkube logs
2023-10-02T07:28:03.165016229Z I1002 07:28:03.164929  419528 cni.go:248] [sriov-operator-tests/testpod-cqgl8 c46f0887118f91050a8436bcb51a17680231679d9a1feff598a141f6d143ddeb] ADD finished CNI request [sriov-operator-tests/testpod-cqgl8 c46f0887118f91050a8436bcb51a17680231679d9a1feff598a141f6d143ddeb], result "{\"interfaces\":[{\"name\":\"c46f0887118f910\",\"mac\":\"c6:86:4b:4c:70:56\"},{\"name\":\"eth0\",\"mac\":\"0a:58:0a:80:03:15\",\"sandbox\":\"/var/run/netns/3ec15511-a387-40e6-a7c6-2de71b7bf880\"}],\"ips\":[{\"interface\":1,\"address\":\"10.128.3.21/23\",\"gateway\":\"10.128.2.1\"}],\"dns\":{}}", err <nil>

Oct 02 07:27:20 worker-0 kubenswrapper[5961]: E1002 07:27:20.860963    5961 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" 
    for \"testpod-cqgl8_sriov-operator-tests(92f60bc6-73a2-4972-b42b-1ef43751d7a1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"testpod-cqgl8_sriov-operator-tests(92f60bc6-73a2-4972-b42b-1ef43751d7a1)\\\": 
    rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-cqgl8_sriov-operator-tests_92f60bc6-73a2-4972-b42b-1ef43751d7a1_0(898e41b3caa05285140dc68ba621f655b7b1f5706ce6e1cc8b6fab39acce6696): 
    error adding pod sriov-operator-tests_testpod-cqgl8 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus\\\" name=\\\"multus-cni-network\\\" failed (add): [sriov-operator-tests/testpod-cqgl8/92f60bc6-73a2-4972-b42b-1ef43751d7a1:test-sriov-static-custom]: 
    error adding container to network \\\"test-sriov-static-custom\\\": SRIOV-CNI failed to load netconf: LoadConf(): the VF 0000:86:01.3 does not have a interface name or a dpdk driver\"" pod="sriov-operator-tests/testpod-cqgl8" podUID=92f60bc6-73a2-4972-b42b-1ef43751d7a1

Oct 02 07:28:13 worker-0 kubenswrapper[5961]: E1002 07:28:13.567236    5961 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"92f60bc6-73a2-4972-b42b-1ef43751d7a1\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for pod sandbox k8s_testpod-cqgl8_sriov-operator-tests_92f60bc6-73a2-4972-b42b-1ef43751d7a1_0(c46f0887118f91050a8436bcb51a17680231679d9a1feff598a141f6d143ddeb): 
    error removing pod sriov-operator-tests_testpod-cqgl8 from CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus\\\" name=\\\"multus-cni-network\\\" 
    failed (delete): delegateDel: error invoking DelegateDel - \\\"sriov\\\": error in getting result from DelNetwork: 
    failed to restore original effective netlink MAC address be:01:d6:fa:de:b3: resource temporarily unavailable\"" pod="sriov-operator-tests/testpod-cqgl8" podUID=92f60bc6-73a2-4972-b42b-1ef43751d7a1