-
Bug
-
Resolution: Done
-
Critical
-
None
-
4.14.0
-
Critical
-
No
-
False
-
-
-
Description of problem:
SRIOV cnf-gotests are randomly failing on container test. This container runs the testcmd which checks connectivity to the server pod. The server Pod runs successfully.
Version-Release number of selected component (if applicable):
4.14
How reproducible:
Easily
Steps to Reproduce:
1. Deploy OCP 4.14 on BM cluster with SRIOV interfaces 2. Run cnf-gotests cases 3.
Actual results:
[FAILED] Timed out after 60.000s. Pod role Client. Invalid return code. Command: [testcmd -port=50000 -mtu=1400 -server=2001:1db8:85a3::1 -protocol=udp] Expected <v1.PodPhase>: Pending to equal <v1.PodPhase>: Succeeded In [It] at: /home/gkopels/Documents/gotests/cnf-gotests/test/network/sriov/netsriovhelper/netsriovhelper.go:798 @ 09/21/23 10:15:40.276
Expected results:
Testcmd testcmd -port=50000 -mtu=1400 -server=2001:1db8:85a3::1 -protocol=udp should run succesfully
Additional info:
# Failed Test Containers: test: Container ID: Image: quay.io/ocp-edge-qe/cnf-gotests-client:v4.13 Image ID: Port: <none> Host Port: <none> Command: testcmd -port=50000 -mtu=1400 -server=2001:1db8:85a3::1 -protocol=udp State: Waiting Reason: PodInitializing Ready: False Restart Count: 0 Limits: openshift.io/testresourceusual: 1 Requests: openshift.io/testresourceusual: 1 Environment: <none> Mounts: /etc/podnetinfo from podnetinfo (ro) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fhztw (ro)# Passed testContainers: test: Container ID: cri-o://18dbb1523f0dcd12f1b0f1e28318cad4c06ed56a410372738011257bc8271a13 Image: quay.io/ocp-edge-qe/cnf-gotests-client:v4.13 Image ID: quay.io/ocp-edge-qe/cnf-gotests-client@sha256:a02f52dd059517b4541217984a25ce5dc1e5bcbdc7f005aba292237254b25af8 Port: <none> Host Port: <none> Command: testcmd -mtu=1350 -server=2001:1db8:85a3::1 -protocol=icmp State: Running Started: Thu, 21 Sep 2023 10:30:41 +0300 Ready: True Restart Count: 0 Limits: openshift.io/testresourcecustom: 1 Requests: openshift.io/testresourcecustom: 1 Environment: <none> Mounts: /etc/podnetinfo from podnetinfo (ro) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-p6z8h (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True # Server Containers: test: Container ID: cri-o://43a23fb60bfe0780233a86fa6a7da2ee8828d721008f93925799a452dbb773c4 Image: quay.io/ocp-edge-qe/cnf-gotests-client:v4.13 Image ID: quay.io/ocp-edge-qe/cnf-gotests-client@sha256:a02f52dd059517b4541217984a25ce5dc1e5bcbdc7f005aba292237254b25af8 Port: <none> Host Port: <none> Command: testcmd --listen -interface=net1 --protocol=tcp --mtu=9000 -port=50000 State: Running Started: Thu, 21 Sep 2023 10:33:27 +0300 Ready: True Restart Count: 0 Limits: openshift.io/testresourcejumbo: 1 Requests: openshift.io/testresourcejumbo: 1 Environment: <none> Mounts: /etc/podnetinfo from podnetinfo (ro) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-v9d9p (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-v9d9p: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true ConfigMapName: openshift-service-ca.crt ConfigMapOptional: <nil> podnetinfo: Type: DownwardAPI (a volume populated by information about the pod) Items: metadata.annotations -> annotations QoS Class: BestEffort Node-Selectors: kubernetes.io/hostname=worker-0 Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 3h default-scheduler Successfully assigned sriov-operator-tests/testpod-2bf6n to worker-0 Warning FailedCreatePodSandBox 3h kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-2bf6n_sriov-operator-tests_aadf056d-b6b1-4f2c-9911-8a75af3b1e81_0(e29b9f3acf2bcb0f7c253e795c0eb79b5933b7fad82fae793818050b0d425470): error adding pod sriov-operator-tests_testpod-2bf6n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: '&{ContainerID:e29b9f3acf2bcb0f7c253e795c0eb79b5933b7fad82fae793818050b0d425470 Netns:/var/run/netns/536f1811-0b74-436b-8c66-058db72787ed IfName:eth0 Args:IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=e29b9f3acf2bcb0f7c253e795c0eb79b5933b7fad82fae793818050b0d425470;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81 Path: StdinData:[123 34 98 105 110 68 105 114 34 58 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 34 108 111 103 76 101 118 101 108 34 58 34 118 101 114 98 111 115 101 34 44 34 108 111 103 84 111 83 116 100 101 114 114 34 58 116 114 117 101 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 116 114 117 101 44 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 45 115 104 105 109 34 44 10 32 32 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 32 32 34 99 104 114 111 111 116 68 105 114 34 58 32 34 47 104 111 115 116 114 111 111 116 34 44 10 32 32 32 32 34 108 111 103 84 111 83 116 100 101 114 114 34 58 32 116 114 117 101 44 10 32 32 32 32 34 108 111 103 76 101 118 101 108 34 58 32 34 118 101 114 98 111 115 101 34 44 10 32 32 32 32 34 98 105 110 68 105 114 34 58 32 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 10 32 32 32 32 34 99 110 105 67 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 101 116 99 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 109 117 108 116 117 115 67 111 110 102 105 103 70 105 108 101 34 58 32 34 97 117 116 111 34 44 10 32 32 32 32 34 109 117 108 116 117 115 65 117 116 111 99 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 32 116 114 117 101 44 10 32 32 32 32 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 32 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 10 32 32 32 32 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 10 32 32 32 32 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 32 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 10 32 32 32 32 34 115 111 99 107 101 116 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 10 125 10]} ContainerID:"e29b9f3acf2bcb0f7c253e795c0eb79b5933b7fad82fae793818050b0d425470" Netns:"/var/run/netns/536f1811-0b74-436b-8c66-058db72787ed" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=e29b9f3acf2bcb0f7c253e795c0eb79b5933b7fad82fae793818050b0d425470;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81" Path:"" ERRORED: error configuring pod [sriov-operator-tests/testpod-2bf6n] networking: [sriov-operator-tests/testpod-2bf6n/aadf056d-b6b1-4f2c-9911-8a75af3b1e81:test-sriov-static-jumbo]: error adding container to network "test-sriov-static-jumbo": SRIOV-CNI failed to load netconf: LoadConf(): the VF 0000:3b:02.5 does not have a interface name or a dpdk driver ' Warning FailedCreatePodSandBox 3h kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-2bf6n_sriov-operator-tests_aadf056d-b6b1-4f2c-9911-8a75af3b1e81_0(294c0e32a503496553d3f53963b58f987acbe935bdd9d75407b13c9894b8fbca): error adding pod sriov-operator-tests_testpod-2bf6n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: '&{ContainerID:294c0e32a503496553d3f53963b58f987acbe935bdd9d75407b13c9894b8fbca Netns:/var/run/netns/5cd8dabf-a909-47f8-b3eb-77d0b7cd30be IfName:eth0 Args:IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=294c0e32a503496553d3f53963b58f987acbe935bdd9d75407b13c9894b8fbca;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81 Path: StdinData:[123 34 98 105 110 68 105 114 34 58 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 34 108 111 103 76 101 118 101 108 34 58 34 118 101 114 98 111 115 101 34 44 34 108 111 103 84 111 83 116 100 101 114 114 34 58 116 114 117 101 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 116 114 117 101 44 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 45 115 104 105 109 34 44 10 32 32 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 32 32 34 99 104 114 111 111 116 68 105 114 34 58 32 34 47 104 111 115 116 114 111 111 116 34 44 10 32 32 32 32 34 108 111 103 84 111 83 116 100 101 114 114 34 58 32 116 114 117 101 44 10 32 32 32 32 34 108 111 103 76 101 118 101 108 34 58 32 34 118 101 114 98 111 115 101 34 44 10 32 32 32 32 34 98 105 110 68 105 114 34 58 32 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 10 32 32 32 32 34 99 110 105 67 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 101 116 99 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 109 117 108 116 117 115 67 111 110 102 105 103 70 105 108 101 34 58 32 34 97 117 116 111 34 44 10 32 32 32 32 34 109 117 108 116 117 115 65 117 116 111 99 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 32 116 114 117 101 44 10 32 32 32 32 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 32 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 10 32 32 32 32 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 10 32 32 32 32 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 32 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 10 32 32 32 32 34 115 111 99 107 101 116 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 10 125 10]} ContainerID:"294c0e32a503496553d3f53963b58f987acbe935bdd9d75407b13c9894b8fbca" Netns:"/var/run/netns/5cd8dabf-a909-47f8-b3eb-77d0b7cd30be" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=294c0e32a503496553d3f53963b58f987acbe935bdd9d75407b13c9894b8fbca;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81" Path:"" ERRORED: error configuring pod [sriov-operator-tests/testpod-2bf6n] networking: [sriov-operator-tests/testpod-2bf6n/aadf056d-b6b1-4f2c-9911-8a75af3b1e81:test-sriov-static-jumbo]: error adding container to network "test-sriov-static-jumbo": SRIOV-CNI failed to load netconf: LoadConf(): the VF 0000:3b:02.5 does not have a interface name or a dpdk driver ' Warning FailedCreatePodSandBox 3h kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-2bf6n_sriov-operator-tests_aadf056d-b6b1-4f2c-9911-8a75af3b1e81_0(04b2b1da00f198ac8bddccd7eea959d0b9a8dcc161dda8bb76ce1fbf6a3bf8b5): error adding pod sriov-operator-tests_testpod-2bf6n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: '&{ContainerID:04b2b1da00f198ac8bddccd7eea959d0b9a8dcc161dda8bb76ce1fbf6a3bf8b5 Netns:/var/run/netns/f5dbfeb9-5fac-4628-a58e-06dae6e1e90e IfName:eth0 Args:IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=04b2b1da00f198ac8bddccd7eea959d0b9a8dcc161dda8bb76ce1fbf6a3bf8b5;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81 Path: StdinData:[123 34 98 105 110 68 105 114 34 58 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 34 108 111 103 76 101 118 101 108 34 58 34 118 101 114 98 111 115 101 34 44 34 108 111 103 84 111 83 116 100 101 114 114 34 58 116 114 117 101 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 116 114 117 101 44 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 45 115 104 105 109 34 44 10 32 32 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 32 32 34 99 104 114 111 111 116 68 105 114 34 58 32 34 47 104 111 115 116 114 111 111 116 34 44 10 32 32 32 32 34 108 111 103 84 111 83 116 100 101 114 114 34 58 32 116 114 117 101 44 10 32 32 32 32 34 108 111 103 76 101 118 101 108 34 58 32 34 118 101 114 98 111 115 101 34 44 10 32 32 32 32 34 98 105 110 68 105 114 34 58 32 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 10 32 32 32 32 34 99 110 105 67 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 101 116 99 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 109 117 108 116 117 115 67 111 110 102 105 103 70 105 108 101 34 58 32 34 97 117 116 111 34 44 10 32 32 32 32 34 109 117 108 116 117 115 65 117 116 111 99 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 32 116 114 117 101 44 10 32 32 32 32 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 32 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 10 32 32 32 32 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 10 32 32 32 32 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 32 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 10 32 32 32 32 34 115 111 99 107 101 116 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 10 125 10]} ContainerID:"04b2b1da00f198ac8bddccd7eea959d0b9a8dcc161dda8bb76ce1fbf6a3bf8b5" Netns:"/var/run/netns/f5dbfeb9-5fac-4628-a58e-06dae6e1e90e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=04b2b1da00f198ac8bddccd7eea959d0b9a8dcc161dda8bb76ce1fbf6a3bf8b5;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81" Path:"" ERRORED: error configuring pod [sriov-operator-tests/testpod-2bf6n] networking: [sriov-operator-tests/testpod-2bf6n/aadf056d-b6b1-4f2c-9911-8a75af3b1e81:test-sriov-static-jumbo]: error adding container to network "test-sriov-static-jumbo": SRIOV-CNI failed to load netconf: LoadConf(): the VF 0000:3b:02.5 does not have a interface name or a dpdk driver ' Warning FailedCreatePodSandBox 179m kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-2bf6n_sriov-operator-tests_aadf056d-b6b1-4f2c-9911-8a75af3b1e81_0(e53f259d4f3b812c52503b82c647186735bec298521ff31bcb963a0be5c628be): error adding pod sriov-operator-tests_testpod-2bf6n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: '&{ContainerID:e53f259d4f3b812c52503b82c647186735bec298521ff31bcb963a0be5c628be Netns:/var/run/netns/22e3b661-4d93-424f-b82b-e000d2205b3f IfName:eth0 Args:IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=e53f259d4f3b812c52503b82c647186735bec298521ff31bcb963a0be5c628be;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81 Path: StdinData:[123 34 98 105 110 68 105 114 34 58 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 34 108 111 103 76 101 118 101 108 34 58 34 118 101 114 98 111 115 101 34 44 34 108 111 103 84 111 83 116 100 101 114 114 34 58 116 114 117 101 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 116 114 117 101 44 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 45 115 104 105 109 34 44 10 32 32 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 32 32 34 99 104 114 111 111 116 68 105 114 34 58 32 34 47 104 111 115 116 114 111 111 116 34 44 10 32 32 32 32 34 108 111 103 84 111 83 116 100 101 114 114 34 58 32 116 114 117 101 44 10 32 32 32 32 34 108 111 103 76 101 118 101 108 34 58 32 34 118 101 114 98 111 115 101 34 44 10 32 32 32 32 34 98 105 110 68 105 114 34 58 32 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 10 32 32 32 32 34 99 110 105 67 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 101 116 99 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 109 117 108 116 117 115 67 111 110 102 105 103 70 105 108 101 34 58 32 34 97 117 116 111 34 44 10 32 32 32 32 34 109 117 108 116 117 115 65 117 116 111 99 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 32 116 114 117 101 44 10 32 32 32 32 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 32 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 10 32 32 32 32 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 10 32 32 32 32 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 32 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 10 32 32 32 32 34 115 111 99 107 101 116 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 10 125 10]} ContainerID:"e53f259d4f3b812c52503b82c647186735bec298521ff31bcb963a0be5c628be" Netns:"/var/run/netns/22e3b661-4d93-424f-b82b-e000d2205b3f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=e53f259d4f3b812c52503b82c647186735bec298521ff31bcb963a0be5c628be;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81" Path:"" ERRORED: error configuring pod [sriov-operator-tests/testpod-2bf6n] networking: [sriov-operator-tests/testpod-2bf6n/aadf056d-b6b1-4f2c-9911-8a75af3b1e81:test-sriov-static-jumbo]: error adding container to network "test-sriov-static-jumbo": SRIOV-CNI failed to load netconf: LoadConf(): the VF 0000:3b:02.5 does not have a interface name or a dpdk driver ' Warning FailedCreatePodSandBox 179m kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-2bf6n_sriov-operator-tests_aadf056d-b6b1-4f2c-9911-8a75af3b1e81_0(7f049e864ac47ad2f2061abf870ead5e3b89c3146b9e89f90d66ec1d37106a8e): error adding pod sriov-operator-tests_testpod-2bf6n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: '&{ContainerID:7f049e864ac47ad2f2061abf870ead5e3b89c3146b9e89f90d66ec1d37106a8e Netns:/var/run/netns/f2c17611-350c-488a-aba7-886f35f35c34 IfName:eth0 Args:IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=7f049e864ac47ad2f2061abf870ead5e3b89c3146b9e89f90d66ec1d37106a8e;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81 Path: StdinData:[123 34 98 105 110 68 105 114 34 58 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 34 108 111 103 76 101 118 101 108 34 58 34 118 101 114 98 111 115 101 34 44 34 108 111 103 84 111 83 116 100 101 114 114 34 58 116 114 117 101 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 116 114 117 101 44 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 45 115 104 105 109 34 44 10 32 32 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 32 32 34 99 104 114 111 111 116 68 105 114 34 58 32 34 47 104 111 115 116 114 111 111 116 34 44 10 32 32 32 32 34 108 111 103 84 111 83 116 100 101 114 114 34 58 32 116 114 117 101 44 10 32 32 32 32 34 108 111 103 76 101 118 101 108 34 58 32 34 118 101 114 98 111 115 101 34 44 10 32 32 32 32 34 98 105 110 68 105 114 34 58 32 34 47 118 97 114 47 108 105 98 47 99 110 105 47 98 105 110 34 44 10 32 32 32 32 34 99 110 105 67 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 101 116 99 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 109 117 108 116 117 115 67 111 110 102 105 103 70 105 108 101 34 58 32 34 97 117 116 111 34 44 10 32 32 32 32 34 109 117 108 116 117 115 65 117 116 111 99 111 110 102 105 103 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 34 44 10 32 32 32 32 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 32 116 114 117 101 44 10 32 32 32 32 34 103 108 111 98 97 108 78 97 109 101 115 112 97 99 101 115 34 58 32 34 100 101 102 97 117 108 116 44 111 112 101 110 115 104 105 102 116 45 109 117 108 116 117 115 44 111 112 101 110 115 104 105 102 116 45 115 114 105 111 118 45 110 101 116 119 111 114 107 45 111 112 101 114 97 116 111 114 34 44 10 32 32 32 32 34 114 101 97 100 105 110 101 115 115 105 110 100 105 99 97 116 111 114 102 105 108 101 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 99 110 105 47 110 101 116 46 100 47 49 48 45 111 118 110 45 107 117 98 101 114 110 101 116 101 115 46 99 111 110 102 34 44 10 32 32 32 32 34 100 97 101 109 111 110 83 111 99 107 101 116 68 105 114 34 58 32 34 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 44 10 32 32 32 32 34 115 111 99 107 101 116 68 105 114 34 58 32 34 47 104 111 115 116 47 114 117 110 47 109 117 108 116 117 115 47 115 111 99 107 101 116 34 10 125 10]} ContainerID:"7f049e864ac47ad2f2061abf870ead5e3b89c3146b9e89f90d66ec1d37106a8e" Netns:"/var/run/netns/f2c17611-350c-488a-aba7-886f35f35c34" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-operator-tests;K8S_POD_NAME=testpod-2bf6n;K8S_POD_INFRA_CONTAINER_ID=7f049e864ac47ad2f2061abf870ead5e3b89c3146b9e89f90d66ec1d37106a8e;K8S_POD_UID=aadf056d-b6b1-4f2c-9911-8a75af3b1e81" Path:"" ERRORED: error configuring pod [sriov-operator-tests/testpod-2bf6n] networking: [sriov-operator-tests/testpod-2bf6n/aadf056d-b6b1-4f2c-9911-8a75af3b1e81:test-sriov-static-jumbo]: error adding container to network "test-sriov-static-jumbo": SRIOV-CNI failed to load netconf: LoadConf(): the VF 0000:3b:02.5 does not have a interface name or a dpdk driver ' Normal Pulled 179m kubelet Container image "quay.io/ocp-edge-qe/cnf-gotests-client:v4.13" already present on machine Normal AddedInterface 179m multus Add net1 [2001:1db8:85a3::1/64] from sriov-operator-tests/test-sriov-static-jumbo Normal AddedInterface 179m (x6 over 3h) multus Add eth0 [10.131.0.98/23] from ovn-kubernetes Normal Created 179m kubelet Created container inittest Normal Started 179m kubelet Started container inittest Normal Pulled 179m kubelet Container image "quay.io/ocp-edge-qe/cnf-gotests-client:v4.13" already present on machine Normal Created 179m kubelet Created container initlogs Normal Started 179m kubelet Started container initlogs Normal Pulled 179m kubelet Container image "quay.io/ocp-edge-qe/cnf-gotests-client:v4.13" already present on machine Normal Created 179m kubelet Created container test Normal Started 179m kubelet Started container test Summarizing 3 Failures: [FAIL] CNF SRIOV Ipam type: IP Static, Ip Stack: ipv6, Mac address: MAC static [It] {"Protocol":"multicast-udp","MTU":1450,"Connectivity":"2 pods on different node"} [31794, test_id:31794, polarion-parameter-MTU:1450, polarion-parameter-Connectivity:2 pods on different node, polarion-parameter-Protocol:multicast-udp] /home/gkopels/Documents/gotests/cnf-gotests/test/network/sriov/netsriovhelper/netsriovhelper.go:798 [FAIL] CNF SRIOV Ipam type: IP Static, Ip Stack: ipv6, Mac address: MAC static [It] {"Protocol":"unicast-sctp","MTU":9000,"Connectivity":"2 pods on the same node 2 different PF"} [31794, test_id:31794, polarion-parameter-MTU:9000, polarion-parameter-Connectivity:2 pods on the same node 2 different PF, polarion-parameter-Protocol:unicast-sctp] /home/gkopels/Documents/gotests/cnf-gotests/test/network/sriov/netsriovhelper/netsriovhelper.go:798 [FAIL] CNF SRIOV Ipam type: IP Static, Ip Stack: ipv6, Mac address: MAC static [It] {"Protocol":"unicast-udp","MTU":1500,"Connectivity":"2 pods on same node same PF"} [31794, test_id:31794, polarion-parameter-MTU:1500, polarion-parameter-Connectivity:2 pods on same node same PF, polarion-parameter-Protocol:unicast-udp] /home/gkopels/Documents/gotests/cnf-gotests/test/network/sriov/netsriovhelper/netsriovhelper.go:798