-
Bug
-
Resolution: Won't Do
-
Critical
-
None
-
4.18, 4.19
-
Quality / Stability / Reliability
-
False
-
-
None
-
None
-
None
-
None
-
None
-
Rejected
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Description of problem:
The main thing I was alerted to was this error message:
namespace/e2e-test-egress-router-cni-e2e-skn6l node/worker-2.ostest.test.metalkube.org pod/egress-router-cni-deployment-74f6cd55f-db98l hmsg/5fad4e9620 - never deleted - firstTimestamp/2025-02-07T04:02:01Z interesting/true lastTimestamp/2025-02-07T04:02:01Z reason/FailedCreatePodSandBox Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_egress-router-cni-deployment-74f6cd55f-db98l_e2e-test-egress-router-cni-e2e-skn6l_2f7b46e6-1e9b-4ecd-81a1-02e9aa83fca9_0(0c1bfd2c1ccd2f2718aa69bdd5bf035041a71093dfd094eaf811508b6d108f0a): error adding pod e2e-test-egress-router-cni-e2e-skn6l_egress-router-cni-deployment-74f6cd55f-db98l to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0c1bfd2c1ccd2f2718aa69bdd5bf035041a71093dfd094eaf811508b6d108f0a" Netns:"/var/run/netns/9f380cc9-f7b6-4b9e-9882-0c826c48d931" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=e2e-test-egress-router-cni-e2e-skn6l;K8S_POD_NAME=egress-router-cni-deployment-74f6cd55f-db98l;K8S_POD_INFRA_CONTAINER_ID=0c1bfd2c1ccd2f2718aa69bdd5bf035041a71093dfd094eaf811508b6d108f0a;K8S_POD_UID=2f7b46e6-1e9b-4ecd-81a1-02e9aa83fca9" Path:"" ERRORED: error configuring pod [e2e-test-egress-router-cni-e2e-skn6l/egress-router-cni-deployment-74f6cd55f-db98l] networking: [e2e-test-egress-router-cni-e2e-skn6l/egress-router-cni-deployment-74f6cd55f-db98l/2f7b46e6-1e9b-4ecd-81a1-02e9aa83fca9:egress-router-cni-nad]: error adding container to network "egress-router-cni-nad": failed to unmarshal raw result: unexpected end of JSON input
Additionally, I noted that this error message:
failed to unmarshal raw result: unexpected end of JSON input
Likely originates from: https://github.com/containernetworking/cni/blob/main/pkg/invoke/exec.go#L41-L51
[sig-network] pods should successfully create sandboxes by other We identified that the main signature for the test failure is: namespace/e2e-statefulset-2751 node/worker-0.ostest.test.metalkube.org pod/ss2-0 hmsg/c8520ff60a - 6.78 seconds after deletion - firstTimestamp/2025-02-05T15:22:17Z interesting/true lastTimestamp/2025-02-05T15:22:17Z reason/FailedCreatePodSandBox Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ss2-0_e2e-statefulset-2751_0469ee01-3e72-44fd-adb1-635889b5128f_0(01502190ae3fd7670eb7f162715b9f3f18c2a67b54e22291e624d3b9292d3b52): error adding pod e2e-statefulset-2751_ss2-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"01502190ae3fd7670eb7f162715b9f3f18c2a67b54e22291e624d3b9292d3b52" Netns:"/var/run/netns/360bfa40-088e-4748-90da-6be2f403ee70" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=e2e-statefulset-2751;K8S_POD_NAME=ss2-0;K8S_POD_INFRA_CONTAINER_ID=01502190ae3fd7670eb7f162715b9f3f18c2a67b54e22291e624d3b9292d3b52;K8S_POD_UID=0469ee01-3e72-44fd-adb1-635889b5128f" Path:"" ERRORED: error configuring pod [e2e-statefulset-2751/ss2-0] networking: [e2e-statefulset-2751/ss2-0/0469ee01-3e72-44fd-adb1-635889b5128f:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[e2e-statefulset-2751/ss2-0 01502190ae3fd7670eb7f162715b9f3f18c2a67b54e22291e624d3b9292d3b52 network default NAD default] [e2e-statefulset-2751/ss2-0 01502190ae3fd7670eb7f162715b9f3f18c2a67b54e22291e624d3b9292d3b52 network default NAD default] pod deleted before sandbox ADD operation began
Version-Release number of selected component (if applicable):
4.19
How reproducible:
Only see 3 times but all within one day
Steps to Reproduce:
1.
2.
3.
Actual results:
Expected results:
A flake rate similar to 4.19.
Additional info:
Component Readiness link: https://sippy.dptools.openshift.org/sippy-ng/component_readiness/test_details?Architecture=amd64&Architecture=amd64&FeatureSet=default&FeatureSet=default&Installer=ipi&Installer=ipi&Network=ovn&Network=ovn&NetworkAccess=default&Platform=aws&Platform=aws&Scheduler=default&SecurityMode=default&Suite=unknown&Suite=unknown&Topology=ha&Topology=ha&Upgrade=micro&Upgrade=micro&baseEndTime=2025-01-22%2023%3A59%3A59&baseRelease=4.19&baseStartTime=2024-11-01%2000%3A00%3A00&capability=Other&columnGroupBy=Architecture%2CNetwork%2CPlatform%2CTopology&component=Networking%20%2F%20cluster-network-operator&confidence=95&dbGroupBy=Platform%2CArchitecture%2CNetwork%2CTopology%2CFeatureSet%2CUpgrade%2CSuite%2CInstaller&environment=amd64%20default%20ipi%20ovn%20aws%20unknown%20ha%20micro&flakeAsFailure=0&ignoreDisruption=1&ignoreMissing=0&includeMultiReleaseAnalysis=1&includeVariant=Architecture%3Aamd64&includeVariant=CGroupMode%3Av2&includeVariant=ContainerRuntime%3Acrun&includeVariant=ContainerRuntime%3Arunc&includeVariant=FeatureSet%3Adefault&includeVariant=FeatureSet%3Atechpreview&includeVariant=Installer%3Aipi&includeVariant=Installer%3Aupi&includeVariant=Network%3Aovn&includeVariant=Owner%3Aeng&includeVariant=Owner%3Aservice-delivery&includeVariant=Platform%3Aaws&includeVariant=Platform%3Aazure&includeVariant=Platform%3Agcp&includeVariant=Platform%3Ametal&includeVariant=Platform%3Arosa&includeVariant=Platform%3Avsphere&includeVariant=Topology%3Aha&includeVariant=Topology%3Amicroshift&minFail=2&passRateAllTests=0&passRateNewTests=95&pity=5&sampleEndTime=2025-01-22%2023%3A59%3A59&samplePRNumber=2147&samplePROrg=openshift&samplePRRepo=kubernetes&sampleRelease=4.19&sampleStartTime=2024-11-01%2000%3A00%3A00&testBasisRelease=4.19&testId=openshift-tests-upgrade%3A356e9bda27b1959596ec4e937754f0a3&testName=%5Bsig-network%5D%20pods%20should%20successfully%20create%20sandboxes%20by%20other&view=
- clones
-
-
- Closed
-
