-
Bug
-
Resolution: Unresolved
-
Normal
-
None
-
4.13
-
Important
-
No
-
SDN Sprint 246, SDN Sprint 247, SDN Sprint 248
-
3
-
False
-
Description of problem:
When trying to create an egress router pod on OpenShift the below error is seen
error adding container to network "openshift-sdn": CNI request failed with status 400: 'could not open netns "/var/run/netns/<layer_id>": unknown FS magic on "/var/run/netns/<layer_id>": 1021994
Version-Release number of selected component (if applicable):
OpenShift v4.13.18 using O-SDN
How reproducible:
Occurring Always
Steps to Reproduce:
1. Customer following Documentaion
2. Check events within the project & logs for creation
3. Check the logs from sdn-xxx pods
Actual results:
(combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_itsp-proxy-w9rxk_itsp-proxy_e0ad5af3-5578-436d-94bd-c44ec158a3dd_0(3699d673bed5c0c110d600d8dcbae993a7bfbb5d5ba34cf895398b1c0a3e5d07): error adding pod itsp-proxy_itsp-proxy-w9rxk to CNI network "multus-cni-network": plugin type="multus" name="multus-cni-network" failed (add): [itsp-proxy/itsp-proxy-w9rxk/e0ad5af3-5578-436d-94bd-c44ec158a3dd:openshift-sdn]: error adding container to network "openshift-sdn": CNI request failed with status 400: 'could not open netns "/var/run/netns/db37539c-0d20-48f5-9303-d1515d1ac3d4": unknown FS magic on "/var/run/netns/db37539c-0d20-48f5-9303-d1515d1ac3d4": 1021994 '
$ oc logs sdn-fpvqn -c sdn | grep "unknown FS magic on" 2023-12-08T15:08:23.411251242Z W1208 15:08:23.411142 2014 pod.go:296] CNI_ADD itsp-proxy/itsp-proxy-ext-rmdtt failed: could not open netns "/var/run/netns/b1011980-4b43-45ba-8149-893727200f6f": unknown FS magic on "/var/run/netns/b1011980-4b43-45ba-8149-893727200f6f": 1021994 2023-12-08T15:08:23.529082510Z W1208 15:08:23.528777 2014 pod.go:296] CNI_ADD itsp-proxy/itsp-proxy-sr97w failed: could not open netns "/var/run/netns/1d94c1f5-20fe-4cd7-af7d-51994e55b623": unknown FS magic on "/var/run/netns/1d94c1f5-20fe-4cd7-af7d-51994e55b623": 1021994 2023-12-08T15:08:35.706593966Z W1208 15:08:35.706515 2014 pod.go:296] CNI_ADD itsp-proxy/itsp-proxy-sr97w failed: could not open netns "/var/run/netns/a9a1fd5f-922c-45ef-a139-87278c8b4b28": unknown FS magic on "/var/run/netns/a9a1fd5f-922c-45ef-a139-87278c8b4b28": 1021994
Expected results:
egress router pod running with no such errors
Additional info:
This Bug seems to re-occur on 4.13 & seems regression of OCPBUGS-3744. I am creating this newer one as the previous is closed & we can better track progress here.