Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-25343

Egress router POD creation is failing while using openshift-sdn network plugin on 4.13

XMLWordPrintable

    • Important
    • No
    • SDN Sprint 246, SDN Sprint 247, SDN Sprint 248
    • 3
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      When trying to create an egress router pod on OpenShift the below error  is seen

      error adding container to network "openshift-sdn": CNI request failed with status 400: 'could not open netns "/var/run/netns/<layer_id>": unknown FS magic on "/var/run/netns/<layer_id>": 1021994 

       

      Version-Release number of selected component (if applicable):

      OpenShift v4.13.18 using O-SDN

       

      How reproducible:

      Occurring Always

       

      Steps to Reproduce:

      1. Customer following Documentaion

      2. Check events within the project & logs for creation

      3. Check the logs from sdn-xxx pods

       

      Actual results:

      (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_itsp-proxy-w9rxk_itsp-proxy_e0ad5af3-5578-436d-94bd-c44ec158a3dd_0(3699d673bed5c0c110d600d8dcbae993a7bfbb5d5ba34cf895398b1c0a3e5d07): error adding pod itsp-proxy_itsp-proxy-w9rxk to CNI network "multus-cni-network": plugin type="multus" name="multus-cni-network" failed (add): [itsp-proxy/itsp-proxy-w9rxk/e0ad5af3-5578-436d-94bd-c44ec158a3dd:openshift-sdn]: error adding container to network "openshift-sdn": CNI request failed with status 400: 'could not open netns "/var/run/netns/db37539c-0d20-48f5-9303-d1515d1ac3d4": unknown FS magic on "/var/run/netns/db37539c-0d20-48f5-9303-d1515d1ac3d4": 1021994 '

       

      $ oc logs sdn-fpvqn -c sdn | grep "unknown FS magic on" 
      2023-12-08T15:08:23.411251242Z W1208 15:08:23.411142    2014 pod.go:296] CNI_ADD itsp-proxy/itsp-proxy-ext-rmdtt failed: could not open netns "/var/run/netns/b1011980-4b43-45ba-8149-893727200f6f": unknown FS magic on "/var/run/netns/b1011980-4b43-45ba-8149-893727200f6f": 1021994
      2023-12-08T15:08:23.529082510Z W1208 15:08:23.528777    2014 pod.go:296] CNI_ADD itsp-proxy/itsp-proxy-sr97w failed: could not open netns "/var/run/netns/1d94c1f5-20fe-4cd7-af7d-51994e55b623": unknown FS magic on "/var/run/netns/1d94c1f5-20fe-4cd7-af7d-51994e55b623": 1021994
      2023-12-08T15:08:35.706593966Z W1208 15:08:35.706515    2014 pod.go:296] CNI_ADD itsp-proxy/itsp-proxy-sr97w failed: could not open netns "/var/run/netns/a9a1fd5f-922c-45ef-a139-87278c8b4b28": unknown FS magic on "/var/run/netns/a9a1fd5f-922c-45ef-a139-87278c8b4b28": 1021994

       

      Expected results:

      egress router pod running with no such errors

      Additional info:

      This Bug seems to re-occur on 4.13 & seems regression of OCPBUGS-3744. I am creating this newer one as the previous is closed & we can better track progress here.

              jcaamano@redhat.com Jaime Caamaño Ruiz
              rhn-support-adubey Akash Dubey
              Huiran Wang Huiran Wang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated: