Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-45079

Using ovn-kubernetes network with v1.multus-cni.io/default-network annotation causes pod to get stuck in ContainerCreating

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • 4.17
    • None
    • None
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      Setting an ovn-kubernetes secondary network as a pod's default network
      using the `v1.multus-cni.io/default-network` annotation causes the pod
      to become stuck in the ContainerCreating state with errors in its event log.

      Version-Release number of selected component (if applicable):

      4.17.4 (initial reported as MTV bug (https://issues.redhat.com/browse/MTV-1645) with OpenShift 4.16.8)

      How reproducible:

      100%

      Steps to Reproduce:

      1. Create an NAD for an ovn-kubernetes network.

       

      apiVersion: k8s.cni.cncf.io/v1
      kind: NetworkAttachmentDefinition
      metadata:
        name: flatl2
        namespace: default
      spec:
        config: |
          {
            "cniVersion": "0.3.1",
            "name": "flatl2",
            "netAttachDefName": "default/flatl2",
            "topology": "layer2",
            "type": "ovn-k8s-cni-overlay"
          }

       

       

      2. Create a pod with that network as the default network, using the `v1.multus-cni.io/default-network` annotation.

       

      apiVersion: v1
      kind: Pod
      metadata:
        annotations:
          v1.multus-cni.io/default-network: default/flatl2
        name: example
        namespace: default
      spec:
        containers:
          - name: ubuntu
            image: ubuntu
            command: ["yes"]

       

      Actual results:

      The pod becomes stuck in a ContainerCreating state with error messages in the pod event log:

      Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_example_default_c82931a7-759c-4254-924f-c95c13862d2e_0(df668fb94f572bee64e19805732463e44221d30c25e4c7e3d2b7848127f575d3): error adding pod default_example to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"df668fb94f572bee64e19805732463e44221d30c25e4c7e3d2b7848127f575d3" Netns:"/var/run/netns/31c9357a-2583-44ff-9925-07f4ce40bf5c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=example;K8S_POD_INFRA_CONTAINER_ID=df668fb94f572bee64e19805732463e44221d30c25e4c7e3d2b7848127f575d3;K8S_POD_UID=c82931a7-759c-4254-924f-c95c13862d2e" Path:"" ERRORED: error configuring pod [default/example] networking: [default/example/c82931a7-759c-4254-924f-c95c13862d2e:flatl2]: error adding container to network "flatl2": CNI request failed with status 400: '[default/example df668fb94f572bee64e19805732463e44221d30c25e4c7e3d2b7848127f575d3 network flatl2 NAD default/flatl2] [default/example df668fb94f572bee64e19805732463e44221d30c25e4c7e3d2b7848127f575d3 network flatl2 NAD default/flatl2] failed to get pod annotation: timed out waiting for annotations: context deadline exceeded ' ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}

       

      Expected results:

      The pod is created successfully, with the network specified in the annotation as its default network.

      Additional info:

      See https://issues.redhat.com/browse/MTV-1645 for details on the impact of this bug on MTV.

              bbennett@redhat.com Ben Bennett
              slucidi@redhat.com Samuel Lucidi
              Anurag Saxena Anurag Saxena
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated: