Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-58360

whereabouts-controller in CreateContainerError updating to 4.18.19

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Important
    • Yes
    • None
    • None
    • None
    • +
    • Done
    • Release Note Not Required
    • N/A

      Description of problem:

          Cluster upgrade is stuck as Upgrade of ClusterOperator fail with network Progressing	4.18.18	Deployment "/openshift-multus/whereabouts-controller" is not available.
      
      The pod in openshift-multus namespace is in CreateContainerError state: 
      pod/whereabouts-controller-6cdb576698-js5rg        0/1     
      CreateContainerError   0          1h
           waiting:
              message: |
                container create failed: executable file `/usr/src/whereabouts/bin/node-slice-controller` not found: No such file or directory
              reason: CreateContainerError
          volumeMounts:
      From the events I can see: 
      
      1h43m       Warning   Failed             pod/whereabouts-controller-6cdb576698-z9rgj    Error: container create failed: executable file `/usr/src/whereabouts/bin/node-slice-controller` not found: No such file or directory
      
      podman run -it quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65d7ead618f2fc253f14c5baa4f22ad8c60936540985045d8b51c89f2436f418 ls -la /usr/src/whereabouts/bin/
      total 103152
      drwxr-xr-x 2 root root       69 Jun 23 10:16 .
      drwxr-xr-x 6 root root       57 Jun 23 10:16 ..
      -rwxrwxr-x 1 root root      779 Jun 23 10:11 entrypoint.sh
      -rwxr-xr-x 1 root root 54842200 Jun 23 10:16 ip-control-loop
      -rwxr-xr-x 1 root root 50774248 Jun 23 10:16 whereabouts
      
      is missing the "node-slice-controller" executable here.

      Version-Release number of selected component (if applicable):

         4.18.19 

      How reproducible:

          Try upgrading to 4.18.19

      Steps to Reproduce:

          1. Create 4.18.18 cluster
          2. Enable additional networks
       
        additionalNetworks:
        - name: whereabouts-shim
          namespace: default
          rawCNIConfig: |-
            {
             "name": "whereabouts-shim",
             "cniVersion": "0.3.1",
             "type": "bridge",
             "ipam": {
               "type": "whereabouts"
             }
            }
          type: Raw
       
          3. Try updating to 4.18.19
          4. When upgrading to 4.18.19 additional pods are created - the whereabouts-controller is the one that does not work throwing CreateContainerError.
          

      Actual results:

          

      Expected results:

          

      Additional info:

          To workaround the upgrade issue it is needed to remove the additionalNetworks which will remove the DaemonSet and the upgrade can continue.

              bpickard@redhat.com Ben Pickard
              rhn-support-afaulhab Anne Faulhaber
              None
              None
              Weibin Liang Weibin Liang
              None
              Votes:
              4 Vote for this issue
              Watchers:
              32 Start watching this issue

                Created:
                Updated:
                Resolved: