Uploaded image for project: 'Red Hat Advanced Cluster Management'
  1. Red Hat Advanced Cluster Management
  2. ACM-5116

Debug console is failing for container in pod is not available when hypershift create with default disk size (DiskPressure)

    XMLWordPrintable

Details

    • False
    • None
    • False
    • No
    • Moderate

    Description

      Description of problem:

      node Debug console is not available on all nodes when deploying hypershift on kubevirt using the 'hypershift create cluster kubevirt' default root-volume-size (16 GB).

      Version-Release number of selected component (if applicable):

      (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc version
      Client Version: 4.12.0-0.nightly-2023-04-01-095001
      Kustomize Version: v4.5.7
      Server Version: 4.12.8
      Kubernetes Version: v1.25.7+eab9cc9

      How reproducible:

      happens all the time.

      Steps to Reproduce:

      1. the setup I deployed is a hub cluster of 3 master + 3 workers with 100G disk each, and on that, deployed a hosted cluster with 2 workers of 16G disk which is the default

      Actual results:

      (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc debug node/hyper-1-kd7sm
      Temporary namespace openshift-debug-5cctb is created for debugging node...
      Starting pod/hyper-1-kd7sm-debug ...
      To use host binaries, run `chroot /host`

      Removing debug pod ...
      Temporary namespace openshift-debug-5cctb was removed.
      Error from server (BadRequest): container "container-00" in pod "hyper-1-kd7sm-debug" is not available
      (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]

      Expected results:

      (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc debug node/hyper-1-rkkkm
      Temporary namespace openshift-debug-v6xr8 is created for debugging node...
      Starting pod/hyper-1-rkkkm-debug ...
      To use host binaries, run `chroot /host`
      Pod IP: 10.128.2.76
      If you don't see a command prompt, try pressing enter.
      sh-4.4# 

      Additional info:

      1. in the output of :

      (.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc describe node hyper-1-kd7sm 

      Conditions:
        Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
        ----             ------  -----------------                 ------------------                ------                       -------
        MemoryPressure   False   Sun, 23 Apr 2023 17:27:02 +0300   Sun, 02 Apr 2023 19:45:20 +0300   KubeletHasSufficientMemory   kubelet has sufficient memory available
        DiskPressure     True    Sun, 23 Apr 2023 17:27:02 +0300   Sat, 15 Apr 2023 00:10:46 +0300   KubeletHasDiskPressure       kubelet has disk pressure
        PIDPressure      False   Sun, 23 Apr 2023 17:27:02 +0300   Sun, 02 Apr 2023 19:45:20 +0300   KubeletHasSufficientPID      kubelet has sufficient PID available
        Ready            True    Sun, 23 Apr 2023 17:27:02 +0300   Sun, 02 Apr 2023 19:47:53 +0300   KubeletReady                 kubelet is posting ready status

       

      2. deploying with a non-default value for --root-volume-size=64 works fine.

      3. [root@ocp-edge44 ~]# oc get catalogsource -n openshift-marketplace
      NAME                  DISPLAY                                 TYPE   PUBLISHER   AGE
      certified-operators   Certified Operators                     grpc   Red Hat     27h
      community-operators   Community Operators                     grpc   Red Hat     27h
      mce-custom-registry   2.2.4-DOWNANDBACK-2023-04-20-19-04-35   grpc   Red Hat     26h
      redhat-marketplace    Red Hat Marketplace                     grpc   Red Hat     27h
      redhat-operators      Red Hat Operators                       grpc   Red Hat     27h

       

      Attachments

        Activity

          People

            rokejungrh Roke Jung
            rhn-support-gamado Gal Amado
            David Huynh David Huynh
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: