-
Bug
-
Resolution: Done
-
Major
-
None
-
ACM 2.7.4
-
False
-
None
-
False
-
-
-
Moderate
-
No
Description of problem:
node Debug console is not available on all nodes when deploying hypershift on kubevirt using the 'hypershift create cluster kubevirt' default root-volume-size (16 GB).
Version-Release number of selected component (if applicable):
(.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc version
Client Version: 4.12.0-0.nightly-2023-04-01-095001
Kustomize Version: v4.5.7
Server Version: 4.12.8
Kubernetes Version: v1.25.7+eab9cc9
How reproducible:
happens all the time.
Steps to Reproduce:
- the setup I deployed is a hub cluster of 3 master + 3 workers with 100G disk each, and on that, deployed a hosted cluster with 2 workers of 16G disk which is the default
Actual results:
(.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc debug node/hyper-1-kd7sm
Temporary namespace openshift-debug-5cctb is created for debugging node...
Starting pod/hyper-1-kd7sm-debug ...
To use host binaries, run `chroot /host`
Removing debug pod ...
Temporary namespace openshift-debug-5cctb was removed.
Error from server (BadRequest): container "container-00" in pod "hyper-1-kd7sm-debug" is not available
(.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$
Expected results:
(.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc debug node/hyper-1-rkkkm
Temporary namespace openshift-debug-v6xr8 is created for debugging node...
Starting pod/hyper-1-rkkkm-debug ...
To use host binaries, run `chroot /host`
Pod IP: 10.128.2.76
If you don't see a command prompt, try pressing enter.
sh-4.4#
Additional info:
1. in the output of :
(.venv) [kni@ocp-edge77 ocp-edge-auto_cluster]$ oc describe node hyper-1-kd7sm
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sun, 23 Apr 2023 17:27:02 +0300 Sun, 02 Apr 2023 19:45:20 +0300 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure True Sun, 23 Apr 2023 17:27:02 +0300 Sat, 15 Apr 2023 00:10:46 +0300 KubeletHasDiskPressure kubelet has disk pressure
PIDPressure False Sun, 23 Apr 2023 17:27:02 +0300 Sun, 02 Apr 2023 19:45:20 +0300 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sun, 23 Apr 2023 17:27:02 +0300 Sun, 02 Apr 2023 19:47:53 +0300 KubeletReady kubelet is posting ready status
2. deploying with a non-default value for --root-volume-size=64 works fine.
3. [root@ocp-edge44 ~]# oc get catalogsource -n openshift-marketplace
NAME DISPLAY TYPE PUBLISHER AGE
certified-operators Certified Operators grpc Red Hat 27h
community-operators Community Operators grpc Red Hat 27h
mce-custom-registry 2.2.4-DOWNANDBACK-2023-04-20-19-04-35 grpc Red Hat 26h
redhat-marketplace Red Hat Marketplace grpc Red Hat 27h
redhat-operators Red Hat Operators grpc Red Hat 27h