Name: ip-10-0-134-254.eu-central-1.compute.internal Roles: worker Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/instance-type=m4.xlarge beta.kubernetes.io/os=linux failure-domain.beta.kubernetes.io/region=eu-central-1 failure-domain.beta.kubernetes.io/zone=eu-central-1a kubernetes.io/arch=amd64 kubernetes.io/hostname=ip-10-0-134-254 kubernetes.io/os=linux node-role.kubernetes.io/worker= node.openshift.io/os_id=rhcos Annotations: machine.openshift.io/machine=openshift-machine-api/maas-a4835-z7t74-worker-eu-central-1a-d9fq4 machineconfiguration.openshift.io/currentConfig=rendered-worker-ac3513437ef2a02945c17c07ad193c94 machineconfiguration.openshift.io/desiredConfig=rendered-worker-ac3513437ef2a02945c17c07ad193c94 machineconfiguration.openshift.io/reason= machineconfiguration.openshift.io/state=Done volumes.kubernetes.io/controller-managed-attach-detach=true CreationTimestamp: Thu, 26 Mar 2020 04:25:12 -0400 Taints: Unschedulable: false Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Thu, 26 Mar 2020 06:57:10 -0400 Thu, 26 Mar 2020 04:25:12 -0400 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Thu, 26 Mar 2020 06:57:10 -0400 Thu, 26 Mar 2020 04:25:12 -0400 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Thu, 26 Mar 2020 06:57:10 -0400 Thu, 26 Mar 2020 04:25:12 -0400 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Thu, 26 Mar 2020 06:57:10 -0400 Thu, 26 Mar 2020 04:26:13 -0400 KubeletReady kubelet is posting ready status Addresses: InternalIP: 10.0.134.254 Hostname: ip-10-0-134-254.eu-central-1.compute.internal InternalDNS: ip-10-0-134-254.eu-central-1.compute.internal Capacity: attachable-volumes-aws-ebs: 39 cpu: 4 ephemeral-storage: 125277164Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 16419384Ki pods: 250 Allocatable: attachable-volumes-aws-ebs: 39 cpu: 3500m ephemeral-storage: 115455434152 hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 15804984Ki pods: 250 System Info: Machine ID: dcb36df27b864739a8112f75755c0722 System UUID: ec29c7d4-f733-a3aa-9d28-b38dacb640f8 Boot ID: 6154449e-9a25-42d8-bb54-50099812b7aa Kernel Version: 4.18.0-147.5.1.el8_1.x86_64 OS Image: Red Hat Enterprise Linux CoreOS 43.81.202003191953.0 (Ootpa) Operating System: linux Architecture: amd64 Container Runtime Version: cri-o://1.16.3-28.dev.rhaos4.3.git9aad8e4.el8 Kubelet Version: v1.16.2 Kube-Proxy Version: v1.16.2 ProviderID: aws:///eu-central-1a/i-0687acbb92dc11fcc Non-terminated Pods: (18 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits --------- ---- ------------ ---------- --------------- ------------- openshift-cluster-node-tuning-operator tuned-fbh4q 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-dns dns-default-njjvc 110m (3%) 0 (0%) 70Mi (0%) 512Mi (3%) openshift-image-registry node-ca-f8dvd 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) openshift-ingress router-default-7468dc4d99-dwc8s 100m (2%) 0 (0%) 256Mi (1%) 0 (0%) openshift-machine-config-operator machine-config-daemon-9tph9 40m (1%) 0 (0%) 100Mi (0%) 0 (0%) openshift-marketplace certified-operators-5586d84b9b-qlj9n 10m (0%) 0 (0%) 100Mi (0%) 0 (0%) openshift-marketplace community-operators-5c67bbd8bb-chldw 10m (0%) 0 (0%) 100Mi (0%) 0 (0%) openshift-marketplace redhat-operators-596c7cb6-sn7q9 10m (0%) 0 (0%) 100Mi (0%) 0 (0%) openshift-monitoring alertmanager-main-0 110m (3%) 100m (2%) 245Mi (1%) 25Mi (0%) openshift-monitoring kube-state-metrics-69bdc4f895-nmtn6 30m (0%) 0 (0%) 120Mi (0%) 0 (0%) openshift-monitoring node-exporter-r6n94 112m (3%) 0 (0%) 200Mi (1%) 0 (0%) openshift-monitoring prometheus-adapter-79ccd78d7-m8jrp 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) openshift-monitoring prometheus-k8s-0 480m (13%) 200m (5%) 1234Mi (7%) 50Mi (0%) openshift-monitoring thanos-querier-6458c8d5c9-dnhl8 40m (1%) 0 (0%) 72Mi (0%) 0 (0%) openshift-multus multus-k9922 10m (0%) 0 (0%) 150Mi (0%) 0 (0%) openshift-operators console-697d7d87df-mcdl7 0 (0%) 0 (0%) 0 (0%) 0 (0%) openshift-sdn ovs-b7dgj 200m (5%) 0 (0%) 400Mi (2%) 0 (0%) openshift-sdn sdn-rjgsr 100m (2%) 0 (0%) 200Mi (1%) 0 (0%) Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 1392m (39%) 300m (8%) memory 3427Mi (22%) 587Mi (3%) attachable-volumes-aws-ebs 0 0 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal NodeHasNoDiskPressure 2h (x8 over 2h) kubelet, ip-10-0-134-254.eu-central-1.compute.internal Node ip-10-0-134-254.eu-central-1.compute.internal status is now: NodeHasNoDiskPressure Normal NodeHasSufficientPID 2h (x8 over 2h) kubelet, ip-10-0-134-254.eu-central-1.compute.internal Node ip-10-0-134-254.eu-central-1.compute.internal status is now: NodeHasSufficientPID Name: ip-10-0-141-116.eu-central-1.compute.internal Roles: master Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/instance-type=m4.xlarge beta.kubernetes.io/os=linux failure-domain.beta.kubernetes.io/region=eu-central-1 failure-domain.beta.kubernetes.io/zone=eu-central-1a kubernetes.io/arch=amd64 kubernetes.io/hostname=ip-10-0-141-116 kubernetes.io/os=linux node-role.kubernetes.io/master= node.openshift.io/os_id=rhcos Annotations: machine.openshift.io/machine=openshift-machine-api/maas-a4835-z7t74-master-0 machineconfiguration.openshift.io/currentConfig=rendered-master-f6b4fc1e7026d40e2a26ca844904cba5 machineconfiguration.openshift.io/desiredConfig=rendered-master-f6b4fc1e7026d40e2a26ca844904cba5 machineconfiguration.openshift.io/reason= machineconfiguration.openshift.io/state=Done volumes.kubernetes.io/controller-managed-attach-detach=true CreationTimestamp: Thu, 26 Mar 2020 04:15:36 -0400 Taints: node-role.kubernetes.io/master:NoSchedule Unschedulable: false Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Thu, 26 Mar 2020 06:57:12 -0400 Thu, 26 Mar 2020 04:15:36 -0400 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Thu, 26 Mar 2020 06:57:12 -0400 Thu, 26 Mar 2020 04:15:36 -0400 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Thu, 26 Mar 2020 06:57:12 -0400 Thu, 26 Mar 2020 04:15:36 -0400 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Thu, 26 Mar 2020 06:57:12 -0400 Thu, 26 Mar 2020 04:20:06 -0400 KubeletReady kubelet is posting ready status Addresses: InternalIP: 10.0.141.116 Hostname: ip-10-0-141-116.eu-central-1.compute.internal InternalDNS: ip-10-0-141-116.eu-central-1.compute.internal Capacity: attachable-volumes-aws-ebs: 39 cpu: 4 ephemeral-storage: 125277164Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 16419384Ki pods: 250 Allocatable: attachable-volumes-aws-ebs: 39 cpu: 3500m ephemeral-storage: 115455434152 hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 15804984Ki pods: 250 System Info: Machine ID: 42a9d42e96f74dd79783ba988d87e8d9 System UUID: ec243ad5-98fd-9439-bc73-2448e2d732ac Boot ID: 0e36a783-6599-4374-89e9-18ea7d7e79b1 Kernel Version: 4.18.0-147.5.1.el8_1.x86_64 OS Image: Red Hat Enterprise Linux CoreOS 43.81.202003191953.0 (Ootpa) Operating System: linux Architecture: amd64 Container Runtime Version: cri-o://1.16.3-28.dev.rhaos4.3.git9aad8e4.el8 Kubelet Version: v1.16.2 Kube-Proxy Version: v1.16.2 ProviderID: aws:///eu-central-1a/i-0cf6f55a0f444e8d8 Non-terminated Pods: (32 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits --------- ---- ------------ ---------- --------------- ------------- openshift-apiserver apiserver-rpssd 150m (4%) 0 (0%) 200Mi (1%) 0 (0%) openshift-authentication oauth-openshift-84666f64fb-29xwt 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-cluster-node-tuning-operator tuned-bjrch 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-cluster-samples-operator cluster-samples-operator-854fdc79c4-897cp 20m (0%) 0 (0%) 0 (0%) 0 (0%) openshift-cluster-storage-operator cluster-storage-operator-568974dd9-sd476 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) openshift-console-operator console-operator-644498f9db-rmwzn 10m (0%) 0 (0%) 100Mi (0%) 0 (0%) openshift-console downloads-6f4898c5c9-9cpmr 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-controller-manager controller-manager-krddp 100m (2%) 0 (0%) 100Mi (0%) 0 (0%) openshift-dns dns-default-cbshv 110m (3%) 0 (0%) 70Mi (0%) 512Mi (3%) openshift-etcd etcd-member-ip-10-0-141-116.eu-central-1.compute.internal 300m (8%) 0 (0%) 600Mi (3%) 0 (0%) openshift-image-registry cluster-image-registry-operator-5c4dc465b-7fpqn 20m (0%) 0 (0%) 0 (0%) 0 (0%) openshift-image-registry node-ca-28rqb 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) openshift-ingress-operator ingress-operator-867b5447c6-ljfgz 20m (0%) 0 (0%) 40Mi (0%) 0 (0%) openshift-kube-apiserver kube-apiserver-ip-10-0-141-116.eu-central-1.compute.internal 170m (4%) 0 (0%) 1124Mi (7%) 0 (0%) openshift-kube-controller-manager kube-controller-manager-ip-10-0-141-116.eu-central-1.compute.internal 210m (6%) 0 (0%) 450Mi (2%) 0 (0%) openshift-kube-scheduler openshift-kube-scheduler-ip-10-0-141-116.eu-central-1.compute.internal 0 (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-machine-config-operator etcd-quorum-guard-58696fdc97-gcdt9 10m (0%) 0 (0%) 5Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-daemon-xrnmk 40m (1%) 0 (0%) 100Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-server-6d68g 20m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-monitoring cluster-monitoring-operator-65dc45d777-xgt5w 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-monitoring node-exporter-72wxp 112m (3%) 0 (0%) 200Mi (1%) 0 (0%) openshift-monitoring prometheus-operator-6bf6ddd5bb-cjw25 10m (0%) 0 (0%) 60Mi (0%) 0 (0%) openshift-multus multus-admission-controller-ct4m6 10m (0%) 0 (0%) 0 (0%) 0 (0%) openshift-multus multus-krg84 10m (0%) 0 (0%) 150Mi (0%) 0 (0%) openshift-operator-lifecycle-manager catalog-operator-7648d9cff4-dd4dp 10m (0%) 0 (0%) 80Mi (0%) 0 (0%) openshift-operator-lifecycle-manager olm-operator-7bc9747fc8-dzb4b 10m (0%) 0 (0%) 160Mi (1%) 0 (0%) openshift-operator-lifecycle-manager packageserver-d895bfdc7-xm5qp 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-sdn ovs-bnx9l 200m (5%) 0 (0%) 400Mi (2%) 0 (0%) openshift-sdn sdn-29bqf 100m (2%) 0 (0%) 200Mi (1%) 0 (0%) openshift-sdn sdn-controller-lq4lh 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-service-ca configmap-cabundle-injector-65cffb78f4-pmhtc 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-service-ca service-serving-cert-signer-5b7cdbf964-xbhjw 10m (0%) 0 (0%) 120Mi (0%) 0 (0%) Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 1742m (49%) 0 (0%) memory 4639Mi (30%) 512Mi (3%) attachable-volumes-aws-ebs 0 0 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal NodeReady 2h kubelet, ip-10-0-141-116.eu-central-1.compute.internal Node ip-10-0-141-116.eu-central-1.compute.internal status is now: NodeReady Name: ip-10-0-144-18.eu-central-1.compute.internal Roles: master Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/instance-type=m4.xlarge beta.kubernetes.io/os=linux failure-domain.beta.kubernetes.io/region=eu-central-1 failure-domain.beta.kubernetes.io/zone=eu-central-1b kubernetes.io/arch=amd64 kubernetes.io/hostname=ip-10-0-144-18 kubernetes.io/os=linux node-role.kubernetes.io/master= node.openshift.io/os_id=rhcos Annotations: machine.openshift.io/machine=openshift-machine-api/maas-a4835-z7t74-master-1 machineconfiguration.openshift.io/currentConfig=rendered-master-f6b4fc1e7026d40e2a26ca844904cba5 machineconfiguration.openshift.io/desiredConfig=rendered-master-f6b4fc1e7026d40e2a26ca844904cba5 machineconfiguration.openshift.io/reason= machineconfiguration.openshift.io/state=Done volumes.kubernetes.io/controller-managed-attach-detach=true CreationTimestamp: Thu, 26 Mar 2020 04:15:36 -0400 Taints: node-role.kubernetes.io/master:NoSchedule Unschedulable: false Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Thu, 26 Mar 2020 06:57:22 -0400 Thu, 26 Mar 2020 04:15:36 -0400 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Thu, 26 Mar 2020 06:57:22 -0400 Thu, 26 Mar 2020 04:15:36 -0400 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Thu, 26 Mar 2020 06:57:22 -0400 Thu, 26 Mar 2020 04:15:36 -0400 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Thu, 26 Mar 2020 06:57:22 -0400 Thu, 26 Mar 2020 04:20:06 -0400 KubeletReady kubelet is posting ready status Addresses: InternalIP: 10.0.144.18 Hostname: ip-10-0-144-18.eu-central-1.compute.internal InternalDNS: ip-10-0-144-18.eu-central-1.compute.internal Capacity: attachable-volumes-aws-ebs: 39 cpu: 4 ephemeral-storage: 125277164Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 16419384Ki pods: 250 Allocatable: attachable-volumes-aws-ebs: 39 cpu: 3500m ephemeral-storage: 115455434152 hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 15804984Ki pods: 250 System Info: Machine ID: 42432fcd1cf4453598a3bf00aebf64dd System UUID: ec2e3127-361c-9f6b-6824-a792f4fd1772 Boot ID: 3b732911-4226-4855-8c12-25f33f5f4102 Kernel Version: 4.18.0-147.5.1.el8_1.x86_64 OS Image: Red Hat Enterprise Linux CoreOS 43.81.202003191953.0 (Ootpa) Operating System: linux Architecture: amd64 Container Runtime Version: cri-o://1.16.3-28.dev.rhaos4.3.git9aad8e4.el8 Kubelet Version: v1.16.2 Kube-Proxy Version: v1.16.2 ProviderID: aws:///eu-central-1b/i-02a00ea2fee81a13c Non-terminated Pods: (29 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits --------- ---- ------------ ---------- --------------- ------------- openshift-apiserver apiserver-6824j 150m (4%) 0 (0%) 200Mi (1%) 0 (0%) openshift-authentication-operator authentication-operator-666c5cd958-dkgmv 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-cluster-node-tuning-operator cluster-node-tuning-operator-5cdbfd75b8-mx8xq 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) openshift-cluster-node-tuning-operator tuned-qwfwn 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-console console-85c95f6ff4-968bb 10m (0%) 0 (0%) 100Mi (0%) 0 (0%) openshift-console downloads-6f4898c5c9-xwgxr 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-controller-manager controller-manager-4xxhc 100m (2%) 0 (0%) 100Mi (0%) 0 (0%) openshift-dns dns-default-z5582 110m (3%) 0 (0%) 70Mi (0%) 512Mi (3%) openshift-etcd etcd-member-ip-10-0-144-18.eu-central-1.compute.internal 300m (8%) 0 (0%) 600Mi (3%) 0 (0%) openshift-image-registry node-ca-dwgw9 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) openshift-kube-apiserver kube-apiserver-ip-10-0-144-18.eu-central-1.compute.internal 170m (4%) 0 (0%) 1124Mi (7%) 0 (0%) openshift-kube-controller-manager kube-controller-manager-ip-10-0-144-18.eu-central-1.compute.internal 210m (6%) 0 (0%) 450Mi (2%) 0 (0%) openshift-kube-scheduler openshift-kube-scheduler-ip-10-0-144-18.eu-central-1.compute.internal 0 (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-machine-api cluster-autoscaler-operator-7cbc557bc-68fn9 20m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-machine-config-operator etcd-quorum-guard-58696fdc97-jtdnf 10m (0%) 0 (0%) 5Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-controller-d94f5445f-zmd6s 20m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-daemon-xbvdk 40m (1%) 0 (0%) 100Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-server-2r5wj 20m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-marketplace marketplace-operator-75f49679d7-vqkld 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-monitoring node-exporter-vldhn 112m (3%) 0 (0%) 200Mi (1%) 0 (0%) openshift-multus multus-admission-controller-lntkk 10m (0%) 0 (0%) 0 (0%) 0 (0%) openshift-multus multus-m2275 10m (0%) 0 (0%) 150Mi (0%) 0 (0%) openshift-operator-lifecycle-manager packageserver-d895bfdc7-wmhrs 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-sdn ovs-5q4nm 200m (5%) 0 (0%) 400Mi (2%) 0 (0%) openshift-sdn sdn-controller-5zhjs 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-sdn sdn-n54np 100m (2%) 0 (0%) 200Mi (1%) 0 (0%) openshift-service-ca apiservice-cabundle-injector-79c8b45d78-pjsrf 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-service-catalog-apiserver-operator openshift-service-catalog-apiserver-operator-68c966c5d-jpr7r 0 (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-service-catalog-controller-manager-operator openshift-service-catalog-controller-manager-operator-db956blzk 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 1692m (48%) 0 (0%) memory 4379Mi (28%) 512Mi (3%) attachable-volumes-aws-ebs 0 0 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal NodeReady 2h kubelet, ip-10-0-144-18.eu-central-1.compute.internal Node ip-10-0-144-18.eu-central-1.compute.internal status is now: NodeReady Name: ip-10-0-152-14.eu-central-1.compute.internal Roles: worker Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/instance-type=m4.xlarge beta.kubernetes.io/os=linux failure-domain.beta.kubernetes.io/region=eu-central-1 failure-domain.beta.kubernetes.io/zone=eu-central-1b kubernetes.io/arch=amd64 kubernetes.io/hostname=ip-10-0-152-14 kubernetes.io/os=linux node-role.kubernetes.io/worker= node.openshift.io/os_id=rhcos Annotations: machine.openshift.io/machine=openshift-machine-api/maas-a4835-z7t74-worker-eu-central-1b-glk8r machineconfiguration.openshift.io/currentConfig=rendered-worker-ac3513437ef2a02945c17c07ad193c94 machineconfiguration.openshift.io/desiredConfig=rendered-worker-ac3513437ef2a02945c17c07ad193c94 machineconfiguration.openshift.io/reason= machineconfiguration.openshift.io/state=Done volumes.kubernetes.io/controller-managed-attach-detach=true CreationTimestamp: Thu, 26 Mar 2020 04:25:29 -0400 Taints: Unschedulable: false Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Thu, 26 Mar 2020 06:57:56 -0400 Thu, 26 Mar 2020 04:25:29 -0400 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Thu, 26 Mar 2020 06:57:56 -0400 Thu, 26 Mar 2020 04:25:29 -0400 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Thu, 26 Mar 2020 06:57:56 -0400 Thu, 26 Mar 2020 04:25:29 -0400 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Thu, 26 Mar 2020 06:57:56 -0400 Thu, 26 Mar 2020 04:26:40 -0400 KubeletReady kubelet is posting ready status Addresses: InternalIP: 10.0.152.14 Hostname: ip-10-0-152-14.eu-central-1.compute.internal InternalDNS: ip-10-0-152-14.eu-central-1.compute.internal Capacity: attachable-volumes-aws-ebs: 39 cpu: 4 ephemeral-storage: 125277164Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 16419384Ki pods: 250 Allocatable: attachable-volumes-aws-ebs: 39 cpu: 3500m ephemeral-storage: 115455434152 hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 15804984Ki pods: 250 System Info: Machine ID: 055d318f9e8f4f96aa28237c4949465e System UUID: ec2dca5e-7175-4d86-4501-41a0d66a2d2d Boot ID: cee7c9bf-6270-4fa3-8b36-b8aceac66586 Kernel Version: 4.18.0-147.5.1.el8_1.x86_64 OS Image: Red Hat Enterprise Linux CoreOS 43.81.202003191953.0 (Ootpa) Operating System: linux Architecture: amd64 Container Runtime Version: cri-o://1.16.3-28.dev.rhaos4.3.git9aad8e4.el8 Kubelet Version: v1.16.2 Kube-Proxy Version: v1.16.2 ProviderID: aws:///eu-central-1b/i-0a5f05f1dc107dd0b Non-terminated Pods: (16 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits --------- ---- ------------ ---------- --------------- ------------- openshift-cluster-node-tuning-operator tuned-flkjf 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-dns dns-default-qgdvz 110m (3%) 0 (0%) 70Mi (0%) 512Mi (3%) openshift-image-registry node-ca-c4px4 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-daemon-5pn45 40m (1%) 0 (0%) 100Mi (0%) 0 (0%) openshift-monitoring alertmanager-main-2 110m (3%) 100m (2%) 245Mi (1%) 25Mi (0%) openshift-monitoring grafana-75899bb875-spw78 110m (3%) 0 (0%) 120Mi (0%) 0 (0%) openshift-monitoring node-exporter-xhz8j 112m (3%) 0 (0%) 200Mi (1%) 0 (0%) openshift-monitoring prometheus-adapter-79ccd78d7-znnfj 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) openshift-monitoring telemeter-client-5db9b5787-qkg7g 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) openshift-monitoring thanos-querier-6458c8d5c9-n6mqb 40m (1%) 0 (0%) 72Mi (0%) 0 (0%) openshift-multus multus-9dplw 10m (0%) 0 (0%) 150Mi (0%) 0 (0%) openshift-operators address-space-controller-555b89686c-s4q5p 0 (0%) 0 (0%) 512Mi (3%) 512Mi (3%) openshift-operators enmasse-operator-86f58c789-n4vlx 0 (0%) 0 (0%) 0 (0%) 0 (0%) openshift-operators enmasse-source-mdxqb 10m (0%) 100m (2%) 50Mi (0%) 100Mi (0%) openshift-sdn ovs-vvzbw 200m (5%) 0 (0%) 400Mi (2%) 0 (0%) openshift-sdn sdn-rqms7 100m (2%) 0 (0%) 200Mi (1%) 0 (0%) Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 882m (25%) 200m (5%) memory 2219Mi (14%) 1149Mi (7%) attachable-volumes-aws-ebs 0 0 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal NodeHasSufficientMemory 2h (x8 over 2h) kubelet, ip-10-0-152-14.eu-central-1.compute.internal Node ip-10-0-152-14.eu-central-1.compute.internal status is now: NodeHasSufficientMemory Normal NodeHasNoDiskPressure 2h (x8 over 2h) kubelet, ip-10-0-152-14.eu-central-1.compute.internal Node ip-10-0-152-14.eu-central-1.compute.internal status is now: NodeHasNoDiskPressure Name: ip-10-0-164-206.eu-central-1.compute.internal Roles: master Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/instance-type=m4.xlarge beta.kubernetes.io/os=linux failure-domain.beta.kubernetes.io/region=eu-central-1 failure-domain.beta.kubernetes.io/zone=eu-central-1c kubernetes.io/arch=amd64 kubernetes.io/hostname=ip-10-0-164-206 kubernetes.io/os=linux node-role.kubernetes.io/master= node.openshift.io/os_id=rhcos Annotations: machine.openshift.io/machine=openshift-machine-api/maas-a4835-z7t74-master-2 machineconfiguration.openshift.io/currentConfig=rendered-master-f6b4fc1e7026d40e2a26ca844904cba5 machineconfiguration.openshift.io/desiredConfig=rendered-master-f6b4fc1e7026d40e2a26ca844904cba5 machineconfiguration.openshift.io/reason= machineconfiguration.openshift.io/state=Done volumes.kubernetes.io/controller-managed-attach-detach=true CreationTimestamp: Thu, 26 Mar 2020 04:15:29 -0400 Taints: node-role.kubernetes.io/master:NoSchedule Unschedulable: false Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Thu, 26 Mar 2020 06:57:35 -0400 Thu, 26 Mar 2020 04:15:29 -0400 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Thu, 26 Mar 2020 06:57:35 -0400 Thu, 26 Mar 2020 04:15:29 -0400 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Thu, 26 Mar 2020 06:57:35 -0400 Thu, 26 Mar 2020 04:15:29 -0400 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Thu, 26 Mar 2020 06:57:35 -0400 Thu, 26 Mar 2020 04:19:49 -0400 KubeletReady kubelet is posting ready status Addresses: InternalIP: 10.0.164.206 Hostname: ip-10-0-164-206.eu-central-1.compute.internal InternalDNS: ip-10-0-164-206.eu-central-1.compute.internal Capacity: attachable-volumes-aws-ebs: 39 cpu: 4 ephemeral-storage: 125277164Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 16419384Ki pods: 250 Allocatable: attachable-volumes-aws-ebs: 39 cpu: 3500m ephemeral-storage: 115455434152 hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 15804984Ki pods: 250 System Info: Machine ID: 18e82a2e42764183a533dc79824c7c1c System UUID: ec24374f-be84-3fba-3e01-7ca0f07b70f9 Boot ID: b1184415-6182-4cab-b4f2-a6d8e86837b4 Kernel Version: 4.18.0-147.5.1.el8_1.x86_64 OS Image: Red Hat Enterprise Linux CoreOS 43.81.202003191953.0 (Ootpa) Operating System: linux Architecture: amd64 Container Runtime Version: cri-o://1.16.3-28.dev.rhaos4.3.git9aad8e4.el8 Kubelet Version: v1.16.2 Kube-Proxy Version: v1.16.2 ProviderID: aws:///eu-central-1c/i-0c5d1ec1026c18349 Non-terminated Pods: (35 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits --------- ---- ------------ ---------- --------------- ------------- openshift-apiserver-operator openshift-apiserver-operator-747d99b97-tqnvs 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-apiserver apiserver-gq8x4 150m (4%) 0 (0%) 200Mi (1%) 0 (0%) openshift-authentication oauth-openshift-84666f64fb-fw8h5 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-cloud-credential-operator cloud-credential-operator-7d86577b8d-74r7v 10m (0%) 0 (0%) 150Mi (0%) 0 (0%) openshift-cluster-machine-approver machine-approver-88bbf5df7-lmx2b 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-cluster-node-tuning-operator tuned-sbrmj 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-cluster-version cluster-version-operator-bcffdff5c-jk9bc 20m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-console console-85c95f6ff4-6v2qt 10m (0%) 0 (0%) 100Mi (0%) 0 (0%) openshift-controller-manager-operator openshift-controller-manager-operator-6cfc9cd9d7-qvpmv 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-controller-manager controller-manager-z6pbb 100m (2%) 0 (0%) 100Mi (0%) 0 (0%) openshift-dns-operator dns-operator-74f8b5dcc7-xf8qq 20m (0%) 0 (0%) 40Mi (0%) 0 (0%) openshift-dns dns-default-h2dt8 110m (3%) 0 (0%) 70Mi (0%) 512Mi (3%) openshift-etcd etcd-member-ip-10-0-164-206.eu-central-1.compute.internal 300m (8%) 0 (0%) 600Mi (3%) 0 (0%) openshift-image-registry node-ca-8w2xc 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) openshift-insights insights-operator-79d4c8bdb5-gm6zv 10m (0%) 0 (0%) 30Mi (0%) 0 (0%) openshift-kube-apiserver-operator kube-apiserver-operator-6558cd776f-d6qlh 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-kube-apiserver kube-apiserver-ip-10-0-164-206.eu-central-1.compute.internal 170m (4%) 0 (0%) 1124Mi (7%) 0 (0%) openshift-kube-controller-manager-operator kube-controller-manager-operator-d68c96b8f-hh59n 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-kube-controller-manager kube-controller-manager-ip-10-0-164-206.eu-central-1.compute.internal 210m (6%) 0 (0%) 450Mi (2%) 0 (0%) openshift-kube-scheduler-operator openshift-kube-scheduler-operator-b77db8f5c-hvdfg 0 (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-kube-scheduler openshift-kube-scheduler-ip-10-0-164-206.eu-central-1.compute.internal 0 (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-machine-api machine-api-controllers-585df67897-q4sp7 30m (0%) 0 (0%) 60Mi (0%) 0 (0%) openshift-machine-api machine-api-operator-855786657-nwhw5 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-machine-config-operator etcd-quorum-guard-58696fdc97-7skqr 10m (0%) 0 (0%) 5Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-daemon-6hc4r 40m (1%) 0 (0%) 100Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-operator-68bd4cb954-4km4s 20m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-machine-config-operator machine-config-server-rtkc6 20m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-monitoring node-exporter-xvkmp 112m (3%) 0 (0%) 200Mi (1%) 0 (0%) openshift-multus multus-2skvb 10m (0%) 0 (0%) 150Mi (0%) 0 (0%) openshift-multus multus-admission-controller-9mwb8 10m (0%) 0 (0%) 0 (0%) 0 (0%) openshift-network-operator network-operator-6bf6c87974-m7tw4 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-sdn ovs-p9nkj 200m (5%) 0 (0%) 400Mi (2%) 0 (0%) openshift-sdn sdn-controller-b7r9x 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-sdn sdn-t56zq 100m (2%) 0 (0%) 200Mi (1%) 0 (0%) openshift-service-ca-operator service-ca-operator-66989dccd9-skgnd 10m (0%) 0 (0%) 80Mi (0%) 0 (0%) Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 1782m (50%) 0 (0%) memory 4819Mi (31%) 512Mi (3%) attachable-volumes-aws-ebs 0 0 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal NodeReady 2h kubelet, ip-10-0-164-206.eu-central-1.compute.internal Node ip-10-0-164-206.eu-central-1.compute.internal status is now: NodeReady Name: ip-10-0-168-36.eu-central-1.compute.internal Roles: worker Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/instance-type=m4.xlarge beta.kubernetes.io/os=linux failure-domain.beta.kubernetes.io/region=eu-central-1 failure-domain.beta.kubernetes.io/zone=eu-central-1c kubernetes.io/arch=amd64 kubernetes.io/hostname=ip-10-0-168-36 kubernetes.io/os=linux node-role.kubernetes.io/worker= node.openshift.io/os_id=rhcos Annotations: machine.openshift.io/machine=openshift-machine-api/maas-a4835-z7t74-worker-eu-central-1c-mlk9z machineconfiguration.openshift.io/currentConfig=rendered-worker-ac3513437ef2a02945c17c07ad193c94 machineconfiguration.openshift.io/desiredConfig=rendered-worker-ac3513437ef2a02945c17c07ad193c94 machineconfiguration.openshift.io/reason= machineconfiguration.openshift.io/state=Done volumes.kubernetes.io/controller-managed-attach-detach=true CreationTimestamp: Thu, 26 Mar 2020 04:25:13 -0400 Taints: Unschedulable: false Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Thu, 26 Mar 2020 06:57:39 -0400 Thu, 26 Mar 2020 04:25:13 -0400 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Thu, 26 Mar 2020 06:57:39 -0400 Thu, 26 Mar 2020 04:25:13 -0400 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Thu, 26 Mar 2020 06:57:39 -0400 Thu, 26 Mar 2020 04:25:13 -0400 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Thu, 26 Mar 2020 06:57:39 -0400 Thu, 26 Mar 2020 04:26:14 -0400 KubeletReady kubelet is posting ready status Addresses: InternalIP: 10.0.168.36 Hostname: ip-10-0-168-36.eu-central-1.compute.internal InternalDNS: ip-10-0-168-36.eu-central-1.compute.internal Capacity: attachable-volumes-aws-ebs: 39 cpu: 4 ephemeral-storage: 125277164Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 16419384Ki pods: 250 Allocatable: attachable-volumes-aws-ebs: 39 cpu: 3500m ephemeral-storage: 115455434152 hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 15804984Ki pods: 250 System Info: Machine ID: 3242aa8ede4b4ffda5a5466770b7f85e System UUID: ec26f32c-095a-f1f8-87d8-3867b1b4f129 Boot ID: 6151d7a8-fff7-4c4f-a2ad-2bdb56370bff Kernel Version: 4.18.0-147.5.1.el8_1.x86_64 OS Image: Red Hat Enterprise Linux CoreOS 43.81.202003191953.0 (Ootpa) Operating System: linux Architecture: amd64 Container Runtime Version: cri-o://1.16.3-28.dev.rhaos4.3.git9aad8e4.el8 Kubelet Version: v1.16.2 Kube-Proxy Version: v1.16.2 ProviderID: aws:///eu-central-1c/i-009c71fd16255cf1e Non-terminated Pods: (13 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits --------- ---- ------------ ---------- --------------- ------------- openshift-cluster-node-tuning-operator tuned-trqjc 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) openshift-dns dns-default-gncgt 110m (3%) 0 (0%) 70Mi (0%) 512Mi (3%) openshift-image-registry image-registry-b898776b9-9bdrs 100m (2%) 0 (0%) 256Mi (1%) 0 (0%) openshift-image-registry node-ca-b7pv7 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) openshift-ingress router-default-7468dc4d99-6swjv 100m (2%) 0 (0%) 256Mi (1%) 0 (0%) openshift-machine-config-operator machine-config-daemon-4fvsf 40m (1%) 0 (0%) 100Mi (0%) 0 (0%) openshift-monitoring alertmanager-main-1 110m (3%) 100m (2%) 245Mi (1%) 25Mi (0%) openshift-monitoring node-exporter-4jbjv 112m (3%) 0 (0%) 200Mi (1%) 0 (0%) openshift-monitoring openshift-state-metrics-7fbdf5c5fc-rdtbt 120m (3%) 0 (0%) 190Mi (1%) 0 (0%) openshift-monitoring prometheus-k8s-1 480m (13%) 200m (5%) 1234Mi (7%) 50Mi (0%) openshift-multus multus-8xdkw 10m (0%) 0 (0%) 150Mi (0%) 0 (0%) openshift-sdn ovs-7v4z4 200m (5%) 0 (0%) 400Mi (2%) 0 (0%) openshift-sdn sdn-f5p5w 100m (2%) 0 (0%) 200Mi (1%) 0 (0%) Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 1502m (42%) 300m (8%) memory 3361Mi (21%) 587Mi (3%) attachable-volumes-aws-ebs 0 0 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal NodeHasSufficientMemory 2h (x8 over 2h) kubelet, ip-10-0-168-36.eu-central-1.compute.internal Node ip-10-0-168-36.eu-central-1.compute.internal status is now: NodeHasSufficientMemory Normal NodeHasNoDiskPressure 2h (x8 over 2h) kubelet, ip-10-0-168-36.eu-central-1.compute.internal Node ip-10-0-168-36.eu-central-1.compute.internal status is now: NodeHasNoDiskPressure