$ ./get_mcp_logs.sh zeus08.lab.eng.tlv2.redhat.com I0823 15:31:32.852111 4377 start.go:108] Version: v4.10.0-202207291908.p0.gdc29945.assembly.stream-dirty (dc29945da95a65f460ad50ad1bbc10e1918a9c61) I0823 15:31:32.907666 4377 start.go:121] Calling chroot("/rootfs") I0823 15:31:32.910188 4377 update.go:1941] Running: systemctl start rpm-ostreed I0823 15:31:33.628296 4377 rpm-ostree.go:325] Running captured: rpm-ostree status --json I0823 15:31:33.738600 4377 rpm-ostree.go:325] Running captured: rpm-ostree status --json I0823 15:31:33.809209 4377 daemon.go:223] Booted osImageURL: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:23d0609643c25efcd30a7a64483fdee2343ced26b1fd08c0cbf8d03a5d405939 (410.84.202208030316-0) I0823 15:31:33.929895 4377 start.go:97] Copied self to /run/bin/machine-config-daemon on host I0823 15:31:33.931573 4377 metrics.go:106] Registering Prometheus metrics I0823 15:31:33.931880 4377 metrics.go:111] Starting metrics listener on 127.0.0.1:8797 I0823 15:31:33.932584 4377 update.go:1956] Starting to manage node: zeus08.lab.eng.tlv2.redhat.com I0823 15:31:33.940007 4377 rpm-ostree.go:325] Running captured: rpm-ostree status I0823 15:31:34.483571 4377 daemon.go:957] State: idle Deployments: * pivot://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:23d0609643c25efcd30a7a64483fdee2343ced26b1fd08c0cbf8d03a5d405939 CustomOrigin: Managed by machine-config-operator Version: 410.84.202208030316-0 (2022-08-03T03:19:21Z) RemovedBasePackages: kernel-core kernel-modules kernel kernel-modules-extra 4.18.0-305.57.1.el8_4 LayeredPackages: kernel-rt-core kernel-rt-kvm kernel-rt-modules kernel-rt-modules-extra pivot://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:23d0609643c25efcd30a7a64483fdee2343ced26b1fd08c0cbf8d03a5d405939 CustomOrigin: Managed by machine-config-operator Version: 410.84.202208030316-0 (2022-08-03T03:19:21Z) RemovedBasePackages: kernel-core kernel-modules kernel kernel-modules-extra 4.18.0-305.57.1.el8_4 LayeredPackages: kernel-rt-core kernel-rt-kvm kernel-rt-modules kernel-rt-modules-extra I0823 15:31:34.483599 4377 rpm-ostree.go:325] Running captured: journalctl --list-boots I0823 15:31:35.646748 4377 daemon.go:964] journalctl --list-boots: -22 1c926d5281a946d9bfb7ebd1469854c1 Thu 2022-08-18 00:46:50 UTC—Sun 2022-08-21 21:10:19 UTC -21 cae3238d4bf846db893643c167bf58ff Sun 2022-08-21 21:13:50 UTC—Sun 2022-08-21 21:47:05 UTC -20 6433a575e5db4e80a8aadc29570b9773 Sun 2022-08-21 21:49:38 UTC—Mon 2022-08-22 19:35:23 UTC -19 0d5e6a724d8542949b16d60ba829f4d2 Mon 2022-08-22 19:45:09 UTC—Mon 2022-08-22 19:48:55 UTC -18 6f59f5f1418b465d813e1f606075f009 Mon 2022-08-22 19:51:30 UTC—Mon 2022-08-22 21:34:16 UTC -17 5024f03a507441a698c5e1935985bcc0 Mon 2022-08-22 21:36:48 UTC—Mon 2022-08-22 22:11:29 UTC -16 1ee6a85542414892884cf8ad6e333a68 Mon 2022-08-22 22:14:01 UTC—Mon 2022-08-22 22:31:33 UTC -15 b70a2889d0bf4adb994e6002c36dad87 Mon 2022-08-22 22:34:08 UTC—Tue 2022-08-23 02:29:12 UTC -14 e7b550b07a014721bb94fff42a7c09e9 Tue 2022-08-23 02:31:43 UTC—Tue 2022-08-23 02:36:38 UTC -13 5420f95df3314601b2a894f00fb07302 Tue 2022-08-23 02:38:50 UTC—Tue 2022-08-23 04:36:47 UTC -12 11de41122ec043498dbd25456bcf6d9b Tue 2022-08-23 04:39:21 UTC—Tue 2022-08-23 05:04:20 UTC -11 b13d3785f4574bffb17f747ec745aee3 Tue 2022-08-23 05:06:51 UTC—Tue 2022-08-23 05:40:42 UTC -10 ba78033e6b984334acef9c260ab83d53 Tue 2022-08-23 05:43:16 UTC—Tue 2022-08-23 06:04:54 UTC -9 9db835e226384d9c884bbdc833df0844 Tue 2022-08-23 06:07:29 UTC—Tue 2022-08-23 08:22:49 UTC -8 7c8e6fa34956409084f4b8b9d32128e8 Tue 2022-08-23 08:25:19 UTC—Tue 2022-08-23 09:33:00 UTC -7 6817e13b2be447c8bd7501d6b2d20f13 Tue 2022-08-23 09:35:32 UTC—Tue 2022-08-23 09:40:23 UTC -6 69da5d15a33e4922882300c3ed24de23 Tue 2022-08-23 09:42:57 UTC—Tue 2022-08-23 10:14:01 UTC -5 f3238ce8e15d4dd68a9c986203467bf6 Tue 2022-08-23 10:16:36 UTC—Tue 2022-08-23 14:04:23 UTC -4 800108834d1c4f21a10131b33ba66890 Tue 2022-08-23 14:06:56 UTC—Tue 2022-08-23 14:21:12 UTC -3 8132bf7607844fd3ad95af463764c188 Tue 2022-08-23 14:23:48 UTC—Tue 2022-08-23 14:51:43 UTC -2 a55f9fb3c64d4cc3b8d745f4845cd584 Tue 2022-08-23 14:54:15 UTC—Tue 2022-08-23 15:20:11 UTC -1 8d0c3cbd114345379414fe93a1d2d46c Tue 2022-08-23 15:22:42 UTC—Tue 2022-08-23 15:27:40 UTC 0 fcc0f48d81ee411bbe56acc942c3fbcb Tue 2022-08-23 15:29:52 UTC—Tue 2022-08-23 15:31:35 UTC I0823 15:31:35.646779 4377 rpm-ostree.go:325] Running captured: systemctl list-units --state=failed --no-legend I0823 15:31:35.657778 4377 daemon.go:977] systemctl --failed: NetworkManager-wait-online.service loaded failed failed Network Manager Wait Online I0823 15:31:35.657797 4377 daemon.go:647] Starting MachineConfigDaemon I0823 15:31:35.657940 4377 daemon.go:654] Enabling Kubelet Healthz Monitor W0823 15:31:37.676070 4377 reflector.go:324] github.com/openshift/machine-config-operator/pkg/generated/informers/externalversions/factory.go:101: failed to list *v1.MachineConfig: Get "https://172.30.0.1:443/apis/machineconfiguration.openshift.io/v1/machineconfigs?limit=500&resourceVersion=0": dial tcp 172.30.0.1:443: connect: no route to host E0823 15:31:37.676221 4377 reflector.go:138] github.com/openshift/machine-config-operator/pkg/generated/informers/externalversions/factory.go:101: Failed to watch *v1.MachineConfig: failed to list *v1.MachineConfig: Get "https://172.30.0.1:443/apis/machineconfiguration.openshift.io/v1/machineconfigs?limit=500&resourceVersion=0": dial tcp 172.30.0.1:443: connect: no route to host W0823 15:31:37.676390 4377 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: Get "https://172.30.0.1:443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 172.30.0.1:443: connect: no route to host E0823 15:31:37.676491 4377 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://172.30.0.1:443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 172.30.0.1:443: connect: no route to host I0823 15:31:42.359124 4377 daemon.go:394] Node zeus08.lab.eng.tlv2.redhat.com is not labeled node-role.kubernetes.io/master I0823 15:31:43.242573 4377 daemon.go:910] Current config: rendered-worker-rt-26047d6290080d191079e2c78bcc0dc1 I0823 15:31:43.242604 4377 daemon.go:911] Desired config: rendered-worker-rt-a87c657bd02350205512be3e1cede644 I0823 15:31:43.258960 4377 update.go:1956] Disk currentConfig rendered-worker-rt-a87c657bd02350205512be3e1cede644 overrides node's currentConfig annotation rendered-worker-rt-26047d6290080d191079e2c78bcc0dc1 I0823 15:31:43.263886 4377 daemon.go:1193] Validating against pending config rendered-worker-rt-a87c657bd02350205512be3e1cede644 I0823 15:31:43.290558 4377 daemon.go:1211] Validated on-disk state I0823 15:31:43.350911 4377 daemon.go:1262] Completing pending config rendered-worker-rt-a87c657bd02350205512be3e1cede644 I0823 15:31:43.350929 4377 drain.go:44] Initiating uncordon on node (currently schedulable: false) I0823 15:31:43.411063 4377 drain.go:62] RunCordonOrUncordon() succeeded but node is still not in uncordon state, retrying I0823 15:31:53.412266 4377 drain.go:44] Initiating uncordon on node (currently schedulable: true) I0823 15:31:53.412298 4377 drain.go:66] uncordon succeeded on node (currently schedulable: true) I0823 15:31:53.412308 4377 update.go:1956] Update completed for config rendered-worker-rt-a87c657bd02350205512be3e1cede644 and node has been successfully uncordoned I0823 15:31:53.416921 4377 daemon.go:1278] In desired config rendered-worker-rt-a87c657bd02350205512be3e1cede644 I0823 15:31:53.436429 4377 config_drift_monitor.go:240] Config Drift Monitor started I0823 15:51:24.552510 4377 daemon.go:510] Preflight config drift check successful (took 23.447387ms) I0823 15:51:24.556637 4377 config_drift_monitor.go:249] Config Drift Monitor has shut down I0823 15:51:24.686619 4377 update.go:1978] Adding SIGTERM protection I0823 15:51:24.722823 4377 update.go:512] Checking Reconcilable for config rendered-worker-rt-a87c657bd02350205512be3e1cede644 to rendered-worker-rt-26047d6290080d191079e2c78bcc0dc1 I0823 15:51:24.802125 4377 update.go:1956] Starting update from rendered-worker-rt-a87c657bd02350205512be3e1cede644 to rendered-worker-rt-26047d6290080d191079e2c78bcc0dc1: &{osUpdate:false kargs:true fips:false passwd:false files:false units:false kernelType:false extensions:false} I0823 15:51:24.807678 4377 drain.go:44] Initiating cordon on node (currently schedulable: true) I0823 15:51:24.860785 4377 drain.go:62] RunCordonOrUncordon() succeeded but node is still not in cordon state, retrying I0823 15:51:34.861231 4377 drain.go:44] Initiating cordon on node (currently schedulable: false) I0823 15:51:34.861273 4377 drain.go:66] cordon succeeded on node (currently schedulable: false) I0823 15:51:34.861298 4377 update.go:1956] Node has been successfully cordoned I0823 15:51:34.865654 4377 update.go:1956] Update prepared; beginning drain