The operator crashed during an upgrade from version 10.19.0-c6693cf to 10.19.1-8247257

    10.19.1-8247257

    100%

    1. Create on AWS (not mandatory) 2 machineset nodes  with 10.19.0-c6693cf     
    2. upgrade the operator (seamless upgrade) to 10.19.1-8247257
    with the following steps: 
Create new Catalogsource wmco-upgrade with the image of 10.19.1-8247257
Delete IDMS
Create IDMS with 4.19 
Delete CSV 
Delete operatorgroup
Delete Subscription
Create operatorgroup
Create Subscription with wmco-upgrade catalogsource
   3. wait for the upgrade to be completed 
    

    The operator is crashing and restarted due to error: "Unable to retrieve private key, please ensure it is created","error":"the cache is not started, can not read objects

    The operator not to crash

wmco output from the crash event    
oc logs deployment/windows-machine-config-operator -n openshift-windows-machine-config-operator -f
{"level":"info","ts":"2025-09-08T15:34:41Z","logger":"version","msg":"operator","version":"10.19.1-8247257"}
{"level":"info","ts":"2025-09-08T15:34:41Z","logger":"version","msg":"go","version":"go1.23.9 (Red Hat 1.23.9-1.el9_6) X:strictfipsruntime linux/amd64"}
{"level":"info","ts":"2025-09-08T15:34:41Z","logger":"setup","msg":"platform","type":"AWS"}
{"level":"info","ts":"2025-09-08T15:34:41Z","logger":"leader","msg":"Trying to become the leader."}
{"level":"info","ts":"2025-09-08T15:34:41Z","logger":"leader","msg":"No pre-existing lock was found."}
{"level":"info","ts":"2025-09-08T15:34:41Z","logger":"leader","msg":"Became the leader."}
{"level":"info","ts":"2025-09-08T15:34:41Z","logger":"setup","msg":"operator","namespace":"openshift-windows-machine-config-operator"}
{"level":"error","ts":"2025-09-08T15:34:41Z","logger":"controllers.secret","msg":"Unable to retrieve private key, please ensure it is created","error":"the cache is not started, can not read objects","stacktrace":"github.com/openshift/windows-machine-config-operator/controllers.(*SecretReconciler).SetupWithManager\n\t/build/windows-machine-config-operator/controllers/secret_controller.go:72\nmain.main\n\t/build/windows-machine-config-operator/cmd/operator/main.go:231\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:272"}
{"level":"info","ts":"2025-09-08T15:34:42Z","logger":"controllers.configmap","msg":"Created","ConfigMap":{"name":"windows-services-10.19.1-8247257","namespace":"openshift-windows-machine-config-operator"}}
{"level":"info","ts":"2025-09-08T15:34:42Z","logger":"setup","msg":"starting manager"}
{"level":"info","ts":"2025-09-08T15:34:42Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","source":"kind source: *v1.Node"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","source":"kind source: *v1.Secret"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","source":"kind source: *v1beta1.Machine"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"node","controllerGroup":"","controllerKind":"Node","source":"kind source: *v1.Node"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.MachineConfig"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","source":"kind source: *v1.ImageDigestMirrorSet"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"secret","controllerGroup":"","controllerKind":"Secret","source":"kind source: *v1.Secret"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","source":"kind source: *v1.ImageTagMirrorSet"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig","source":"kind source: *v1.ControllerConfig"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.ConfigMap"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.Node"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.Node"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"secret","controllerGroup":"","controllerKind":"Secret","source":"kind source: *v1.Secret"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest","source":"kind source: *v1.CertificateSigningRequest"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"namespace","controllerGroup":"","controllerKind":"Namespace","source":"kind source: *v1.ServiceMonitor"}
{"level":"info","ts":"2025-09-08T15:34:43Z","msg":"Starting EventSource","controller":"namespace","controllerGroup":"","controllerKind":"Namespace","source":"kind source: *v1.Namespace"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"secret","controllerGroup":"","controllerKind":"Secret"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"secret","controllerGroup":"","controllerKind":"Secret","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"namespace","controllerGroup":"","controllerKind":"Namespace"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"namespace","controllerGroup":"","controllerKind":"Namespace","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"node","controllerGroup":"","controllerKind":"Node"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"node","controllerGroup":"","controllerKind":"Node","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting Controller","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"}
{"level":"info","ts":"2025-09-08T15:34:45Z","msg":"Starting workers","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","worker count":1}
{"level":"info","ts":"2025-09-08T15:34:45Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:9182","secure":true}
{"level":"info","ts":"2025-09-08T15:34:50Z","logger":"controllers.controllerconfig","msg":"updating kubelet CA client certificates in","node":"ip-10-0-11-68.us-east-2.compute.internal"}
{"level":"info","ts":"2025-09-08T15:34:51Z","logger":"controllers.registry","msg":"updating containerd config","registry":{"name":""},"directory":"C:\\k\\containerd\\registries","node":"ip-10-0-11-68.us-east-2.compute.internal"}
{"level":"info","ts":"2025-09-08T15:34:56Z","logger":"controllers.registry","msg":"updating containerd config","registry":{"name":""},"directory":"C:\\k\\containerd\\registries","node":"ip-10-0-26-160.us-east-2.compute.internal"}
{"level":"info","ts":"2025-09-08T15:34:57Z","logger":"controllers.controllerconfig","msg":"updating kubelet CA client certificates in","node":"ip-10-0-26-160.us-east-2.compute.internal"}
{"level":"info","ts":"2025-09-08T15:35:00Z","logger":"controllers.registry","msg":"updating containerd config","registry":{"name":""},"registry":{"name":"stage-repo"},"directory":"C:\\k\\containerd\\registries","node":"ip-10-0-26-160.us-east-2.compute.internal"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"788a68d1-791d-4770-ba15-9324945b934c","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"c2637bdd-6f2a-4e60-966d-35e31877dddd","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"7474ea4e-5cb9-4f84-a858-eb572e78c23b","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"fb0b5d35-9b5c-471b-9213-54ca589b4fe9","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"e87f49bc-96e3-4289-b2da-6d626502bf17","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"7bcf83a2-0f8a-4dea-9eff-8f32fc16a4cd","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"31a0ba9c-aae9-4e53-abad-83d99451fe43","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"bb51f12f-e60a-4cea-94a5-3037919611d2","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"a6197472-d111-4597-998e-098f9daf1861","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"699f371e-aad1-4d24-ba4c-d4cd625fa58e","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"7f9e3820-3996-403d-a8c8-8144e5a5ad63","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"e7efe2a7-1860-477b-bc63-290957b6e5ba","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"a1dc8d86-506e-429f-8f2d-c1b9f6e9a685","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:00Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"ff0325f6-d536-4a98-a925-12fc56fa091d","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:01Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"bfc7a728-eea5-4981-9fba-968c0b2aa812","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:01Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"2ddf1bce-2dd2-457c-a1d4-f3b805be89a3","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:01Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"93538de1-c0e0-450e-852b-58f77fc97ea4","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:02Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"949a7738-1be4-4621-82e1-34d67a4ae132","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:03Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"fcfe0766-e261-4356-9960-6e56bdaca60f","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:03Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"814a9f1e-efe6-4f1e-84a1-7c0b91048298","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:05Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","reconcileID":"6d0c65a6-2418-433a-ac53-32e685e2a224","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"error","ts":"2025-09-08T15:35:05Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"eb879387-818a-4d5c-9390-06e52a825da3","error":"error validating userData secret: invalid content for userData secret","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"info","ts":"2025-09-08T15:35:06Z","logger":"controllers.registry","msg":"updating containerd config","registry":{"name":""},"registry":{"name":"stage-repo"},"directory":"C:\\k\\containerd\\registries","node":"ip-10-0-11-68.us-east-2.compute.internal"}
{"level":"info","ts":"2025-09-08T15:35:09Z","logger":"controllers.secret","msg":"updating secret","secret":{"name":"windows-machine-config-operator-tls","namespace":"openshift-windows-machine-config-operator"},"secret":{"name":"cloud-private-key","namespace":"openshift-windows-machine-config-operator"},"name":"windows-user-data"}
{"level":"info","ts":"2025-09-08T15:35:09Z","logger":"controller.windowsmachine","msg":"deleting machine","windowsmachine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64","namespace":"openshift-machine-api"}}
{"level":"info","ts":"2025-09-08T15:35:09Z","logger":"controller.windowsmachine","msg":"unhealthy machine count for machineset","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a","total":2,"unhealthy":0}
{"level":"info","ts":"2025-09-08T15:35:09Z","logger":"controller.windowsmachine","msg":"machine has been remediated by deletion","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-xgp64"}
{"level":"info","ts":"2025-09-08T15:36:09Z","logger":"controller.windowsmachine","msg":"deleting machine","windowsmachine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"}}
{"level":"info","ts":"2025-09-08T15:36:09Z","logger":"controller.windowsmachine","msg":"unhealthy machine count for machineset","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a","total":2,"unhealthy":1}
{"level":"info","ts":"2025-09-08T15:36:09Z","logger":"controller.windowsmachine","msg":"machine deletion restricted","windowsmachine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"maxUnhealthyCount":1}
{"level":"info","ts":"2025-09-08T15:36:09Z","logger":"controller.windowsmachine","msg":"processing","windowsmachine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-8c4mv","namespace":"openshift-machine-api"},"address":"10.0.1.43"}
{"level":"info","ts":"2025-09-08T15:39:29Z","logger":"wc 10.0.1.43","msg":"configuring"}
{"level":"info","ts":"2025-09-08T15:40:25Z","logger":"wc 10.0.1.43","msg":"rebooting instance"}
{"level":"info","ts":"2025-09-08T15:40:47Z","logger":"wc 10.0.1.43","msg":"transferring files"}
{"level":"info","ts":"2025-09-08T15:41:35Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-pns6k"}
{"level":"info","ts":"2025-09-08T15:41:38Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-46wdw"}
{"level":"info","ts":"2025-09-08T15:41:43Z","logger":"wc 10.0.1.43","msg":"configured","service":"windows-instance-config-daemon","args":"controller --windows-service --log-dir C:\\var\\log\\wicd --kubeconfig C:\\k\\wicd-kubeconfig --namespace openshift-windows-machine-config-operator --ca-bundle C:\\k\\ca-bundle.crt"}
{"level":"info","ts":"2025-09-08T15:41:46Z","logger":"wc 10.0.1.43","msg":"rebooting instance"}
{"level":"info","ts":"2025-09-08T15:42:43Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-l2v97"}
{"level":"info","ts":"2025-09-08T15:43:13Z","logger":"nc 10.0.1.43","msg":"instance has been configured as a worker node","version":"10.19.1-8247257"}
{"level":"info","ts":"2025-09-08T15:44:13Z","logger":"controller.windowsmachine","msg":"deleting machine","windowsmachine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"}}
{"level":"info","ts":"2025-09-08T15:44:13Z","logger":"controller.windowsmachine","msg":"unhealthy machine count for machineset","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a","total":2,"unhealthy":0}
{"level":"info","ts":"2025-09-08T15:44:13Z","logger":"controller.windowsmachine","msg":"machine has been remediated by deletion","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc"}
{"level":"info","ts":"2025-09-08T15:45:13Z","logger":"controller.windowsmachine","msg":"processing","windowsmachine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrhft","namespace":"openshift-machine-api"},"address":"10.0.26.32"}
{"level":"info","ts":"2025-09-08T15:45:21Z","logger":"controllers.configmap","msg":"Deleted outdated resource","ConfigMap":{"name":"windows-services-10.19.0-c6693cf","namespace":"openshift-windows-machine-config-operator"}}
{"level":"info","ts":"2025-09-08T15:48:30Z","logger":"wc 10.0.26.32","msg":"configuring"}
{"level":"info","ts":"2025-09-08T15:49:19Z","logger":"controllers.registry","msg":"updating containerd config","registry":{"name":""},"registry":{"name":"stage-repo"},"registry":{"name":"stage-repo"},"directory":"C:\\k\\containerd\\registries","node":"ip-10-0-1-43.us-east-2.compute.internal"}
{"level":"info","ts":"2025-09-08T15:49:29Z","logger":"wc 10.0.26.32","msg":"rebooting instance"}
{"level":"info","ts":"2025-09-08T15:49:30Z","logger":"controllers.registry","msg":"updating containerd config","registry":{"name":""},"registry":{"name":"stage-repo"},"registry":{"name":"stage-repo"},"registry":{"name":"stage-repo"},"directory":"C:\\k\\containerd\\registries","node":"ip-10-0-1-43.us-east-2.compute.internal"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Stopping and waiting for non leader election runnables"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Stopping and waiting for leader election runnables"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"node","controllerGroup":"","controllerKind":"Node"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"namespace","controllerGroup":"","controllerKind":"Namespace"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Shutdown signal received, waiting for all workers to finish","controller":"secret","controllerGroup":"","controllerKind":"Secret"}
{"level":"error","ts":"2025-09-08T15:49:34Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrhft","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrhft","reconcileID":"1dff63e0-448b-4b54-92cc-f2981574b11b","error":"unable to configure instance i-0f3f2fb674ad20e81: bootstrapping the Windows instance failed: error restarting the Windows instance and reinitializing SSH connection: instance reboot failed to start: context canceled","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"node","controllerGroup":"","controllerKind":"Node"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"namespace","controllerGroup":"","controllerKind":"Namespace"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"secret","controllerGroup":"","controllerKind":"Secret"}
{"level":"error","ts":"2025-09-08T15:49:34Z","msg":"Reconciler error","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","Machine":{"name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","namespace":"openshift-machine-api"},"namespace":"openshift-machine-api","name":"rrasouli-5240-llpg4-windows-worker-us-east-2a-vrpnc","reconcileID":"e595dc19-9512-4036-bf12-f8da7a18e0b3","error":"client rate limiter Wait returned an error: context canceled","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/build/windows-machine-config-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"All workers finished","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Stopping and waiting for caches"}
W0908 15:49:34.502435       1 reflector.go:492] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers.go:108: watch of *v1.ImageTagMirrorSet ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
W0908 15:49:34.528138       1 reflector.go:492] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers.go:108: watch of *v1.ConfigMap ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Stopping and waiting for webhooks"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Stopping and waiting for HTTP servers"}
{"level":"info","ts":"2025-09-08T15:49:34Z","logger":"controller-runtime.metrics","msg":"Shutting down metrics server with timeout of 1 minute"}
{"level":"info","ts":"2025-09-08T15:49:34Z","msg":"Wait completed, proceeding to shutdown the manager"}