-
Bug
-
Resolution: Unresolved
-
Normal
-
None
-
4.18.0
-
None
-
Moderate
-
None
-
3
-
WINC - Sprint 266
-
1
-
False
-
Description of problem:
After removing and re-adding the openshift.io/cluster-monitoring label to the openshift-windows-machine-config-operator namespace, no events are generated as expected. Additionally, there are no relevant logs in the operator that indicate this action
Version-Release number of selected component (if applicable):
Operator Version: 10.18.0-0ceb106
How reproducible:
Always reproducible.
Steps to Reproduce:
1. Run the following command to remove the label from the openshift-windows-machine-config-operator namespace: #oc label namespace openshift-windows-machine-config-operator openshift.io/cluster-monitoring- 2.Re-add the label using the following command: #oc label namespace openshift-windows-machine-config-operator openshift.io/cluster-monitoring=true 3.Check for events in the namespace: #oc get events -n openshift-windows-machine-config-operator 4.Check the operator logs: #oc logs -n openshift-windows-machine-config-operator deployment/windows-machine-config-operator -f
Actual results:
No events are generated in the namespace after removing or re-adding the label. The operator logs do not contain any relevant information about the label change.
Expected results:
An event should be generated indicating that monitoring is disabled when the label is removed. An event should be generated indicating that monitoring is enabled when the label is re-added.
Additional info:
> oc logs -n openshift-windows-machine-config-operator deployment/windows-machine-config-operator -f {"level":"info","ts":"2024-11-22T02:21:07Z","logger":"version","msg":"operator","version":"10.18.0-0ceb106"} {"level":"info","ts":"2024-11-22T02:21:07Z","logger":"version","msg":"go","version":"go1.22.7 (Red Hat 1.22.7-1.el9_5) linux/amd64"} {"level":"info","ts":"2024-11-22T02:21:07Z","logger":"leader","msg":"Trying to become the leader."} {"level":"info","ts":"2024-11-22T02:21:07Z","logger":"leader","msg":"No pre-existing lock was found."} {"level":"info","ts":"2024-11-22T02:21:07Z","logger":"leader","msg":"Became the leader."} {"level":"info","ts":"2024-11-22T02:21:07Z","logger":"setup","msg":"operator","namespace":"openshift-windows-machine-config-operator"} {"level":"error","ts":"2024-11-22T02:21:07Z","logger":"controllers.secret","msg":"Unable to retrieve private key, please ensure it is created","error":"the cache is not started, can not read objects","stacktrace":"github.com/openshift/windows-machine-config-operator/controllers.(*SecretReconciler).SetupWithManager\n\t/remote-source/build/windows-machine-config-operator/controllers/secret_controller.go:72\nmain.main\n\t/remote-source/build/windows-machine-config-operator/cmd/operator/main.go:230\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:271"} {"level":"info","ts":"2024-11-22T02:21:08Z","logger":"controllers.configmap","msg":"Created","ConfigMap":{"name":"windows-services-10.18.0-0ceb106","namespace":"openshift-windows-machine-config-operator"}} {"level":"info","ts":"2024-11-22T02:21:08Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2024-11-22T02:21:08Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","source":"kind source: *v1beta1.Machine"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","source":"kind source: *v1.Node"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","source":"kind source: *v1.ImageDigestMirrorSet"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","source":"kind source: *v1.ImageTagMirrorSet"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","source":"kind source: *v1.Secret"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"node","controllerGroup":"","controllerKind":"Node","source":"kind source: *v1.Node"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"node","controllerGroup":"","controllerKind":"Node"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.ConfigMap"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.Node"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.Node"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"secret","controllerGroup":"","controllerKind":"Secret","source":"kind source: *v1.Secret"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"secret","controllerGroup":"","controllerKind":"Secret","source":"kind source: *v1.Secret"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"secret","controllerGroup":"","controllerKind":"Secret"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig","source":"kind source: *v1.ControllerConfig"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest","source":"kind source: *v1.CertificateSigningRequest"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"namespace","controllerGroup":"","controllerKind":"Namespace","source":"kind source: *v1.Namespace"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting EventSource","controller":"namespace","controllerGroup":"","controllerKind":"Namespace","source":"kind source: *v1.ServiceMonitor"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting Controller","controller":"namespace","controllerGroup":"","controllerKind":"Namespace"} {"level":"info","ts":"2024-11-22T02:21:09Z","msg":"Starting workers","controller":"node","controllerGroup":"","controllerKind":"Node","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","msg":"Starting workers","controller":"certificatesigningrequest","controllerGroup":"certificates.k8s.io","controllerKind":"CertificateSigningRequest","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","msg":"Starting workers","controller":"controllerconfig","controllerGroup":"machineconfiguration.openshift.io","controllerKind":"ControllerConfig","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","msg":"Starting workers","controller":"imagedigestmirrorset","controllerGroup":"config.openshift.io","controllerKind":"ImageDigestMirrorSet","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","msg":"Starting workers","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","msg":"Starting workers","controller":"machine","controllerGroup":"machine.openshift.io","controllerKind":"Machine","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","msg":"Starting workers","controller":"secret","controllerGroup":"","controllerKind":"Secret","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","msg":"Starting workers","controller":"namespace","controllerGroup":"","controllerKind":"Namespace","worker count":1} {"level":"info","ts":"2024-11-22T02:21:11Z","logger":"controllers.metrics","msg":"Deleted malformed resource","metrics":{"name":"openshift-windows-machine-config-operator"},"serviceMonitor":"windows-exporter","namespace":"openshift-windows-machine-config-operator"} {"level":"info","ts":"2024-11-22T02:21:11Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:9182","secure":true} {"level":"info","ts":"2024-11-22T02:22:26Z","logger":"controllers.secret","msg":"secret not found, creating the secret","secret":{"name":"windows-machine-config-operator-tls","namespace":"openshift-windows-machine-config-operator"},"secret":{"name":"cloud-private-key","namespace":"openshift-windows-machine-config-operator"},"name":"windows-user-data"} {"level":"info","ts":"2024-11-22T02:23:27Z","logger":"controller.windowsmachine","msg":"processing","windowsmachine":{"name":"weinliu-3451-bvtns-windows-worker-a-zq542","namespace":"openshift-machine-api"},"address":"10.0.128.5"} {"level":"info","ts":"2024-11-22T02:27:06Z","logger":"wc 10.0.128.5","msg":"configuring"} {"level":"info","ts":"2024-11-22T02:28:03Z","logger":"wc 10.0.128.5","msg":"rebooting instance"} {"level":"info","ts":"2024-11-22T02:28:25Z","logger":"wc 10.0.128.5","msg":"transferring files"} {"level":"info","ts":"2024-11-22T02:28:55Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-wdhdh"} {"level":"info","ts":"2024-11-22T02:28:58Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-9hxtb"} {"level":"info","ts":"2024-11-22T02:29:04Z","logger":"wc 10.0.128.5","msg":"configured","service":"windows-instance-config-daemon","args":"controller --windows-service --log-dir C:\\var\\log\\wicd --kubeconfig C:\\k\\wicd-kubeconfig --namespace openshift-windows-machine-config-operator --ca-bundle C:\\k\\ca-bundle.crt"} {"level":"info","ts":"2024-11-22T02:29:11Z","logger":"wc 10.0.128.5","msg":"rebooting instance"} {"level":"info","ts":"2024-11-22T02:29:53Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-qmk45"} {"level":"info","ts":"2024-11-22T02:31:19Z","logger":"nc 10.0.128.5","msg":"instance has been configured as a worker node","version":"10.18.0-0ceb106"} {"level":"info","ts":"2024-11-22T02:31:49Z","logger":"controller.windowsmachine","msg":"processing","windowsmachine":{"name":"weinliu-3451-bvtns-windows-worker-a-v869x","namespace":"openshift-machine-api"},"address":"10.0.128.4"} {"level":"info","ts":"2024-11-22T02:32:01Z","logger":"wc 10.0.128.4","msg":"configuring"} {"level":"info","ts":"2024-11-22T02:32:48Z","logger":"wc 10.0.128.4","msg":"rebooting instance"} {"level":"info","ts":"2024-11-22T02:33:10Z","logger":"wc 10.0.128.4","msg":"transferring files"} {"level":"info","ts":"2024-11-22T02:33:38Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-8296h"} {"level":"info","ts":"2024-11-22T02:33:40Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-cvjm5"} {"level":"info","ts":"2024-11-22T02:33:47Z","logger":"wc 10.0.128.4","msg":"configured","service":"windows-instance-config-daemon","args":"controller --windows-service --log-dir C:\\var\\log\\wicd --kubeconfig C:\\k\\wicd-kubeconfig --namespace openshift-windows-machine-config-operator --ca-bundle C:\\k\\ca-bundle.crt"} {"level":"info","ts":"2024-11-22T02:33:54Z","logger":"wc 10.0.128.4","msg":"rebooting instance"} {"level":"info","ts":"2024-11-22T02:34:34Z","logger":"controllers.certificatesigningrequests","msg":"CSR contents are invalid for approval by WMCO","CSR":"csr-f4r9t"} {"level":"info","ts":"2024-11-22T02:36:02Z","logger":"nc 10.0.128.4","msg":"instance has been configured as a worker node","version":"10.18.0-0ceb106"} {"level":"info","ts":"2024-11-22T02:50:50Z","logger":"controllers.controllerconfig","msg":"updating kubelet CA client certificates in","node":"weinliu-3451-bvtns-windows-worker-a-zq542"} {"level":"info","ts":"2024-11-22T02:50:58Z","logger":"controllers.controllerconfig","msg":"updating kubelet CA client certificates in","node":"weinliu-3451-bvtns-windows-worker-a- > oc label namespace openshift-windows-machine-config-operator openshift.io/cluster-monitoring- namespace/openshift-windows-machine-config-operator unlabeled > oc label namespace openshift-windows-machine-config-operator openshift.io/cluster-monitoring=true namespace/openshift-windows-machine-config-operator labeled > oc get events -n openshift-windows-machine-config-operator No resources found in openshift-windows-machine-config-operator namespace. > oc describe namespace openshift-windows-machine-config-operator Name: openshift-windows-machine-config-operator Labels: kubernetes.io/metadata.name=openshift-windows-machine-config-operator olm.operatorgroup.uid/ec4654cb-eab5-4721-aea1-d19b4106b3f7= openshift.io/cluster-monitoring=true pod-security.kubernetes.io/audit=privileged pod-security.kubernetes.io/audit-version=latest pod-security.kubernetes.io/enforce=privileged pod-security.kubernetes.io/enforce-version=latest pod-security.kubernetes.io/warn=privileged pod-security.kubernetes.io/warn-version=latest security.openshift.io/scc.podSecurityLabelSync=true Annotations: openshift.io/sa.scc.mcs: s0:c27,c4 openshift.io/sa.scc.supplemental-groups: 1000710000/10000 openshift.io/sa.scc.uid-range: 1000710000/10000 Status: Active No resource quota. No LimitRange resource.