2024-03-19T09:21:58.202Z INFO controller-runtime.metrics Metrics server is starting to listen {"addr": ":8383"} 2024-03-19T09:21:58.322Z INFO setup starting manager I0319 09:21:58.322911 1 enhanced-filtered-cache.go:521] Start enhanced filtered cache 2024-03-19T09:21:58.322Z INFO Starting server {"path": "/metrics", "kind": "metrics", "addr": "[::]:8383"} 2024-03-19T09:21:58.322Z INFO Starting server {"kind": "health probe", "addr": "[::]:8081"} W0319 09:21:58.323076 1 shared_informer.go:416] The sharedIndexInformer has started, run more than once is not allowed W0319 09:21:58.323119 1 shared_informer.go:416] The sharedIndexInformer has started, run more than once is not allowed W0319 09:21:58.323163 1 shared_informer.go:416] The sharedIndexInformer has started, run more than once is not allowed W0319 09:21:58.323229 1 shared_informer.go:416] The sharedIndexInformer has started, run more than once is not allowed W0319 09:21:58.323272 1 shared_informer.go:416] The sharedIndexInformer has started, run more than once is not allowed 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1beta1.ObservabilityAddon"} 2024-03-19T09:21:59.323Z INFO Starting Controller {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1beta1.ObservabilityAddon"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.Secret"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.Secret"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.Secret"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.Secret"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.ConfigMap"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.ConfigMap"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.ConfigMap"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.Deployment"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.Deployment"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.ClusterRoleBinding"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.ConfigMap"} 2024-03-19T09:21:59.323Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.StatefulSet"} 2024-03-19T09:21:59.324Z INFO Starting EventSource {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "source": "kind source: *v1.ConfigMap"} 2024-03-19T09:21:59.324Z INFO Starting Controller {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon"} 2024-03-19T09:22:00.324Z INFO Starting workers {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "worker count": 1} 2024-03-19T09:22:00.426Z INFO Starting workers {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "worker count": 1} 2024-03-19T09:22:00.426Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-addon"} W0319 09:22:00.426238 1 client_config.go:618] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work. 2024-03-19T09:22:00.430Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.057Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.058Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.061Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.061Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.065Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.065Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.069Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.069Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.074Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.074Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.077Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.078Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.294Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.305Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:01.318Z INFO controllers.Status Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-addon"} 2024-03-19T09:22:01.320Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "hub-info-secret"} 2024-03-19T09:22:01.343Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.366Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.366Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.370Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.370Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.374Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.374Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.380Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.380Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.387Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.387Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.387Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.388Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.396Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.401Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:01.410Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-managed-cluster-certs"} 2024-03-19T09:22:01.413Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.440Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.440Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.444Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.444Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.448Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.448Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.451Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.451Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.457Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.457Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.457Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.457Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.466Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.470Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:01.476Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-controller-open-cluster-management.io-observability-signer-client-cert"} 2024-03-19T09:22:01.481Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.508Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.508Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.513Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.513Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.517Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.517Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.521Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.521Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.526Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.526Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.526Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.526Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.536Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.540Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:01.548Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-metrics-allowlist"} 2024-03-19T09:22:01.551Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.596Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.596Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.599Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.599Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.604Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.604Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.607Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.607Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.614Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.614Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.614Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.614Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.625Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.629Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:01.635Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-alertmanager-accessor"} 2024-03-19T09:22:01.638Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.666Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.666Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.674Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.674Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.684Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.684Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.689Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.689Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.694Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.694Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.694Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.694Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.705Z ERROR controllers.ObservabilityAddon Failed to update deployment {"name": "metrics-collector-deployment", "error": "Operation cannot be fulfilled on deployments.apps \"metrics-collector-deployment\": the object has been modified; please apply your changes to the latest version and try again"} github.com/stolostron/multicluster-observability-operator/operators/endpointmetrics/controllers/observabilityendpoint.updateMetricsCollector /remote-source/app/operators/endpointmetrics/controllers/observabilityendpoint/metrics_collector.go:670 github.com/stolostron/multicluster-observability-operator/operators/endpointmetrics/controllers/observabilityendpoint.updateMetricsCollectors /remote-source/app/operators/endpointmetrics/controllers/observabilityendpoint/metrics_collector.go:561 github.com/stolostron/multicluster-observability-operator/operators/endpointmetrics/controllers/observabilityendpoint.(*ObservabilityAddonReconciler).Reconcile /remote-source/app/operators/endpointmetrics/controllers/observabilityendpoint/observabilityaddon_controller.go:248 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2 /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235 2024-03-19T09:22:01.711Z ERROR Reconciler error {"controller": "observabilityaddon", "controllerGroup": "observability.open-cluster-management.io", "controllerKind": "ObservabilityAddon", "ObservabilityAddon": {"name":"observability-alertmanager-accessor","namespace":"open-cluster-management-addon-observability"}, "namespace": "open-cluster-management-addon-observability", "name": "observability-alertmanager-accessor", "reconcileID": "f79af2cd-e4f5-48f6-9ce0-0c763c061cc1", "error": "Operation cannot be fulfilled on deployments.apps \"metrics-collector-deployment\": the object has been modified; please apply your changes to the latest version and try again"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2 /remote-source/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235 2024-03-19T09:22:01.711Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "images-list"} 2024-03-19T09:22:01.711Z INFO controllers.Status Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-addon"} 2024-03-19T09:22:01.715Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.738Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.738Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.742Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.742Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.746Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.746Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.750Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.750Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.755Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.755Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.756Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.756Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.765Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.769Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:01.776Z INFO controllers.Status Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-addon"} 2024-03-19T09:22:01.776Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "metrics-collector-deployment"} 2024-03-19T09:22:01.780Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:01.803Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:01.803Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:01.807Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:01.807Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:01.810Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:01.810Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:01.814Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.814Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:01.819Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:01.819Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:01.819Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:01.819Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.828Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:01.832Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:01.838Z INFO controllers.ObservabilityAddon Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-alertmanager-accessor"} 2024-03-19T09:22:01.842Z INFO util unable to get CRD with ApiextensionsV1 Client, not found. {"CRD": "hostedclusters.hypershift.openshift.io"} 2024-03-19T09:22:02.145Z INFO controllers.ObservabilityAddon The clusterrolebinding already existed 2024-03-19T09:22:02.145Z INFO controllers.ObservabilityAddon The configmap already existed 2024-03-19T09:22:02.154Z INFO controllers.ObservabilityAddon the hub-alertmanager-router-ca secret already exists, check if it needs to be updated 2024-03-19T09:22:02.154Z INFO controllers.ObservabilityAddon no change for the hub-alertmanager-router-ca secret 2024-03-19T09:22:02.159Z INFO controllers.ObservabilityAddon the observability-alertmanager-accessor secret already exists, check if it needs to be updated 2024-03-19T09:22:02.159Z INFO controllers.ObservabilityAddon no change for the observability-alertmanager-accessor secret 2024-03-19T09:22:02.164Z INFO controllers.ObservabilityAddon configmap already exists, check if it needs update {"name": "cluster-monitoring-config"} 2024-03-19T09:22:02.164Z INFO controllers.ObservabilityAddon configmap already exists and key config.yaml exists, check if the value needs update {"name": "cluster-monitoring-config", "key": "config.yaml"} 2024-03-19T09:22:02.170Z INFO controllers.ObservabilityAddon configmap updated {"name": "cluster-monitoring-config"} 2024-03-19T09:22:02.170Z INFO controllers.ObservabilityAddon in isRevertedAlready 2024-03-19T09:22:02.170Z INFO controllers.ObservabilityAddon isRevertedAlready {"clusterMonitoringConfigReverted:": false} 2024-03-19T09:22:02.171Z INFO controllers.ObservabilityAddon updateMetricsCollector {"name": "metrics-collector-deployment"} 2024-03-19T09:22:02.183Z INFO controllers.ObservabilityAddon Updated deployment {"name": "metrics-collector-deployment"} 2024-03-19T09:22:02.187Z INFO controllers.ObservabilityAddon The metrics collector deployment does not exist {"name": "uwl-metrics-collector-deployment"} 2024-03-19T09:22:02.197Z INFO controllers.Status Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-addon"} 2024-03-19T09:22:26.528Z INFO controllers.Status Reconciling {"Request.Namespace": "open-cluster-management-addon-observability", "Request.Name": "observability-addon"}