Loading...

Type: Bug
Resolution: Done
Priority: Blocker
Fix Version/s: 2.12.1.GA
Affects Version/s: 2.12.0.GA
Component/s: deploy: cli, install, machine-exec, operator
Labels:
None

Blocked:
False
Ready:
False
Steps to Reproduce:

Hide

CRW 2.11 -> 2.12 rollout update

Show
CRW 2.11 -> 2.12 rollout update
Market:

SFDC Cases Counter:
SFDC Cases Open:
SFDC Cases Links:

This issue is currently a blocker for 2.12 rollout update on the workspaces.openshift.com

codeready-operator:
    Container ID:  cri-o://d445cc458ac4481d70a0098fa8b3d77eb3887444961875e49d99a70859668526
    Image:         registry.redhat.io/codeready-workspaces/crw-2-rhel8-operator@sha256:458802564043f3047e477045c9cf4e06ef6b9e41bd8de3a05f482250f326ea28
    Image ID:      registry.redhat.io/codeready-workspaces/crw-2-rhel8-operator@sha256:458802564043f3047e477045c9cf4e06ef6b9e41bd8de3a05f482250f326ea28
    Port:          60000/TCP
    Host Port:     0/TCP
    Command:
      /manager
    Args:
      --leader-elect
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       OOMKilled
      Exit Code:    137
      Started:      Fri, 15 Oct 2021 11:15:06 +0200
      Finished:     Fri, 15 Oct 2021 11:15:59 +0200
    Ready:          False
    Restart Count:  8
    Limits:
      cpu:     500m
      memory:  256Mi
    Requests:
      cpu:      100m
      memory:   64Mi
    Liveness:   http-get http://:6789/healthz delay=15s timeout=5s period=10s #success=1 #failure=10
    Readiness:  http-get http://:6789/readyz delay=5s timeout=5s period=10s #success=1 #failure=10

Logs from `che-dev`:


{"level":"info","ts":1634289306.6872416,"msg":"Binary info ","Go version":"go1.15.14"}
{"level":"info","ts":1634289306.6872716,"msg":"Binary info ","OS":"linux","Arch":"amd64"}
{"level":"info","ts":1634289306.687276,"msg":"Address ","Metrics":":60000"}
{"level":"info","ts":1634289306.6872787,"msg":"Address ","Probe":":6789"}
{"level":"info","ts":1634289306.6872814,"msg":"Operator is running on ","Infrastructure":"OpenShift v4.x"}
I1015 09:15:07.739975       1 request.go:655] Throttling request took 1.046252533s, request: GET:https://172.30.0.1:443/apis/authentication.k8s.io/v1beta1?timeout=32s
{"level":"info","ts":1634289310.0956612,"logger":"controller-runtime.metrics","msg":"metrics server is starting to listen","addr":":60000"}
time="2021-10-15T09:15:13Z" level=info msg="Use 'terminationGracePeriodSeconds' 20 sec. from operator deployment."
time="2021-10-15T09:15:13Z" level=info msg="Set up process signal handler"
{"level":"info","ts":1634289316.9225101,"logger":"setup","msg":"DevWorkspace support disabled. Will initiate restart when CheCluster with devworkspaces enabled will appear"}
{"level":"info","ts":1634289316.9225595,"logger":"setup","msg":"starting manager"}
I1015 09:15:16.922602       1 leaderelection.go:243] attempting to acquire leader lease codeready-workspaces-operator/e79b08a4.org.eclipse.che...
{"level":"info","ts":1634289316.922656,"logger":"controller-runtime.manager","msg":"starting metrics server","path":"/metrics"}
I1015 09:15:33.481173       1 leaderelection.go:253] successfully acquired lease codeready-workspaces-operator/e79b08a4.org.eclipse.che
{"level":"info","ts":1634289333.481345,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.4813764,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.4813943,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterBackup","controller":"checlusterbackup-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.4813488,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterRestore","controller":"checlusterrestore-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.5816646,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.5817509,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterBackup","controller":"checlusterbackup-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.5817795,"logger":"controller","msg":"Starting Controller","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterBackup","controller":"checlusterbackup-controller"}
{"level":"info","ts":1634289333.5817652,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.5817933,"logger":"controller","msg":"Starting workers","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterBackup","controller":"checlusterbackup-controller","worker count":1}
{"level":"info","ts":1634289333.581868,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterRestore","controller":"checlusterrestore-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.5818877,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.5819728,"logger":"controller","msg":"Starting Controller","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterRestore","controller":"checlusterrestore-controller"}
{"level":"info","ts":1634289333.6820486,"logger":"controller","msg":"Starting workers","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterRestore","controller":"checlusterrestore-controller","worker count":1}
{"level":"info","ts":1634289333.6822321,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289333.6825864,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289336.18428,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289336.4852304,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.284703,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.2856758,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.285804,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.386374,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.386716,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.387146,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.4877405,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.4885905,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.4887831,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.4893227,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.5890694,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.58964,"logger":"controller","msg":"Starting Controller","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster"}
{"level":"info","ts":1634289337.5901265,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.5927026,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.5939822,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289337.594153,"logger":"controller","msg":"Starting Controller","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster"}
{"level":"info","ts":1634289337.5941985,"logger":"controller","msg":"Starting workers","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","worker count":1}
{"level":"info","ts":1634289337.594245,"logger":"controller","msg":"Starting workers","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","worker count":1}
{"level":"error","ts":1634289337.6243963,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"test-operatorhub-che","error":"namespaces \"test-operatorhub-che\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289338.6351063,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
I1015 09:15:38.644230       1 request.go:655] Throttling request took 1.04706661s, request: GET:https://172.30.0.1:443/apis/apps.openshift.io/v1?timeout=32s
{"level":"error","ts":1634289339.6422954,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"vp-eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289340.7104428,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"test-operatorhub-che","error":"namespaces \"test-operatorhub-che\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289341.7190259,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289342.7268744,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"vp-eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289343.7798045,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"test-operatorhub-che","error":"namespaces \"test-operatorhub-che\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289344.7918189,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289345.7991686,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"vp-eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289346.8518243,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"test-operatorhub-che","error":"namespaces \"test-operatorhub-che\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
Difference:
  &v1.Deployment{
  	... // 2 ignored fields
  	Spec: v1.DeploymentSpec{
  		... // 1 ignored field
  		Selector: &{MatchLabels: {"app": "codeready", "component": "keycloak"}},
  		Template: v1.PodTemplateSpec{
  			ObjectMeta: {Labels: {"app": "codeready", "app.kubernetes.io/component": "keycloak", "app.kubernetes.io/instance": "codeready", "app.kubernetes.io/managed-by": "codeready-operator", ...}},
  			Spec: v1.PodSpec{
  				Volumes:        {{Name: "che-public-certs", VolumeSource: {ConfigMap: &{LocalObjectReference: {Name: "ca-certs-merged"}}}}},
  				InitContainers: nil,
  				Containers: []v1.Container{
  					{
  						Name: "keycloak",
  						Image: strings.Join({
  							"registry.redhat.io/rh-sso-7/sso74-openshift-rhel8@sha256:",
- 							"ac4b64c5bec40e32125fac931fc7b5492752f9a9896adf2400a84930960d9a41",
+ 							"b98f0b743dd406be726d8ba8c0437ed5228c7064015c1d48ef5f87eb365522bc",
  						}, ""),
  						Command: {"/bin/sh"},
  						Args:    {"-c", "echo \"ssl_required WAS UPDATED for master realm.\" && \n\tfunction "...},
  						... // 3 ignored and 15 identical fields
  					},
  				},
  				EphemeralContainers: nil,
  				RestartPolicy:       "Always",
  				... // 4 ignored and 26 identical fields
  			},
  		},
  		Strategy:        {Type: "RollingUpdate"},
  		MinReadySeconds: 0,
  		... // 2 ignored and 1 identical fields
  	},
  	... // 1 ignored field
  }
time="2021-10-15T09:15:47Z" level=info msg="Updating existing object: v1.Deployment, name: keycloak"
{"level":"error","ts":1634289347.8599112,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
I1015 09:15:48.691158       1 request.go:655] Throttling request took 1.58352019s, request: GET:https://172.30.0.1:443/apis/extensions/v1beta1?timeout=32s
{"level":"error","ts":1634289348.867911,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"vp-eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289349.9587493,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"test-operatorhub-che","error":"namespaces \"test-operatorhub-che\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289350.966988,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289351.977214,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"vp-eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289353.027432,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"test-operatorhub-che","error":"namespaces \"test-operatorhub-che\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289354.034908,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289355.0434537,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"vp-eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289356.1043947,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"test-operatorhub-che","error":"namespaces \"test-operatorhub-che\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
time="2021-10-15T09:15:56Z" level=info msg="Deployment keycloak is in the rolling update state."
{"level":"error","ts":1634289357.112319,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
{"level":"error","ts":1634289358.122969,"logger":"controller","msg":"Reconciler error","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","name":"vp-eclipse-che","namespace":"che-operatorhub","error":"namespaces \"che-operatorhub\" not found","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/che-operator/vendor/github.com/go-logr/zapr/zapr.go:132\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:246\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:218\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:197\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/che-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90"}
I1015 09:15:58.738819       1 request.go:655] Throttling request took 1.95922577s, request: GET:https://172.30.0.1:443/apis/storage.k8s.io/v1beta1?timeout=32s

logs from Developer Sandbox staging:

{"level":"info","ts":1634289624.790157,"msg":"Binary info ","Go version":"go1.15.14"}
{"level":"info","ts":1634289624.790186,"msg":"Binary info ","OS":"linux","Arch":"amd64"}
{"level":"info","ts":1634289624.790191,"msg":"Address ","Metrics":":60000"}
{"level":"info","ts":1634289624.7901945,"msg":"Address ","Probe":":6789"}
{"level":"info","ts":1634289624.7901978,"msg":"Operator is running on ","Infrastructure":"OpenShift v4.x"}
I1015 09:20:25.842995       1 request.go:655] Throttling request took 1.047333154s, request: GET:https://172.30.0.1:443/apis/autoscaling/v1?timeout=32s
{"level":"info","ts":1634289628.9987462,"logger":"controller-runtime.metrics","msg":"metrics server is starting to listen","addr":":60000"}
time="2021-10-15T09:20:33Z" level=info msg="Use 'terminationGracePeriodSeconds' 20 sec. from operator deployment."
time="2021-10-15T09:20:33Z" level=info msg="Set up process signal handler"
I1015 09:20:35.861760       1 request.go:655] Throttling request took 2.645092109s, request: GET:https://172.30.0.1:443/apis/apiserver.openshift.io/v1?timeout=32s
{"level":"info","ts":1634289637.4203815,"logger":"setup","msg":"DevWorkspace support disabled. Will initiate restart when CheCluster with devworkspaces enabled will appear"}
{"level":"info","ts":1634289637.420418,"logger":"setup","msg":"starting manager"}
I1015 09:20:37.420447       1 leaderelection.go:243] attempting to acquire leader lease codeready-workspaces-operator/e79b08a4.org.eclipse.che...
{"level":"info","ts":1634289637.4204903,"logger":"controller-runtime.manager","msg":"starting metrics server","path":"/metrics"}
I1015 09:20:52.655366       1 leaderelection.go:253] successfully acquired lease codeready-workspaces-operator/e79b08a4.org.eclipse.che
{"level":"info","ts":1634289652.6555758,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.6556299,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.6556563,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterRestore","controller":"checlusterrestore-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.655655,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterBackup","controller":"checlusterbackup-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.7559457,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.755997,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.7560248,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterRestore","controller":"checlusterrestore-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.7559683,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.756178,"logger":"controller","msg":"Starting Controller","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterRestore","controller":"checlusterrestore-controller"}
{"level":"info","ts":1634289652.756191,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterBackup","controller":"checlusterbackup-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.7562184,"logger":"controller","msg":"Starting Controller","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheClusterBackup","controller":"checlusterbackup-controller"}
{"level":"info","ts":1634289652.856323,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}
{"level":"info","ts":1634289652.8566048,"logger":"controller","msg":"Starting EventSource","reconcilerGroup":"org.eclipse.che","reconcilerKind":"CheCluster","controller":"checluster","source":"kind source: /, Kind="}