-
Bug
-
Resolution: Done
-
Major
-
None
Description of problem:
CLO pod crashing due to panic: invalid memory address or nil pointer dereference
Version-Release number of selected component (if applicable):
Logging5.7
How reproducible:
Always
Steps to Reproduce:
- Add 'ocpConsole' config to CL
spec:
collection:
type: fluentd
logStore:
lokistack:
name: lokistack-sample
type: lokistack
managementState: Managed
visualization:
ocpConsole:
logsLimit: 200
timeout: 60s
type: ocp-console
Actual result:
oc get pods
NAME READY STATUS RESTARTS AGE
cluster-logging-operator-7cdc68b54-sjnf4 0/1 CrashLoopBackOff 8 (3m8s ago) 19m
collector-2cxp6 2/2 Running 0 164m
collector-gt8z5 2/2 Running 0 164m
collector-hr4hn 2/2 Running 0 164m
collector-j8lln 2/2 Running 0 164m
collector-jklgf 2/2 Running 0 164m
collector-pzdjl 2/2 Running 0 164m
logging-view-plugin-5f4854cc69-wkgxz 1/1 Running 0 163m
lokistack-sample-compactor-0 1/1 Running 0 176m
lokistack-sample-distributor-bff7dd44d-jjdm4 1/1 Running 0 176m
lokistack-sample-gateway-6476c685c5-69zsn 2/2 Running 0 176m
lokistack-sample-gateway-6476c685c5-7l62r 2/2 Running 0 176m
lokistack-sample-index-gateway-0 1/1 Running 0 176m
lokistack-sample-ingester-0 1/1 Running 0 176m
lokistack-sample-querier-799bb69d7-92vm8 1/1 Running 0 176m
lokistack-sample-query-frontend-bf99b7974-dln7v 1/1 Running 0 176m
Error log:
$ oc logs cluster-logging-operator-7cdc68b54-sjnf4 {"_ts":"2023-03-28T12:55:18.178332097Z","_level":"0","_component":"cluster-logging-operator","_message":"starting up...","go_arch":"amd64","go_os":"linux","go_version":"go1.18.9","operator_version":"5.7"} I0328 12:55:19.228818 1 request.go:682] Waited for 1.036614538s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/k8s.cni.cncf.io/v1?timeout=32s {"_ts":"2023-03-28T12:55:20.588564698Z","_level":"0","_component":"cluster-logging-operator","_message":"migrating resources provided by the manifest"} {"_ts":"2023-03-28T12:55:20.593024775Z","_level":"0","_component":"cluster-logging-operator","_message":"Registering Components."} {"_ts":"2023-03-28T12:55:20.593261678Z","_level":"0","_component":"cluster-logging-operator","_message":"Starting the Cmd."} panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x8 pc=0x14c6ca2] goroutine 550 [running]: github.com/openshift/cluster-logging-operator/internal/visualization/kibana.New({0xc00070ea80, 0x11}, {0x182c45a, 0x6}, 0xc00041f270, 0xc00080af00, {{0xc000a12060, 0x17}, {0x18340eb, 0xe}, ...}) /remote-source/cluster-logging-operator/app/internal/visualization/kibana/factory.go:46 +0x2c2 github.com/openshift/cluster-logging-operator/internal/k8shandler.(*ClusterLoggingRequest).createOrUpdateKibana(0xc000a360c0) /remote-source/cluster-logging-operator/app/internal/k8shandler/visualization.go:50 +0x2a7 github.com/openshift/cluster-logging-operator/internal/k8shandler.(*ClusterLoggingRequest).CreateOrUpdateVisualization(0xc000a360c0) /remote-source/cluster-logging-operator/app/internal/k8shandler/visualization.go:27 +0x6a github.com/openshift/cluster-logging-operator/internal/k8shandler.Reconcile(0xc000000960, {0x1abcfe8, 0xc000222cd0}, {0x7fd3705128c0, 0xc000332310}, {0x1ab7500, 0xc00054a040}, {0xc00013c420, 0x22}, {0xc00013c1e0, ...}) /remote-source/cluster-logging-operator/app/internal/k8shandler/reconciler.go:107 +0x645 github.com/openshift/cluster-logging-operator/controllers/clusterlogging.(*ReconcileClusterLogging).Reconcile(0xc0006cc300, {0x1ab7f70, 0xc00080a450}, {{{0xc000138d80?, 0x175fe20?}, {0xc0005ae450?, 0x30?}}}) /remote-source/cluster-logging-operator/app/controllers/clusterlogging/clusterlogging_controller.go:90 +0x3c9 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile(0xc000184000, {0x1ab7f70, 0xc00080a2a0}, {{{0xc000138d80?, 0x175fe20?}, {0xc0005ae450?, 0x409534?}}}) /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:114 +0x27e sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000184000, {0x1ab7ec8, 0xc000656cc0}, {0x1695de0?, 0xc00060e260?}) /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:311 +0x349 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000184000, {0x1ab7ec8, 0xc000656cc0}) /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:266 +0x1d9 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2() /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:227 +0x85 created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2 /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:223 +0x31c