Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-3879

CLO pod crashing due to panic: invalid memory address or nil pointer dereference

XMLWordPrintable

    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Log Collection - Sprint 234

      Description of problem:

      CLO pod crashing due to panic: invalid memory address or nil pointer dereference

      Version-Release number of selected component (if applicable):

      Logging5.7

      How reproducible:

      Always

      Steps to Reproduce:

      1. Add 'ocpConsole' config to CL
          spec:
            collection:
              type: fluentd
            logStore:
              lokistack:
                name: lokistack-sample
              type: lokistack
            managementState: Managed
            visualization:
              ocpConsole:
                logsLimit: 200
                timeout: 60s
              type: ocp-console

      Actual result:

      oc get pods
      NAME                                              READY   STATUS             RESTARTS       AGE
      cluster-logging-operator-7cdc68b54-sjnf4          0/1     CrashLoopBackOff   8 (3m8s ago)   19m
      collector-2cxp6                                   2/2     Running            0              164m
      collector-gt8z5                                   2/2     Running            0              164m
      collector-hr4hn                                   2/2     Running            0              164m
      collector-j8lln                                   2/2     Running            0              164m
      collector-jklgf                                   2/2     Running            0              164m
      collector-pzdjl                                   2/2     Running            0              164m
      logging-view-plugin-5f4854cc69-wkgxz              1/1     Running            0              163m
      lokistack-sample-compactor-0                      1/1     Running            0              176m
      lokistack-sample-distributor-bff7dd44d-jjdm4      1/1     Running            0              176m
      lokistack-sample-gateway-6476c685c5-69zsn         2/2     Running            0              176m
      lokistack-sample-gateway-6476c685c5-7l62r         2/2     Running            0              176m
      lokistack-sample-index-gateway-0                  1/1     Running            0              176m
      lokistack-sample-ingester-0                       1/1     Running            0              176m
      lokistack-sample-querier-799bb69d7-92vm8          1/1     Running            0              176m
      lokistack-sample-query-frontend-bf99b7974-dln7v   1/1     Running            0              176m

      Error log:
       

      $ oc logs cluster-logging-operator-7cdc68b54-sjnf4
      {"_ts":"2023-03-28T12:55:18.178332097Z","_level":"0","_component":"cluster-logging-operator","_message":"starting up...","go_arch":"amd64","go_os":"linux","go_version":"go1.18.9","operator_version":"5.7"}
      I0328 12:55:19.228818       1 request.go:682] Waited for 1.036614538s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/k8s.cni.cncf.io/v1?timeout=32s
      {"_ts":"2023-03-28T12:55:20.588564698Z","_level":"0","_component":"cluster-logging-operator","_message":"migrating resources provided by the manifest"}
      {"_ts":"2023-03-28T12:55:20.593024775Z","_level":"0","_component":"cluster-logging-operator","_message":"Registering Components."}
      {"_ts":"2023-03-28T12:55:20.593261678Z","_level":"0","_component":"cluster-logging-operator","_message":"Starting the Cmd."}
      panic: runtime error: invalid memory address or nil pointer dereference
      [signal SIGSEGV: segmentation violation code=0x1 addr=0x8 pc=0x14c6ca2]
      goroutine 550 [running]:
      github.com/openshift/cluster-logging-operator/internal/visualization/kibana.New({0xc00070ea80, 0x11}, {0x182c45a, 0x6}, 0xc00041f270, 0xc00080af00, {{0xc000a12060, 0x17}, {0x18340eb, 0xe}, ...})
          /remote-source/cluster-logging-operator/app/internal/visualization/kibana/factory.go:46 +0x2c2
      github.com/openshift/cluster-logging-operator/internal/k8shandler.(*ClusterLoggingRequest).createOrUpdateKibana(0xc000a360c0)
          /remote-source/cluster-logging-operator/app/internal/k8shandler/visualization.go:50 +0x2a7
      github.com/openshift/cluster-logging-operator/internal/k8shandler.(*ClusterLoggingRequest).CreateOrUpdateVisualization(0xc000a360c0)
          /remote-source/cluster-logging-operator/app/internal/k8shandler/visualization.go:27 +0x6a
      github.com/openshift/cluster-logging-operator/internal/k8shandler.Reconcile(0xc000000960, {0x1abcfe8, 0xc000222cd0}, {0x7fd3705128c0, 0xc000332310}, {0x1ab7500, 0xc00054a040}, {0xc00013c420, 0x22}, {0xc00013c1e0, ...})
          /remote-source/cluster-logging-operator/app/internal/k8shandler/reconciler.go:107 +0x645
      github.com/openshift/cluster-logging-operator/controllers/clusterlogging.(*ReconcileClusterLogging).Reconcile(0xc0006cc300, {0x1ab7f70, 0xc00080a450}, {{{0xc000138d80?, 0x175fe20?}, {0xc0005ae450?, 0x30?}}})
          /remote-source/cluster-logging-operator/app/controllers/clusterlogging/clusterlogging_controller.go:90 +0x3c9
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile(0xc000184000, {0x1ab7f70, 0xc00080a2a0}, {{{0xc000138d80?, 0x175fe20?}, {0xc0005ae450?, 0x409534?}}})
          /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:114 +0x27e
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000184000, {0x1ab7ec8, 0xc000656cc0}, {0x1695de0?, 0xc00060e260?})
          /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:311 +0x349
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000184000, {0x1ab7ec8, 0xc000656cc0})
          /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:266 +0x1d9
      sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2()
          /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:227 +0x85
      created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
          /remote-source/cluster-logging-operator/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.0/pkg/internal/controller/controller.go:223 +0x31c
      

            jcantril@redhat.com Jeffrey Cantrill
            gkarager Giriyamma Karagere Ramaswamy (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: