Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-2121

LokiStack components/pods are not coming up due to CrashLoopBackOff error

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • Logging 5.4.0
    • None
    • Log Storage
    • None
    • False
    • False
    • NEW
    • OBSDA-7 - Adopting Loki as an alternative to Elasticsearch to support more lightweight, easier to manage/operate storage scenarios
    • VERIFIED
    • Logging (LogExp) - Sprint 213

      Tested on OCP 4.9 and below Loki csv.

      [kbharti@cube hack]$ oc get csv -n openshift-logging

      NAME                   DISPLAY         VERSION   REPLACES   PHASE

      loki-operator.v0.0.1   Loki Operator   0.0.1                Succeeded

      Steps to Deploy Loki Operator:

      1) Build and push the container image [2] and then deploy the operator with: 

      make olm-deploy REGISTRY_ORG=$YOUR_QUAY_ORG VERSION=$VERSION

      2) create a storage secret for the operator

      ./hack/deploy-example-secret.sh openshift-logging

      3)  create a LokiStack instance to get the various components of Loki up and running

      oc create -f lokistack_gateway_ocp.yaml -n openshift-logging

      Documentation: https://github.com/grafana/loki/blob/main/operator/docs/hack_loki_operator.md#hacking-on-loki-operator-on-openshift

      Result:

      [kbharti@cube hack]$ oc get pods -n openshift-logging

      NAME                                                              READY   STATUS             RESTARTS        AGE

      ca62d525248e797cf94ed1f067021020d655a54cf961251d1ec098--1-stzct   0/1     Completed          0               10m

      loki-compactor-lokistack-dev-0                                    0/1     CrashLoopBackOff   5 (2m17s ago)   5m28s

      loki-distributor-lokistack-dev-764f88d94b-6hfnj                   0/1     CrashLoopBackOff   5 (2m21s ago)   5m28s

      loki-index-gateway-lokistack-dev-0                                0/1     CrashLoopBackOff   5 (2m12s ago)   5m28s

      loki-ingester-lokistack-dev-0                                     0/1     CrashLoopBackOff   5 (2m16s ago)   5m28s

      loki-operator-controller-manager-79bb668fcf-xsd2m                 2/2     Running            0               9m57s

      loki-querier-lokistack-dev-6989b6964c-26vjf                       0/1     CrashLoopBackOff   5 (2m27s ago)   5m28s

      loki-query-frontend-lokistack-dev-5744d7f997-b27cs                0/1     CrashLoopBackOff   5 (2m18s ago)   5m28s

      lokistack-gateway-lokistack-dev-7f69ccd568-rs5bh                  2/2     Running            0               5m27s

      quay-io-rhn-support-kbharti-loki-operator-bundle-v0-0-1           1/1     Running            0               10m

       

      Error in LokiStack Pods: level=error ts=2022-01-10T16:54:10.516711991Z caller=main.go:51 msg="validating config" err="invalid queryrange config: querier.cache-results may only be enabled in conjunction with querier.split-queries-by-interval. Please set the latter"

              sasagarw@redhat.com Sashank Agarwal (Inactive)
              rhn-support-kbharti Kabir Bharti
              Kabir Bharti Kabir Bharti
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: