Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-2753

Update Grafana configuration for LokiStack integration on grafana/loki repo

    XMLWordPrintable

Details

    • False
    • None
    • False
    • NEW
    • OBSDA-7 - Adopting Loki as an alternative to Elasticsearch to support more lightweight, easier to manage/operate storage scenarios
    • VERIFIED
    • Logging (LogExp) - Sprint 220, Log Storage - Sprint 221

    Description

      This is a tracker to update the Grafana config on the official repo for LokiStack integration since the config expects the route to be non-TLS.

      Current config on the grafana/loki repo shows proxy request failed on grafana pod

      [kbharti@cube hack]$ oc logs grafana-6446946f89-ss4c6 grafana | tail -n 3
      logger=context traceID=00000000000000000000000000000000 userId=1 orgId=1 uname=kube:admin t=2022-06-21T13:54:09.69+0000 lvl=eror msg="Request Completed" method=GET path=/api/datasources/proxy/1/loki/api/v1/query_range status=502 remote_addr=103.155.213.124 time_ms=9 duration=9.658397ms size=0 referer="https://grafana-openshift-logging.apps.kbharti-411-131.qe.devcluster.openshift.com/explore?orgId=1&left=%7B%22datasource%22:%22Loki%20(Application)%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7B%7D%22%7D%5D,%22range%22:%7B%22from%22:%22now-1h%22,%22to%22:%22now%22%7D%7D" traceID=00000000000000000000000000000000
      logger=data-proxy-log userId=1 orgId=1 uname=kube:admin path=/api/datasources/proxy/1/loki/api/v1/query_range remote_addr=103.155.213.124 referer="https://grafana-openshift-logging.apps.kbharti-411-131.qe.devcluster.openshift.com/explore?orgId=1&left=%7B%22datasource%22:%22Loki%20(Application)%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7B%7D%22%7D%5D,%22range%22:%7B%22from%22:%22now-1h%22,%22to%22:%22now%22%7D%7D" t=2022-06-21T13:54:09.69+0000 lvl=eror msg="Proxy request failed" err="tls: first record does not look like a TLS handshake"
      logger=context traceID=00000000000000000000000000000000 userId=1 orgId=1 uname=kube:admin t=2022-06-21T13:54:09.69+0000 lvl=eror msg="Request Completed" method=GET path=/api/datasources/proxy/1/loki/api/v1/query_range status=502 remote_addr=103.155.213.124 time_ms=8 duration=8.783931ms size=0 referer="https://grafana-openshift-logging.apps.kbharti-411-131.qe.devcluster.openshift.com/explore?orgId=1&left=%7B%22datasource%22:%22Loki%20(Appl

      Tested the integration with rojacob@redhat.com's workaround manifests and Grafana works fine in that case. Able to query app/audit/infra logs on grafana UI with no issue.

      CSV's tested:

      [kbharti@cube hack]$ oc get csv
      NAME                     DISPLAY                     VERSION    REPLACES   PHASE
      cluster-logging.5.5.0    Red Hat OpenShift Logging   5.5.0                 Succeeded
      loki-operator.5.5.0-18   Loki Operator               5.5.0-18              Succeeded
      

      Attachments

        Issue Links

          Activity

            People

              rojacob@redhat.com Robert Jacob
              rhn-support-kbharti Kabir Bharti
              Kabir Bharti Kabir Bharti
              Kabir Bharti Kabir Bharti
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: