Uploaded image for project: 'Distributed Tracing'
  1. Distributed Tracing
  2. TRACING-5715

Provide correlation mechanism to link metrics, traces and logs

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Not Selected

      As possible in Grafana, the feature to correlate Metrics exemplars with traces and traces with logs is highly interesting for customers as well as supporting the korrel8r from rhn-engineering-aconway 

      Even though OpenShift Monitoring might not scrape exemplars at the moment, technically we are able to scrape them with the OpenShift Monitoring stack since 4.16.

      From the experience and use of these correlations with Grafana, it's mandatory to understand that custom queries to correlate are highly appreciated compared to hardcoded lookups 

      A possible query from traces to logs could look like 

      { service_name=~".+"} |  trace_id="${__span.traceId}" 

      which removes the burden of guessing compared to time-range based correlation.

      One perfect use-case of such correlation already possible is OpenShift ServiceMesh which provides metrics, traces and logs with build-in envoy correlation
      The screenshot from Grafana below provides the `Log` icon which executes the query towards Loki for one. A similar style in OpenShift UIPlugin is what we are looking for.

              jamparke@redhat.com Jamie Parker
              rhn-support-milang Michaela Lang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: