Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-18127

Investigate Loki's structured_metadata

XMLWordPrintable

    • Icon: Spike Spike
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • openstack-cloudkitty
    • None

      TODO: Identify goal, timebox and outcome.

      Summary:

      • The current implementation of CloudKitty is storing everything in Loki in pure unstructured json. This format is perfect for logs, which are normally quite diverse on their structure, but within our CloudKitty use case, we know in advance the structure of our json, as CloudKitty uses the base object called "point" to perform all its operations. The point structure is very well known, so the fields could be stored as structured metadata instead of unstructured json.

      This will make queries much more efficient, as Loki will not need to go through every single json to see if it matches with the query.

      However, structured metadata is quite a recent addition to Loki and the possibility of using it requires experimentantion and discovery.

      Goal:

      • Define what success looks like for this investigation.

      TimeBox:

      • Specify the maximum amount of time we want to invest 

      Deliverables/Outcomes:

      • Specify what artifacts or outcomes are expected (e.g., documentation, blog post, confluence page, or Epic & Stories that capture the next steps).
      • …

              rhn-engineering-jlarriba Juan Larriba
              rhn-engineering-jlarriba Juan Larriba
              rhos-conplat-observability
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: