Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-2695

Loki - Stream-based Retention

    XMLWordPrintable

Details

    • Loki - Stream-based Retention
    • False
    • None
    • False
    • Not Selected
    • NEW
    • Done
    • OBSDA-7 - Adopting Loki as an alternative to Elasticsearch to support more lightweight, easier to manage/operate storage scenarios
    • Impediment
    • OBSDA-7Adopting Loki as an alternative to Elasticsearch to support more lightweight, easier to manage/operate storage scenarios
    • VERIFIED
    • 100
    • 100% 100%

    Description

      Goals

      1. Expose Loki's stream-based retention capabilities in the LokiStack custom resources for OpenShift Administrators.
      2. Expose Loki's stream-based retention capabilities in the LokiStack custom resource for OpenShift Application owners.

      Non-Goals

      1. Enable managing object storage retention policies via Loki-Operator managed custom resources.

      Motivation

      The Loki Operator manages LokiStack resources that consists of a set of Loki components for ingestion/quering and optionally a gateway microservice that ensures authenticated and authorized access to logs stored by Loki. Retention in Loki has always been global for a cluster and deferred to the underlying object store. Since v2.3.0 Loki can handle retention through the Compactor component. Retention can be configured per tenant and per stream. These different retention configurations allow storage cost control and meet security and compliance requirements in a more granular way. A common use case for custom policies is to delete high-frequency logs earlier than other (low-frequency) logs.

      Alternatives

      1. Continue with supporting retention policies only via the selected object storage provider.

      Acceptance Criteria

      1. The OpenShift Admnistrator can enable the retention via the LokiStack custom resource.
      2. The OpenShift Administrator can declare per-tenant and global policies through the LokiStack custom resource ordered by priority.

      Risk and Assumptions

      1. Assuming the OpenShift Administrators are the single eliglibable persona to configure stream-based retention polices for all application owners
      2. OpenShift Application owners can only delegate their retention policy requests w/o having access rights to edit the Lokistack custom resource.

      Documentation Considerations

      Open Questions

      Additional Notes

      1. Enhancement Proposal (Upstream): Loki Operator Stream-based Retention

      Attachments

        Issue Links

          Activity

            People

              ptsiraki@redhat.com Periklis Tsirakidis
              ptsiraki@redhat.com Periklis Tsirakidis
              Qiaoling Tang Qiaoling Tang
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: