Uploaded image for project: 'Observability and Data Analysis Program'
  1. Observability and Data Analysis Program
  2. OBSDA-333

Allow configuration of persistent storage for file buffers for the Vector log collector

XMLWordPrintable

      1. Proposed title of this feature request

      Allow configuration of persistent storage for file buffers for the Vector log collector

      2. What is the nature and description of the request?

      There is no solution available to configure persistent storage for theĀ  cluster logging collector file buffers to avoid loss of data.

      3. Why does the customer need this? (List the business requirements here)

      By default, the fluent.conf uses directories under "/var/lib/fluentd" for storing file buffers pending transfer to long-term storage in ElasticSearch. While ElasticSearch can be configured with persistent storage, the collector file buffers can not, meaning that whenever collector pod restart, logs in buffer will be lost. if destination is down, collector pod might fill out memory then get restarted(OOM).

      4. List any affected packages or components.

      • OpenShift Cluster Logging
      • fluentd/collector pods

              jamparke@redhat.com Jamie Parker
              rhn-support-choule Claude Houle
              Votes:
              19 Vote for this issue
              Watchers:
              27 Start watching this issue

                Created:
                Updated:
                Resolved: