Uploaded image for project: 'OpenShift Request For Enhancement'
  1. OpenShift Request For Enhancement
  2. RFE-7905

Adding buffer max_size setting to vector log forwarder sink

XMLWordPrintable

    • Icon: Feature Request Feature Request
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • openshift-4.16
    • Logging
    • None
    • None
    • Product / Portfolio Work
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

       [1] Proposed title of this feature request
      -> Adding buffer max_size setting to Vector

       [2] What is the nature and description of the request?
      -> Our customer is asking us to set a higher buffer max size for one of their log forwarder sinks (outputs). After reading OpenShift and Vector documentation, we concluded that this specific buffer.max_size setting is not directly configurable through the ClusterLogForwarder or ClusterLogging custom resources in OpenShift Logging. However, when we check the Vector config file (vector.toml) that is mounted to the collector pods, we can see the default buffer max_size is set to 268435488 bytes. This max_size is not sufficient for our customer and needs to be increased.

       [3] Why does the customer need this? (List the business requirements here)
      ->  Customer has a high-volume logging environment. Their applications experience bursting and sustained high log throughput. Without sufficient buffer, Vector may drop logs or fail under pressure. Increasing max_size allows for a better handling of log spikes, preventing data loss during high activity periods (e.g.,deployment rollouts).

       

      [4] List any affected packages or components.
      ->  Monitoring

              jamparke@redhat.com Jamie Parker
              rhn-support-hthakare Harshal Thakare
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                None
                None