Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-4597

Modify vector buffer and request to have fluentd parity

XMLWordPrintable

    • 1
    • False
    • None
    • False
    • NEW
    • NEW
    • Hide
      Prior to this change, vector collector deployments relied upon the default retry and buffering behavior. This could lead to the delivery pipeline being backed up trying to deliver every message when the availability of an output was unstable. This fix modifies the configuration to have parity with earlier releases of alternate collectors to limit the number of message retries and to drop messages once the threshold is exceeded.
      Show
      Prior to this change, vector collector deployments relied upon the default retry and buffering behavior. This could lead to the delivery pipeline being backed up trying to deliver every message when the availability of an output was unstable. This fix modifies the configuration to have parity with earlier releases of alternate collectors to limit the number of message retries and to drop messages once the threshold is exceeded.
    • Enhancement
    • Proposed
    • Log Collection - Sprint 243

      Summary

      The fluent collector was modified in a prior release (5.6?) to discard undeliverable messages after a configured time period (1h) in order to not block delivery pipelines. The default behavior of vector is to block and try indefinitely in order to not lose any messages. We believe this has lead to reported issues of high CPU and memory utilization, ref: LOG-4518, LOG-4536, LOG-4561

      Acceptance Criteria

      • Verify messages to an output that goes up and down are either delivered or dropped and messages continue to flow

        1. screenshot-1.png
          screenshot-1.png
          30 kB

            [LOG-4597] Modify vector buffer and request to have fluentd parity

            GitLab CEE Bot added a comment -

            CPaaS Service Account mentioned this issue in merge request !4223 of openshift-logging / Log Collection Midstream on branch openshift-logging-5.8-rhel-9_upstream_6c51165b32bdf30145c2075123aa76a9:

            Updated US source to: e4279a4 LOG-4597: Revert back to default behavior and block when full buffer

            GitLab CEE Bot added a comment - CPaaS Service Account mentioned this issue in merge request !4223 of openshift-logging / Log Collection Midstream on branch openshift-logging-5.8-rhel-9_ upstream _6c51165b32bdf30145c2075123aa76a9 : Updated US source to: e4279a4 LOG-4597 : Revert back to default behavior and block when full buffer

            Errata Tool added a comment -

            Since the problem described in this issue should be resolved in a recent advisory, it has been closed.

            For information on the advisory (Logging Subsystem 5.8.0 - Red Hat OpenShift), and where to find the updated files, follow the link below.

            If the solution does not work for you, open a new bug report.
            https://access.redhat.com/errata/RHBA-2023:6139

            Errata Tool added a comment - Since the problem described in this issue should be resolved in a recent advisory, it has been closed. For information on the advisory (Logging Subsystem 5.8.0 - Red Hat OpenShift), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2023:6139

            Anping Li added a comment -

            Verified on Logging 5.8.0 cluster-logging-rhel9-operator/images/v5.8.0-186

            Anping Li added a comment - Verified on Logging 5.8.0 cluster-logging-rhel9-operator/images/v5.8.0-186

            GitLab CEE Bot added a comment -

            CPaaS Service Account mentioned this issue in a merge request of openshift-logging / Log Collection Midstream on branch openshift-logging-5.8-rhel-9_upstream_a3176f33c737a4037720ee66f9a901dc:

            Updated US source to: 78a1e1a Merge pull request #2200 from syedriko/syedriko-log-4589

            GitLab CEE Bot added a comment - CPaaS Service Account mentioned this issue in a merge request of openshift-logging / Log Collection Midstream on branch openshift-logging-5.8-rhel-9_ upstream _a3176f33c737a4037720ee66f9a901dc : Updated US source to: 78a1e1a Merge pull request #2200 from syedriko/syedriko-log-4589

            Jeffrey Cantrill added a comment -

            cc abrennan@redhat.com landerso@redhat.com  Once this lands it really should be added to the 5.8.0 release notes for a more obvious notification of "change".  I'm betting we will backport this to 5.7 but I will defer that until later

            Jeffrey Cantrill added a comment - cc abrennan@redhat.com landerso@redhat.com   Once this lands it really should be added to the 5.8.0 release notes for a more obvious notification of "change".  I'm betting we will backport this to 5.7 but I will defer that until later

            Jeffrey Cantrill added a comment -

            Chose defaults based upon fluentd settings and how those translate to available vector config

            Jeffrey Cantrill added a comment - Chose defaults based upon fluentd settings and how those translate to available vector config

              jcantril@redhat.com Jeffrey Cantrill
              jcantril@redhat.com Jeffrey Cantrill
              Anping Li Anping Li
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: