Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-5174

compression is not enable for Elasticsearch output

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • NEW
    • NEW
    • Release Note Not Required
    • Log Collection - Sprint 250
    • Informational

      Description of problem:

      compression can not be added into vector.toml. Vector can forward logs to Elasticsearch 8 when I set compression=glib or zlib in vector.toml

      Version-Release number of selected component (if applicable):

      How reproducible:

      Always

      Steps to Reproduce:

      1. Deploy CLF with tuning options

      cat <<EOF |  oc apply -f -
      apiVersion: logging.openshift.io/v1
      kind: ClusterLogForwarder
      metadata:
        name:  clf-logs
      spec:
        inputs:
        - application:
            namespaces:
            - project-qa-1
          name: myLogsQA
        outputs:
        - name: elasticsearch
          elasticsearch:
            version: 8
          secret:
            name: to-es-secret
          type: elasticsearch
          tuning:
            compression: 'gzip'
            delivery: AtMostOnce
            maxWrite: 10M
            minRetryDuration: 5
            maxRetryDuration: 10
          url: https://elasticsearch-server.es-aosqe.svc:9200
        pipelines:
        - inputRefs:
          - myLogsQA
          name:  pipe1
          outputRefs:
          - elasticsearch
        serviceAccountName: clf-to-es
      EOF

      1.  Check the vector.toml
      2. ...

      Actual results:

      compression: gzip isn't enabled  in vector.toml

      Expected results:

      Additional info:

              rh-ee-calee Calvin Lee
              rhn-support-anli Anping Li
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: