Uploaded image for project: 'Observability Documentation'
  1. Observability Documentation
  2. OBSDOCS-118

Configuring JSON log data for Elasticsearch is defined incorrectly

    XMLWordPrintable

Details

    • 3
    • False
    • Hide

      None

      Show
      None
    • True
    • OBSDOCS (Jan 22 - Feb 12) #248

    Description

      The examples for enabling should be adjusted to correctly define the feature. "outputDefaults" applies to the default output only. This is a managed version of Elasticsearch offered by logging and referred to in CLF as "default". There is a similar functionality available for a defined instance of an Elasticsearch output, but the defaults do not "merge" into the customer defined instance. This is what is implied now.

      For instance, the following example (in documentation) is correct for the default ES logstore that is defined in CL:

      outputDefaults:
       elasticsearch:
          structuredTypeKey: kubernetes.labels.logFormat 
          structuredTypeName: nologformat
      pipelines:
      - inputRefs: <application>
        outputRefs: default
        parse: json
      

      but further down the example listed here should be somethign like:

      outputDefaults:
       elasticsearch:
          structuredTypeKey: kubernetes.labels.managed 
          structuredTypeName: nologformat
      outputs:
      - output:
        name: elasticsearch-secure
        elasticsearch:
          structuredTypeKey: openshift.labels.unmanaged 
          structuredTypeName: nologformat
      pipelines:
       - name: application-logs
         inputRefs:
         - application
         - audit
         outputRefs:
         - elasticsearch-secure
         - default
         parse: json
         labels:
           myLabel: myValue
      

      Where it is explicitly mentioned that "OutputDefaults" applies only to the default logstore and not other defined Elasticsearch outputs. Any place where we reference "default" in context of json parsing this is OK, otherwise we should include an example of an Elasticsearch output

       

       

       

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jcantril@redhat.com Jeffrey Cantrill
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: