Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-2160

[Logging 5.4]Logs under openshift-* projects are sent to app* index when using fluentd as collector

    XMLWordPrintable

Details

    • False
    • False
    • NEW
    • VERIFIED
    • Before this update, the change of the path from which the collector reads container logs caused certain records to be forwarded to the wrong indices. With this update, the collector now uses the correct configuration to resolve the issue.
    • Logging (Core) - Sprint 213, Logging (Core) - Sprint 214

    Description

      Description of problem:

      Logs under openshift-* projects are sent to app* index:

      $ oc exec elasticsearch-cdm-7gic0ozw-1-7458ffb455-kw6qz -- es_util --query=app*/_search?pretty |grep "namespace_name"
      Defaulted container "elasticsearch" out of: elasticsearch, proxy
                  "namespace_name" : "openshift-image-registry",
                  "namespace_name" : "openshift-image-registry",
                  "namespace_name" : "openshift-multus",
                  "namespace_name" : "openshift-multus",
                  "namespace_name" : "openshift-kube-storage-version-migrator",
                  "namespace_name" : "openshift-kube-storage-version-migrator",
                  "namespace_name" : "openshift-kube-storage-version-migrator",
                  "namespace_name" : "openshift-kube-storage-version-migrator",
                  "namespace_name" : "openshift-kube-storage-version-migrator",
                  "namespace_name" : "openshift-kube-storage-version-migrator", 

      I find in fluent.conf, the source directory is changed from `/var/log/containers/` to `/var/log/pods/`, but I'm not sure if it's the root cause:

      http://pastebin.test.redhat.com/1023797 

      Version-Release number of selected component (if applicable):

      cluster-logging.5.4.0-37

      How reproducible:

      Always

      Steps to Reproduce:

      1. deploy logging 
      2. check data in ES

      Actual results:

      Expected results:

      Additional info: 

      no such issue when testing with cluster-logging.5.4.0-36

      Attachments

        Activity

          People

            vparfono Vitalii Parfonov
            qitang@redhat.com Qiaoling Tang
            Qiaoling Tang Qiaoling Tang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: