Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-2794

unreadable message in ES when origin logs include Non-English characters

    XMLWordPrintable

Details

    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Before this update, non latin characters displayed incorrectly in Elasticsearch. With this update Elasticsearch displays all valid UTF-8 symbols correctly.
    • QE Confirmed

    Description

      unreadable message in ES when the original logs is ㄅㄉˇˋㄓˊ˙ㄚㄞㄢㄦㄆ 中国 883.317µs ā á ǎ à ō ó ▅ ▆ ▇ █ 々

      "message" : "�������������������������������� ������ 883.317��s �� �� �� �� �� �� ��� ��� ��� ��� ���",

      Logging 5.4.2

      Steps to reproduce:
      1) create Non-English characters log genernate pod
      oc new-app https://raw.githubusercontent.com/openshift/verification-tests/master/testdata/logging/loggen/container_json_unicode_log_template.json
      2) Forward logs to ES
      3) check the record in ES

      oc exec it -n openshift-logging $ESPOD -c elasticsearch – es_util --query=app*/_search?pretty -d '{
      "query": {
      "bool" : {
      "must" : [
      { "match" : { "kubernetes.namespace_name": "<pod_namespace_name>" }}
      ]
      },
      "size": 10
      }'

      Attachments

        Issue Links

          Activity

            People

              vparfono Vitalii Parfonov
              rhn-support-anli Anping Li
              Anping Li Anping Li
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: