Details
-
Bug
-
Resolution: Done
-
Major
-
Logging 5.1
-
False
-
False
-
NEW
-
NEW
-
Undefined
-
Logging (Core) - Sprint 204
Description
Description of problem:
The unicode messages like `ㄅㄉˇˋㄓˊ˙ㄚㄞㄢㄦㄆ 中国 883.317µs ā á ǎ à ō ó ▅ ▆ ▇ █ 々` are displayed as `"message": "�������������������������������� ������ 883.317��s �� �� �� �� �� �� ��� ��� ��� ��� ���"` in ES/Kibana
{
"_index": "app-000002",
"_type": "_doc",
"_id": "MDdhYTdiZmQtYWFjNy00MzFkLTlhYzUtYjBlZGM2NjRjZGQ5",
"_version": 1,
"_score": null,
"_source": {
"kubernetes": {
"container_image_id": "quay.io/openshifttest/ocp-logtest@sha256:f23bea6f669d125f2f317e3097a0a4da48e8792746db32838725b45efa6c64a4",
"container_name": "centos-logtest",
"namespace_id": "83d4bf8c-681c-4ef8-9ca3-9a8758ce6ed6",
"flat_labels": [
"run=centos-logtest",
"test=centos-logtest"
],
"host": "qitang-xxxxxxx",
"master_url": "https://kubernetes.default.svc",
"pod_id": "8d8fcf0f-2a95-4b64-8364-526f4e6ab6fa",
"namespace_labels": {
"kubernetes_io/metadata_name": "qitang"
},
"container_image": "quay.io/openshifttest/ocp-logtest@sha256:f23bea6f669d125f2f317e3097a0a4da48e8792746db32838725b45efa6c64a4",
"namespace_name": "qitang",
"pod_name": "centos-logtest-699rm"
},
"viaq_msg_id": "MDdhYTdiZmQtYWFjNy00MzFkLTlhYzUtYjBlZGM2NjRjZGQ5",
"level": "unknown",
"message": "�������������������������������� ������ 883.317��s �� �� �� �� �� �� ��� ��� ��� ��� ���",
"docker": {
"container_id": "911f731827d666c0442a33a81b632bcd9839aee641f95c5308fb22051d7b8868"
},
"hostname": "qitang-xxxx",
"@timestamp": "2021-07-14T01:34:21.549933+00:00",
"pipeline_metadata": {
"collector": {
"received_at": "2021-07-14T01:34:22.230709+00:00",
"name": "fluentd",
"inputname": "fluent-plugin-systemd",
"version": "1.7.4 1.6.0",
"ipaddr4": "10.0.128.3"
}
}
},
"fields": {
"@timestamp": [
"2021-07-14T01:34:21.549Z"
],
"pipeline_metadata.collector.received_at": [
"2021-07-14T01:34:22.230Z"
]
},
"sort": [
1626226461549
]
}
Version-Release number of selected component (if applicable):
cluster-logging.5.1.0-72
How reproducible:
always
Steps to Reproduce:
1. deploy logging
2. create pod to generate unicode messages with https://raw.githubusercontent.com/openshift/verification-tests/master/testdata/logging/loggen/container_json_unicode_log_template.json
3. check logs in Kibana/Elasticsearch
Actual results:
"message": "�������������������������������� ������ 883.317��s �� �� �� �� �� �� ��� ��� ��� ��� ���"
Expected results:
"message": "ㄅㄉˇˋㄓˊ˙ㄚㄞㄢㄦㄆ 中国 883.317µs ā á ǎ à ō ó ▅ ▆ ▇ █ 々"
Additional info:
No such issue when testing with cluster-logging.5.1.0-70
