-
Bug
-
Resolution: Obsolete
-
Major
-
Logging 5.4.4
-
False
-
None
-
False
-
NEW
-
NEW
-
Log Collection - Sprint 225
CU have several OpenShift clusters and have a ClusterLogForwarder configured to send the logs to an external Elasticsearch instance.
This has worked without problems until yesterday there was an update of the Cluster Logging Operator from 5.4.2 to 5.4.4 - now we see these errors in the collector pod logs:
2022-08-05 06:10:34 +0000 [warn]: [external] failed to flush the buffer. retry_times=1 next_retry_time=2022-08-05 06:10:36 +0000 chunk="5e57852dccb4c3e647405770eb287171" error_class=Fluent::Plugin::ElasticsearchOutput::RecoverableRequestFailure error="could not push logs to Elasticsearch cluster (\{:host=>\"vvhu6001.power.inet\", :port=>50522, :scheme=>\"http\"}): undefined method `dig' for \"ok\":String" 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluent-plugin-elasticsearch-5.2.2/lib/fluent/plugin/out_elasticsearch.rb:1139:in `rescue in send_bulk' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluent-plugin-elasticsearch-5.2.2/lib/fluent/plugin/out_elasticsearch.rb:1101:in `send_bulk' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluent-plugin-elasticsearch-5.2.2/lib/fluent/plugin/out_elasticsearch.rb:879:in `block in write' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluent-plugin-elasticsearch-5.2.2/lib/fluent/plugin/out_elasticsearch.rb:878:in `each' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluent-plugin-elasticsearch-5.2.2/lib/fluent/plugin/out_elasticsearch.rb:878:in `write' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluentd-1.14.6/lib/fluent/plugin/output.rb:1179:in `try_flush' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluentd-1.14.6/lib/fluent/plugin/output.rb:1500:in `flush_thread_run' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluentd-1.14.6/lib/fluent/plugin/output.rb:499:in `block (2 levels) in start' 2022-08-05 06:10:34 +0000 [warn]: /usr/local/share/gems/gems/fluentd-1.14.6/lib/fluent/plugin_helper/thread.rb:78:in `block in thread_create'
