Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3623

Support invisible columns with MySql 8.0.23+

    XMLWordPrintable

Details

    Description

      Context:

      • Mysql 8.0.25 (a primary and two secondaries with group replication)
      • Debezium Mysql Connector 1.5.Final
      • Mysql Connector connects to Mysql via proxysql (always connect to the master node)

       

      Issue:

      The Mysql connector stopped running after Mysql upgrade from 8.0.21 to 8.0.25, which triggered failover from node3 to node1

       

      Logs:

       

      {"@timestamp":"2021-06-12T06:24:48.226+00:00","@version":"1","message":"MySQL current GTID set 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-62497200 does contain the GTID set required by the connector 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-58043340","logger_name":"io.debezium.connector.mysql.MySqlConnectorTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.233+00:00","@version":"1","message":"GTIDs known by the server but not processed yet 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:58043341-62497200, for replication are available only 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:58043341-62497200","logger_name":"io.debezium.connector.mysql.MySqlConnectorTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.240+00:00","@version":"1","message":"Requested thread factory for connector MySqlConnector, id = my-debezium named = binlog-client","logger_name":"io.debezium.util.Threads","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"GTID set purged on server: 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-44877726","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"Attempting to generate a filtered GTID set","logger_name":"io.debezium.connector.mysql.MySqlTaskContext","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"GTID set from previous recorded offset: 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-58043340","logger_name":"io.debezium.connector.mysql.MySqlTaskContext","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"GTID set available on server: 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-62497200","logger_name":"io.debezium.connector.mysql.MySqlTaskContext","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"Using first available positions for new GTID channels","logger_name":"io.debezium.connector.mysql.MySqlTaskContext","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"Relevant GTID set available on server: 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-62497200","logger_name":"io.debezium.connector.mysql.MySqlTaskContext","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"Final merged GTID set to use when connecting to MySQL: 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-58043340","logger_name":"io.debezium.connector.mysql.MySqlTaskContext","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"Registering binlog reader with GTID set: 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-58043340","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.247+00:00","@version":"1","message":"Creating thread debezium-mysqlconnector-my-debezium-binlog-client","logger_name":"io.debezium.util.Threads","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.250+00:00","@version":"1","message":"Creating thread debezium-mysqlconnector-my-debezium-binlog-client","logger_name":"io.debezium.util.Threads","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"INFO","level_value":20000}
      Jun 12, 2021 6:24:48 AM com.github.shyiko.mysql.binlog.BinaryLogClient connect
      INFO: Connected to mysqlservername-proxysql-lb.internal.com:3306 at 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-58043340 (sid:5850, cid:878853)
      {"@timestamp":"2021-06-12T06:24:48.264+00:00","@version":"1","message":"Connected to MySQL binlog at mysqlservername-proxysql-lb.internal.com:3306, starting at GTIDs 38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-58043340 and binlog file 'mysqlservername003_binlog.003372', pos=973999890, skipping 2 events plus 1 rows","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"INFO","level_value":20000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:48.264+00:00","@version":"1","message":"Waiting for keepalive thread to start","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.264+00:00","@version":"1","message":"Creating thread debezium-mysqlconnector-my-debezium-binlog-client","logger_name":"io.debezium.util.Threads","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"INFO","level_value":20000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:48.364+00:00","@version":"1","message":"Keepalive thread is running","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:48.464+00:00","@version":"1","message":"WorkerSourceTask{id=mysql-connector-tranform-0} Source task finished initialization and start","logger_name":"org.apache.kafka.connect.runtime.WorkerSourceTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"connector.context":"[mysql-connector-tranform|task-0] "}
      {"@timestamp":"2021-06-12T06:24:49.970+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117193995","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.970+00:00","@version":"1","message":"Error while deserializing binlog event at offset {ts_sec=1623398220, file=mysqlservername001_binlog.003618, pos=117193925, gtids=38d9b9fb-5c3a-4f33-ae73-15b81adc9e9d:1-58043340, server_id=3179378664, event=1}.Use the mysqlbinlog tool to view the problematic event: mysqlbinlog --start-position=117194308 --stop-position=117194610 --verbose mysqlservername001_binlog.003618","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.970+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117193995","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.971+00:00","@version":"1","message":"Failed due to error: Error processing binlog event","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"stack_trace":"org.apache.kafka.connect.errors.ConnectException: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1623398220000, eventType=EXT_UPDATE_ROWS, serverId=3179378664, headerLength=19, dataLength=283, nextPosition=117194610, flags=0}at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230)at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:207)at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:604)at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1100)at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:951)at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:594)at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)at java.base/java.lang.Thread.run(Thread.java:834)Caused by: java.lang.RuntimeException: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1623398220000, eventType=EXT_UPDATE_ROWS, serverId=3179378664, headerLength=19, dataLength=283, nextPosition=117194610, flags=0}at io.debezium.connector.mysql.BinlogReader.handleServerIncident(BinlogReader.java:672)at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:587)... 5 common frames omittedCaused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1623398220000, eventType=EXT_UPDATE_ROWS, serverId=3179378664, headerLength=19, dataLength=283, nextPosition=117194610, flags=0}at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:301)at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:224)at io.debezium.connector.mysql.BinlogReader$1.nextEvent(BinlogReader.java:249)at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:930)... 3 common frames omittedCaused by: com.github.shyiko.mysql.binlog.event.deserialization.MissingTableMapEventException: No TableMapEventData has been found for table id:867. Usually that means that you have started reading binary log 'within the logical event group' (e.g. from WRITE_ROWS and not proceeding TABLE_MAPat com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:104)at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserializeRows(UpdateRowsEventDataDeserializer.java:71)at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:58)at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:33)at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:295)... 6 common frames omitted","dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.971+00:00","@version":"1","message":"Error processing binlog event, and propagating to Kafka Connect so it stops this connector. Future binlog events read before connector is shutdown will be ignored.","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"INFO","level_value":20000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.972+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117194811","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.972+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117195624","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.972+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117196436","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.973+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117197247","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.973+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117198065","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.973+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117198880","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.973+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117199692","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:49.974+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/117200507","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}{"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"WorkerSourceTask{id=mysql-connector-tranform-0} Task threw an uncaught and unrecoverable exception","logger_name":"org.apache.kafka.connect.runtime.WorkerTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"ERROR","level_value":40000,"stack_trace":"org.apache.kafka.connect.errors.ConnectException: nullat io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230)at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:196)at io.debezium.connector.mysql.BinlogReader$ReaderThreadLifecycleListener.onEventDeserializationFailure(BinlogReader.java:1147)at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:943)at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:594)at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)at java.base/java.lang.Thread.run(Thread.java:834)Caused by: java.lang.NullPointerException: nullat com.github.shyiko.mysql.binlog.event.deserialization.TableMapEventMetadataDeserializer.deserialize(TableMapEventMetadataDeserializer.java:50)at com.github.shyiko.mysql.binlog.event.deserialization.TableMapEventDataDeserializer.deserialize(TableMapEventDataDeserializer.java:47)at com.github.shyiko.mysql.binlog.event.deserialization.TableMapEventDataDeserializer.deserialize(TableMapEventDataDeserializer.java:27)at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:295)at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeTableMapEventData(EventDeserializer.java:273)at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:220)at io.debezium.connector.mysql.BinlogReader$1.nextEvent(BinlogReader.java:249)at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:930)... 3 common frames omitted","connector.context":"[mysql-connector-tranform|task-0] "}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"WorkerSourceTask{id=mysql-connector-tranform-0} Task is being killed and will not recover until manually restarted","logger_name":"org.apache.kafka.connect.runtime.WorkerTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"ERROR","level_value":40000,"connector.context":"[mysql-connector-tranform|task-0] "}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"Stopping down connector","logger_name":"io.debezium.connector.common.BaseSourceTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"connector.context":"[mysql-connector-tranform|task-0] "}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"Stopping MySQL connector task","logger_name":"io.debezium.connector.mysql.MySqlConnectorTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/118381698","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"ChainedReader: Stopping the binlog reader","logger_name":"io.debezium.connector.mysql.ChainedReader","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"Discarding 0 unsent record(s) due to the connector shutting down","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/118382515","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/118383329","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:50.244+00:00","@version":"1","message":"Error during binlog processing. Last offset stored = null, binlog reader near position = mysqlservername001_binlog.003618/118384145","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"ERROR","level_value":40000,"dbz.connectorType":"MySQL","dbz.connectorContext":"binlog","dbz.connectorName":"my-debezium"}
      {"@timestamp":"2021-06-12T06:24:50.247+00:00","@version":"1","message":"Stopped reading binlog after 0 events, no new offset was recorded","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"blc-mysqlservername-proxysql-lb.internal.com:3306","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","dbz.connectorContext":"binlog"}
      {"@timestamp":"2021-06-12T06:24:50.247+00:00","@version":"1","message":"Discarding 0 unsent record(s) due to the connector shutting down","logger_name":"io.debezium.connector.mysql.BinlogReader","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:50.247+00:00","@version":"1","message":"[Producer clientId=mysql-connector-tranform-dbhistory] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.","logger_name":"org.apache.kafka.clients.producer.KafkaProducer","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:50.249+00:00","@version":"1","message":"Connector task finished all work and is now shutdown","logger_name":"io.debezium.connector.mysql.MySqlConnectorTask","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"dbz.connectorName":"my-debezium","dbz.connectorType":"MySQL","connector.context":"[mysql-connector-tranform|task-0] ","dbz.connectorContext":"task"}
      {"@timestamp":"2021-06-12T06:24:50.249+00:00","@version":"1","message":"[Producer clientId=connector-producer-mysql-connector-tranform-0] Closing the Kafka producer with timeoutMillis = 30000 ms.","logger_name":"org.apache.kafka.clients.producer.KafkaProducer","thread_name":"task-thread-mysql-connector-tranform-0","level":"INFO","level_value":20000,"connector.context":"[mysql-connector-tranform|task-0] "}
      {"@timestamp":"2021-06-12T06:24:51.247+00:00","@version":"1","message":"WorkerSourceTask{id=mysql-connector-tranform-0} Committing offsets","logger_name":"org.apache.kafka.connect.runtime.WorkerSourceTask","thread_name":"SourceTaskOffsetCommitter-1","level":"INFO","level_value":20000,"connector.context":"[mysql-connector-tranform|task-0|offsets] "}
      

       

       

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              tinntsea Tin Nguyen (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: