[2018-10-04 12:23:12,256] ERROR Failed to properly convert data value for 'demo.test_table.json_col' of type JSON for row [2, [100, 101, 102], []]: (io.debezium.relational.TableSchemaBuilder:200) org.apache.kafka.connect.errors.ConnectException: Failed to parse and read a JSON value on json_col JSON NOT NULL: null at io.debezium.connector.mysql.MySqlValueConverters.convertJson(MySqlValueConverters.java:341) at io.debezium.connector.mysql.MySqlValueConverters.lambda$converter$0(MySqlValueConverters.java:206) at io.debezium.relational.TableSchemaBuilder.lambda$createValueGenerator$2(TableSchemaBuilder.java:192) at io.debezium.relational.TableSchema.valueFromColumnData(TableSchema.java:135) at io.debezium.connector.mysql.RecordMakers$1.insert(RecordMakers.java:212) at io.debezium.connector.mysql.RecordMakers$RecordsForTable.create(RecordMakers.java:419) at io.debezium.connector.mysql.BinlogReader.handleInsert(BinlogReader.java:765) at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:435) at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1055) at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:913) at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:559) at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:793) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.EOFException at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:190) at com.github.shyiko.mysql.binlog.event.deserialization.json.JsonBinary.readValueType(JsonBinary.java:975) at com.github.shyiko.mysql.binlog.event.deserialization.json.JsonBinary.parse(JsonBinary.java:205) at com.github.shyiko.mysql.binlog.event.deserialization.json.JsonBinary.parse(JsonBinary.java:181) at com.github.shyiko.mysql.binlog.event.deserialization.json.JsonBinary.parseAsString(JsonBinary.java:168) at io.debezium.connector.mysql.MySqlValueConverters.convertJson(MySqlValueConverters.java:338) ... 12 more [2018-10-04 12:23:12,259] ERROR Error during binlog processing. Last offset stored = {ts_sec=1538626965, file=mysql-bin.000013, pos=11554, row=1, server_id=1, event=2}, binlog reader near position = mysql-bin.000013/11907 (io.debezium.connector.mysql.BinlogReader:969) [2018-10-04 12:23:12,259] ERROR Failed due to error: Error processing binlog event (io.debezium.connector.mysql.BinlogReader:179) org.apache.kafka.connect.errors.ConnectException: Invalid value: null used for required field: "json_col", schema type: STRING at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:200) at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:178) at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:451) at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1055) at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:913) at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:559) at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:793) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "json_col", schema type: STRING at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:220) at org.apache.kafka.connect.data.Struct.validate(Struct.java:233) at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:252) at org.apache.kafka.connect.data.Struct.put(Struct.java:216) at org.apache.kafka.connect.data.Struct.put(Struct.java:203) at io.debezium.data.Envelope.create(Envelope.java:262) at io.debezium.connector.mysql.RecordMakers$1.insert(RecordMakers.java:219) at io.debezium.connector.mysql.RecordMakers$RecordsForTable.create(RecordMakers.java:419) at io.debezium.connector.mysql.BinlogReader.handleInsert(BinlogReader.java:765) at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:435) ... 5 more [2018-10-04 12:23:12,259] INFO Error processing binlog event, and propagating to Kafka Connect so it stops this connector. Future binlog events read before connector is shutdown will be ignored. (io.debezium.connector.mysql.BinlogReader:456) [2018-10-04 12:23:12,603] INFO WorkerSourceTask{id=demo-mysql-connector-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397) [2018-10-04 12:23:12,603] INFO WorkerSourceTask{id=demo-mysql-connector-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414) [2018-10-04 12:23:12,603] ERROR WorkerSourceTask{id=demo-mysql-connector-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:177) org.apache.kafka.connect.errors.ConnectException: Invalid value: null used for required field: "json_col", schema type: STRING at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:200) at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:178) at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:451) at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1055) at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:913) at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:559) at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:793) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "json_col", schema type: STRING at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:220) at org.apache.kafka.connect.data.Struct.validate(Struct.java:233) at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:252) at org.apache.kafka.connect.data.Struct.put(Struct.java:216) at org.apache.kafka.connect.data.Struct.put(Struct.java:203) at io.debezium.data.Envelope.create(Envelope.java:262) at io.debezium.connector.mysql.RecordMakers$1.insert(RecordMakers.java:219) at io.debezium.connector.mysql.RecordMakers$RecordsForTable.create(RecordMakers.java:419) at io.debezium.connector.mysql.BinlogReader.handleInsert(BinlogReader.java:765) at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:435) ... 5 more [2018-10-04 12:23:12,604] ERROR WorkerSourceTask{id=demo-mysql-connector-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:178) [2018-10-04 12:23:12,604] INFO Stopping MySQL connector task (io.debezium.connector.mysql.MySqlConnectorTask:245) [2018-10-04 12:23:12,604] INFO Stopping the binlog reader (io.debezium.connector.mysql.ChainedReader:121) [2018-10-04 12:23:12,605] INFO [Producer clientId=demo-mysql-connector-dbhistory] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (org.apache.kafka.clients.producer.KafkaProducer:1103) [2018-10-04 12:23:12,605] INFO Stopped reading binlog after 1 events, last recorded offset: {ts_sec=1538626965, file=mysql-bin.000013, pos=11554, row=1, server_id=1, event=2} (io.debezium.connector.mysql.BinlogReader:930) [2018-10-04 12:23:12,607] INFO Connector task finished all work and is now shutdown (io.debezium.connector.mysql.MySqlConnectorTask:276)