Details
-
Bug
-
Resolution: Done
-
Major
-
1.2.0.Final
-
None
Description
We ran into this issue recently when trying to add tables to an existing connector:
Everything runs fine but when getting close to finishing parallel reading, an NPE is thrown:
[2020-07-28 04:32:31,602] ERROR [dbz-stingray-9|task-0] db.debezium.mysql.stingray Failed due to error: Error processing binlog event (BinlogReader:208) July 27th 2020, 21:32:32.415 org.apache.kafka.connect.errors.ConnectException at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230) at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:207) at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:600) at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1130) at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:978) at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:581) at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:860) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at io.debezium.connector.mysql.ParallelSnapshotReader$ParallelHaltingPredicate.accepts(ParallelSnapshotReader.java:228) at io.debezium.connector.mysql.AbstractReader.enqueueRecord(AbstractReader.java:332) at io.debezium.heartbeat.HeartbeatImpl.forcedBeat(HeartbeatImpl.java:99) at io.debezium.heartbeat.HeartbeatImpl.heartbeat(HeartbeatImpl.java:78) at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:586) ... 5 more
the relevant DBZ code line is here: https://github.com/debezium/debezium/blob/master/debezium-connector-mysql/src/main/java/io/debezium/connector/mysql/ParallelSnapshotReader.java#L228
I'm not totally clear under what circumstances an event will have sourceInfo without a timestamp, but this seems to be what is causing the NPE.
