Details
-
Bug
-
Resolution: Done
-
Critical
-
0.3
-
None
Description
One connector start up and snapshot is complete. restarting connector fails to read the bingo and worker will stop.
Here is the first step when snapshot is complete.
[2016-08-26 18:21:33,017] INFO Step 8: - 3851 of 3851 rows scanned from table 'CCCC' after 00:00:00.904 (io.debezium.connector.mysql.SnapshotReader:364) [2016-08-26 18:21:33,022] INFO Step 8: - scanning table 'CCCCC' (6 of 6 tables) (io.debezium.connector.mysql.SnapshotReader:346) [2016-08-26 18:21:33,115] INFO Step 8: - 1473 of 1473 rows scanned from table 'VVVVVV' after 00:00:00.093 (io.debezium.connector.mysql.SnapshotReader:364) [2016-08-26 18:21:33,118] INFO Step 8: scanned 10052 rows in 6 tables in 00:00:01.596 (io.debezium.connector.mysql.SnapshotReader:389) [2016-08-26 18:21:33,118] INFO Step 9: committing transaction (io.debezium.connector.mysql.SnapshotReader:424) [2016-08-26 18:21:33,120] INFO Completed snapshot in 00:00:02.704 (io.debezium.connector.mysql.SnapshotReader:436) [2016-08-26 18:22:30,116] INFO Finished WorkerSourceTask{id=debizium-connector-tst-new101-0} commitOffsets successfully in 157 ms (org.apache.kafka.connect.runtime.WorkerSourceTask:356)
Here is exception after restarting the connector
[2016-08-26 18:38:54,489] ERROR Task debizium-connector-tst-new101-0 threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:142) org.apache.kafka.connect.errors.ConnectException: The connector is trying to read binlog starting at GTIDs 036d85a9-64e5-11e6-9b48-42010af0000c:1-2,7145bf69-d1ca-11e5-a588-0242ac110004:1-3200,7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-41 and binlog file 'mysql-bin.000004', pos=2306, row=0, but this is no longer available on the server. Reconfigure the connector to use a snapshot when needed. at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:104) at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:137) at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140) at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) view rawgistfile1.txt hosted with ❤ by GitHub
Here are the GTID values
+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------+ | Variable_name | Value | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------+ | gtid_executed | 036d85a9-64e5-11e6-9b48-42010af0000c:1-2, 7145bf69-d1ca-11e5-a588-0242ac110004:1-3202, 7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-41 | | gtid_executed_compression_period | 1000 | | gtid_mode | ON | | gtid_owned | | | gtid_purged | 7145bf69-d1ca-11e5-a588-0242ac110004:1-3092, 7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-39 | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------+ 5 rows in set (0.00 sec) mysql> show master status -> ; +------------------+----------+--------------+------------------+----------------------------------------------------------------------------------------------------------------------------------+ | File | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set | +------------------+----------+--------------+------------------+----------------------------------------------------------------------------------------------------------------------------------+ | mysql-bin.000004 | 2683 | | | 036d85a9-64e5-11e6-9b48-42010af0000c:1-2, 7145bf69-d1ca-11e5-a588-0242ac110004:1-3202, 7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-41 | +------------------+----------+--------------+------------------+----------------------------------------------------------------------------------------------------------------------------------+ 1 row in set (0.00 sec)
Attachments
Issue Links
- is related to
-
DBZ-107 Exception while setting GTID set on binlog client
- Closed