Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-111

Debezium failed to read after snapshot is complete

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Critical
    • 0.3.1, 0.4
    • 0.3
    • mysql-connector
    • None

    Description

      One connector start up and snapshot is complete. restarting connector fails to read the bingo and worker will stop.

      Here is the first step when snapshot is complete.

      [2016-08-26 18:21:33,017] INFO Step 8: - 3851 of 3851 rows scanned from table 'CCCC' after 00:00:00.904 (io.debezium.connector.mysql.SnapshotReader:364)
      [2016-08-26 18:21:33,022] INFO Step 8: - scanning table 'CCCCC' (6 of 6 tables) (io.debezium.connector.mysql.SnapshotReader:346)
      [2016-08-26 18:21:33,115] INFO Step 8: - 1473 of 1473 rows scanned from table 'VVVVVV' after 00:00:00.093 (io.debezium.connector.mysql.SnapshotReader:364)
      [2016-08-26 18:21:33,118] INFO Step 8: scanned 10052 rows in 6 tables in 00:00:01.596 (io.debezium.connector.mysql.SnapshotReader:389)
      [2016-08-26 18:21:33,118] INFO Step 9: committing transaction (io.debezium.connector.mysql.SnapshotReader:424)
      [2016-08-26 18:21:33,120] INFO Completed snapshot in 00:00:02.704 (io.debezium.connector.mysql.SnapshotReader:436)
      [2016-08-26 18:22:30,116] INFO Finished WorkerSourceTask{id=debizium-connector-tst-new101-0} commitOffsets successfully in 157 ms (org.apache.kafka.connect.runtime.WorkerSourceTask:356)
      

      Here is exception after restarting the connector

      [2016-08-26 18:38:54,489] ERROR Task debizium-connector-tst-new101-0 threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:142)
      org.apache.kafka.connect.errors.ConnectException: The connector is trying to read binlog starting at GTIDs 036d85a9-64e5-11e6-9b48-42010af0000c:1-2,7145bf69-d1ca-11e5-a588-0242ac110004:1-3200,7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-41 and binlog file 'mysql-bin.000004', pos=2306, row=0, but this is no longer available on the server. Reconfigure the connector to use a snapshot when needed.
      	at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:104)
      	at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:137)
      	at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
      	at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      view rawgistfile1.txt hosted with ❤ by GitHub
      

      Here are the GTID values

      +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------+
      | Variable_name                    | Value                                                                                                                            |
      +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------+
      | gtid_executed                    | 036d85a9-64e5-11e6-9b48-42010af0000c:1-2,
      7145bf69-d1ca-11e5-a588-0242ac110004:1-3202,
      7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-41 |
      | gtid_executed_compression_period | 1000                                                                                                                             |
      | gtid_mode                        | ON                                                                                                                               |
      | gtid_owned                       |                                                                                                                                  |
      | gtid_purged                      | 7145bf69-d1ca-11e5-a588-0242ac110004:1-3092,
      7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-39                                           |
      +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------+
      5 rows in set (0.00 sec)
      
      mysql> show master status
          -> ;
      +------------------+----------+--------------+------------------+----------------------------------------------------------------------------------------------------------------------------------+
      | File             | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set                                                                                                                |
      +------------------+----------+--------------+------------------+----------------------------------------------------------------------------------------------------------------------------------+
      | mysql-bin.000004 |     2683 |              |                  | 036d85a9-64e5-11e6-9b48-42010af0000c:1-2,
      7145bf69-d1ca-11e5-a588-0242ac110004:1-3202,
      7c1de3f2-3fd2-11e6-9cdc-42010af000bc:1-41 |
      +------------------+----------+--------------+------------------+----------------------------------------------------------------------------------------------------------------------------------+
      1 row in set (0.00 sec)
      

      Attachments

        Issue Links

          Activity

            People

              rhauch Randall Hauch (Inactive)
              akshathpatkar Akshath Patkar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: