Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-8140

Validate log position method missing gtid info from SourceInfo

XMLWordPrintable

      We expect to print the GTID information of SourceInfo when the previous connector offset is not available, it will hellp us to figure out the cause of connector failure.

      connector offset info:
      ["test_source_v5",

      {"server":"txy_testnet_cht_rate_new"}

      ]

      {"transaction_id":null,"ts_sec":1723528676,"file":"mysql-bin.003812","pos":182209085,"gtids":"a61802a0-8917-11ee-beef-08c0eb46d56e:1-719173120","row":1,"server_id":1677731605,"event":2}
      [2024-08-13 06:07:26,391] ERROR [test_source_v5|task-0] WorkerSourceTask{id=test_source_v5-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:191)
      io.debezium.DebeziumException: The connector is trying to read binlog starting at SourceInfo [currentGtid=null, currentBinlogFilename=mysql-bin.003812, currentBinlogPosition=182209085, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery=null, tableIds=[], databaseName=null], but this is no longer available on the server. Reconfigure the connector to use a snapshot when needed.
      	at io.debezium.connector.mysql.MySqlConnectorTask.validateSnapshotFeasibility(MySqlConnectorTask.java:365)
      	at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:114)
      	at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:130)
      	at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)
      	at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:189)
      	at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:238)
      	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
      	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at java.base/java.lang.Thread.run(Thread.java:829)
      

            ywyuewei Harvey Yue (Inactive)
            ywyuewei Harvey Yue (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: