Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-215

Validate that database.server.name and database.history.kafka.topic have different values

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Optional Optional
    • 0.5.1
    • 0.5
    • mysql-connector
    • None

      Setting up from scrach, the connector successfully snapshot and then recieves updates from the binlog.
      If Kakfa Connect is restarted for whatever reason, the following message will appear:

      [2017-04-07 00:43:59,721] INFO Kafka version : 0.10.2.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:83)
      [2017-04-07 00:43:59,721] INFO Kafka commitId : 0003bb14a2acad37 (org.apache.kafka.common.utils.AppInfoParser:84)
      [2017-04-07 00:43:59,747] INFO Discovered coordinator localhost:9092 (id: 2147483647 rack: null) for group pushdb-connector-dbhistory. (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:573)
      [2017-04-07 00:43:59,754] INFO Revoking previously assigned partitions [] for group pushdb-connector-dbhistory (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393)
      [2017-04-07 00:43:59,754] INFO (Re-)joining group pushdb-connector-dbhistory (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:407)
      [2017-04-07 00:43:59,828] INFO Successfully joined group pushdb-connector-dbhistory with generation 11 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:375)
      [2017-04-07 00:43:59,828] INFO Setting newly assigned partitions [pushdb-0] for group pushdb-connector-dbhistory (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:252)
      [2017-04-07 00:44:00,409] INFO Stopping MySQL connector task (io.debezium.connector.mysql.MySqlConnectorTask:218)
      [2017-04-07 00:44:00,410] ERROR Failed to start the connector (see other exception), but got this error while cleaning up (io.debezium.connector.mysql.MySqlConnectorTask:183)
      java.lang.NullPointerException
              at io.debezium.connector.mysql.MySqlConnectorTask.stop(MySqlConnectorTask.java:220)
              at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:180)
              at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:141)
              at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:139)
              at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:182)
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
              at java.lang.Thread.run(Thread.java:745)
      [2017-04-07 00:44:00,411] ERROR Task pushdb-connector-0 threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:141)
      org.apache.kafka.connect.errors.ConnectException: java.lang.NullPointerException
              at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:192)
              at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:141)
              at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:139)
              at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:182)
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.NullPointerException
              at io.debezium.relational.history.HistoryRecordComparator.isSameSource(HistoryRecordComparator.java:60)
              at io.debezium.relational.history.HistoryRecordComparator.isAtOrBefore(HistoryRecordComparator.java:52)
              at io.debezium.relational.history.AbstractDatabaseHistory.lambda$recover$0(AbstractDatabaseHistory.java:53)
              at io.debezium.relational.history.KafkaDatabaseHistory.recoverRecords(KafkaDatabaseHistory.java:202)
              at io.debezium.relational.history.AbstractDatabaseHistory.recover(AbstractDatabaseHistory.java:52)
              at io.debezium.connector.mysql.MySqlSchema.loadHistory(MySqlSchema.java:312)
              at io.debezium.connector.mysql.MySqlTaskContext.loadHistory(MySqlTaskContext.java:116)
              at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:80)
              ... 8 more
      [2017-04-07 00:44:00,411] ERROR Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:142)
      [2017-04-07 00:44:00,411] INFO Closing the Kafka producer with timeoutMillis = 30000 ms. (org.apache.kafka.clients.producer.KafkaProducer:689)
      

            gunnar.morling Gunnar Morling
            captain.magnus_jira Magnus Boman (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: