Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-6937

MySql connector get NPE when snapshot.mode is set to never and signal data collection configured

XMLWordPrintable

      Bug report

      For bug reports, provide this information, please:

      What Debezium connector do you use and what version?

      <Your answer>

      What is the connector configuration?

      {
        "name": "inventory-connector",  
        "config": {  
          "connector.class": "io.debezium.connector.mysql.MySqlConnector",
          "tasks.max": "1",  
          "database.hostname": "mysql",  
          "database.port": "3306",
          "database.user": "debezium",
          "database.password": "dbz",
          "database.server.id": "184054",  
          "database.ssl.mode": "disabled",
          "topic.prefix": "dbserver1",  
          "database.include.list": "inventory",  
          "schema.history.internal.kafka.bootstrap.servers": "kafka:9092",  
          "schema.history.internal.kafka.topic": "schema-changes.inventory",
          "signal.data.collection": "inventory.debezium_signal",
          "snapshot.mode": "never"
        }
      }
       

      What is the captured database version and mode of depoyment?

      (E.g. on-premises, with a specific cloud provider, etc.)

      <Your answer>

      What behaviour do you expect?

      <Your answer>

      What behaviour do you see?

      <Your answer>

      Do you see the same behaviour using the latest relesead Debezium version?

      (Ideally, also verify with latest Alpha/Beta/CR version)

      <Your answer>

      Do you have the connector logs, ideally from start till finish?

      2023-09-18 14:18:46,660 ERROR  MySQL|dbserver1|binlog  Producer failure   [io.debezium.pipeline.ErrorHandler]
      2023-09-18T14:18:46.660951600Z io.debezium.DebeziumException: Error processing binlog event
      2023-09-18T14:18:46.660954141Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:395)
      2023-09-18T14:18:46.660956561Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$27(MySqlStreamingChangeEventSource.java:930)
      2023-09-18T14:18:46.660958926Z     at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1246)
      2023-09-18T14:18:46.660961123Z     at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1072)
      2023-09-18T14:18:46.660963214Z     at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:631)
      2023-09-18T14:18:46.660965359Z     at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:932)
      2023-09-18T14:18:46.660967437Z     at java.base/java.lang.Thread.run(Thread.java:829)
      2023-09-18T14:18:46.660969669Z Caused by: java.lang.NullPointerException
      2023-09-18T14:18:46.660971832Z     at io.debezium.pipeline.source.snapshot.incremental.AbstractIncrementalSnapshotChangeEventSource.processSchemaChange(AbstractIncrementalSnapshotChangeEventSource.java:144)
      2023-09-18T14:18:46.660974453Z     at io.debezium.pipeline.EventDispatcher.dispatchSchemaChangeEvent(EventDispatcher.java:370)
      2023-09-18T14:18:46.660976691Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleQueryEvent(MySqlStreamingChangeEventSource.java:607)
      2023-09-18T14:18:46.660979003Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$15(MySqlStreamingChangeEventSource.java:901)
      2023-09-18T14:18:46.660981326Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:375)
      2023-09-18T14:18:46.660983581Z     ... 6 more
      2023-09-18T14:18:46.661153948Z 2023-09-18 14:18:46,661 INFO   MySQL|dbserver1|binlog  Error processing binlog event, and propagating to Kafka Connect so it stops this connector. Future binlog events read before connector is shutdown will be ignored.   [io.debezium.connector.mysql.MySqlStreamingChangeEventSource]
      2023-09-18T14:18:46.665109512Z 2023-09-18 14:18:46,664 ERROR  ||  WorkerSourceTask{id=inventory-connector-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted   [org.apache.kafka.connect.runtime.WorkerTask]
      2023-09-18T14:18:46.665125961Z org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
      2023-09-18T14:18:46.665128547Z     at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67)
      2023-09-18T14:18:46.665131208Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:395)
      2023-09-18T14:18:46.665133485Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$27(MySqlStreamingChangeEventSource.java:930)
      2023-09-18T14:18:46.665134941Z     at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1246)
      2023-09-18T14:18:46.665136316Z     at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1072)
      2023-09-18T14:18:46.665137731Z     at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:631)
      2023-09-18T14:18:46.665139096Z     at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:932)
      2023-09-18T14:18:46.665140595Z     at java.base/java.lang.Thread.run(Thread.java:829)
      2023-09-18T14:18:46.665141963Z Caused by: io.debezium.DebeziumException: Error processing binlog event
      2023-09-18T14:18:46.665143708Z     ... 7 more
      2023-09-18T14:18:46.665146117Z Caused by: java.lang.NullPointerException
      2023-09-18T14:18:46.665148454Z     at io.debezium.pipeline.source.snapshot.incremental.AbstractIncrementalSnapshotChangeEventSource.processSchemaChange(AbstractIncrementalSnapshotChangeEventSource.java:144)
      2023-09-18T14:18:46.665151627Z     at io.debezium.pipeline.EventDispatcher.dispatchSchemaChangeEvent(EventDispatcher.java:370)
      2023-09-18T14:18:46.665153909Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleQueryEvent(MySqlStreamingChangeEventSource.java:607)
      2023-09-18T14:18:46.665155989Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$15(MySqlStreamingChangeEventSource.java:901)
      2023-09-18T14:18:46.665158290Z     at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:375)
      2023-09-18T14:18:46.665169715Z     ... 6 more
      2023-09-18T14:18:46.665338917Z 2023-09-18 14:18:46,665 INFO   ||  Stopping down connector   [io.debezium.connector.common.BaseSourceTask]

              rh-ee-mvitale Mario Fiore Vitale
              rh-ee-mvitale Mario Fiore Vitale
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: