Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3595

Pulsar sink tries to convert null key to string

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 1.6.0.Beta2
    • 1.5.2.Final
    • debezium-server
    • None

      I'm using debezium server to CDC the table data from oracle to pulsar.when I run the script run.sh,I got the error

      message " 2021-06-07 17:39:09,887 INFO [io.deb.ser.ConnectorLifecycle] (pool-3-thread-1) Connector completed: success = 'false', message = 'Stopping connector after error in the application's handler method: Unexpected data type 'null'', error = '{}': io.debezium.DebeziumException: Unexpected data type 'null'
      at io.debezium.server.BaseChangeConsumer.getString(BaseChangeConsumer.java:71)
      at io.debezium.server.pulsar.PulsarChangeConsumer.handleBatch(PulsarChangeConsumer.java:123)
      at io.debezium.embedded.ConvertingEngineBuilder.lambda$notifying$2(ConvertingEngineBuilder.java:83)
      at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:821)
      at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:188)
      at io.debezium.server.DebeziumServer.lambda$start$1(DebeziumServer.java:142)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)"
      

      I think the reason is the source table has none primary key.

      Then I got the solution by Naros to use oracle connector parameter "message.key.columns".

      Why  the property "debezium.sink.pulsar.null.key" can not resove this?

              jpechane Jiri Pechanec
              happyshf Tim Xu (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: