Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2378

debezium not work during the snapshot phase

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Blocker
    • None
    • 1.2.1.Final
    • sqlserver-connector
    • None

    Description

       Kafka connect configuration information is as follows:

      name=MDS_ITCND_LOG_37_SqlServerConnector
      connector.class=io.debezium.connector.sqlserver.SqlServerConnector
      tasks.max=1
      database.history.kafka.bootstrap.servers=****
      database.history.kafka.topic=CDC-MDS-his.dbo.ITCND_LOG_37
      database.hostname=****
      database.port=1433
      database.applicationIntent=ReadOnly
      database.user=bdcuser
      database.password=@User=****
      database.dbname=MDS
      database.server.name=CDC-MDS
      table.whitelist=dbo.ITCND_LOG_37
      snapshot.isolation.mode=snapshot
      poll.interval.ms=2000
      transforms=unwrap
      transforms.unwrap.drop.tombstones=false
      transforms.unwrap.type=io.debezium.transforms.ExtractNewRecordState
      

      when I submit the configure above, the kafka connect service print lots of warning: 

      kafka_kafka-connector.1.tfibc2d6k4fy@CP70-bigdata-005 | [2020-07-24 04:24:49,310] WARN [Producer clientId=connector-producer-MDS_ITCND_LOG_37_SqlServerConnector-0] Error while fetching metadata with correlation id 1184 : {CDC-MDS=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
      

      Obviously, the topic CDC-MDS is wrong, which should be CDC-MDS.dbo.ICTND_LOG_37. What is puzzling is that the connectors that are executing the incremental synchronization do not report errors. The problem only occurs with the newly submitted connectors which need to synchronize historical data. 

      But the problem did not appear in version 1.1.0, I have not encountered this problem before. I suspect it is a bug created by 1.2.x. 

      Attachments

        Activity

          People

            Unassigned Unassigned
            cobolbaby xing-long zhang (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: