Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7585

Snapshot skipping records

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 2.6.0.Final
    • 2.5.2.Final
    • debezium-server
    • None
    • Critical

      Debezium Server 2.5.2.Final

      Source: Azure Sql Server

      Sink: Azure Event Hubs

      What behaviour do you expect?

      Snapshot not skipping records sent to Azure Event Hub

      What behaviour do you see?

      Snapshot skipping records sent to Azure Event Hub

      Follow up ticket out of zulip discussion

      https://debezium.zulipchat.com/#narrow/stream/348252-community-sqlserver/topic/Snapshot.20missing.20records.2C.20skips.20every.2079.2F80.20records

      Seems like the record being added to the batch for processing, gets marked as processed, even it was never part of the batch.

      https://github.com/debezium/debezium-server/blob/main/debezium-server-eventhubs/src/main/java/io/debezium/server/eventhubs/EventHubsChangeConsumer.java#L181

      https://github.com/debezium/debezium-server/blob/main/debezium-server-eventhubs/src/main/java/io/debezium/server/eventhubs/BatchManager.java#L110

      Not processed events should never be "lost". 

            vjuranek@redhat.com Vojtech Juranek
            devployment Daniel Weinand
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: