Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2792

Parallel write can be lost during catch-up phase

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 1.8.0.CR1
    • 1.4.0.Alpha2
    • postgresql-connector
    • None

      When catch-up phase is in progress and a parallel db write is executed it is possible that the write is lost as it is not neither caught by snapshot nor by stremaing pahse as it can get filtered.

      To reproduce check io.debezium.connector.postgresql.PostgresConnectorIT.shouldResumeStreamingFromSlotPositionForCustomSnapshotWal2Json() and execute it for decoderbufs. The LSN of the parallel write gets filtered due to LSN comparison. If the LSN filtering is disabled in the code the record gets in.

      This is problem only for custom snapshotters with shouldStreamEventsStartingFromSnapshot() set to false.

              ccranfor@redhat.com Chris Cranford
              jpechane Jiri Pechanec
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: