Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2338

LSNs in replication slots are not monotonically increasing

    XMLWordPrintable

    Details

      Description

      Upon restart PostgreSQL connector takes the LSN stored in offets and filters out all changes coming from database with lower LSN. The reason is that database can re-send events already seen by Debezium.

      The problem is that with parallel transactions it can happen that they are not stored in order of their LSNs. Genrally the tx that starts first has lower LSN but the one that is committed first is first written into the replication slot.

      This can be a problem in connector restart when we can have higher LSN already stored in the offset but a tx with lower LSN can still arrive.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              jpechanec Jiri Pechanec
              Reporter:
              jpechanec Jiri Pechanec
              Votes:
              3 Vote for this issue
              Watchers:
              9 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: