Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3158

Snapshot mode ALWAYS requires concurrent transaction for wal2json

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Do
    • Major
    • None
    • 1.4.1.Final
    • postgresql-connector
    • None
    • False
    • False
    • Undefined

    Description

      When snapshot mode ALWAYS is in place then

      • it queries current LSN
      • streams changes from lastest seen LSN till the current LSN
      • when the LSN coming from plugin matches or is large than the current LSN then th streaming is terminated and snapshot started

      Unfortunately, the second condition can happen for wal2json plugin only when a concurrent transaction is exectued. The problem is that wal2json changes comes as a single event so there is not exact LSN match and the last streamed change will not reach the current LSN. This issue disappears as soon as another transaction is executed as the streaming processing moves pass the target LSN and starts the snapshot

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jpechane Jiri Pechanec
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: