Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4878

Re-read incremental snapshot chunk on DDL event

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Minor Minor
    • 1.9.0.CR1
    • 1.9.0.Beta1
    • mysql-connector
    • None
    • False
    • None
    • False
    • Hide

      It's hard to reproduce deterministically. The events order when the issue will happen:
      1. open snapshot window
      2. select chunk
      3. alter table's schema
      4. close snapshot window

      Show
      It's hard to reproduce deterministically. The events order when the issue will happen: 1. open snapshot window 2. select chunk 3. alter table's schema 4. close snapshot window

      A new schema can be applied to the chunk with an old schema if DDL event is within the chunk select window.

      The chunk's JDBC schema in this case is the same as before. Schema change won't be detected. The binlog schema will get updated with the DDL event. The chunk is inserted after window close event. The events mapping uses the latest schema for the chunk.

      The fix is simple: re-read chunk on DDL event. In this case chunk will have schema that is up to date with the binlog schema.

        1. image-2022-03-16-23-35-51-475.png
          image-2022-03-16-23-35-51-475.png
          43 kB

              Unassigned Unassigned
              kgalieva Kate Galieva (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: