Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4878

Re-read incremental snapshot chunk on DDL event

    XMLWordPrintable

Details

    • False
    • None
    • False
    • Hide

      It's hard to reproduce deterministically. The events order when the issue will happen:
      1. open snapshot window
      2. select chunk
      3. alter table's schema
      4. close snapshot window

      Show
      It's hard to reproduce deterministically. The events order when the issue will happen: 1. open snapshot window 2. select chunk 3. alter table's schema 4. close snapshot window

    Description

      A new schema can be applied to the chunk with an old schema if DDL event is within the chunk select window.

      The chunk's JDBC schema in this case is the same as before. Schema change won't be detected. The binlog schema will get updated with the DDL event. The chunk is inserted after window close event. The events mapping uses the latest schema for the chunk.

      The fix is simple: re-read chunk on DDL event. In this case chunk will have schema that is up to date with the binlog schema.

      Attachments

        Activity

          People

            Unassigned Unassigned
            kgalieva Kate Galieva (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: