Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-511

New snapshot.mode to track schema changes and read from beginning of the bin logs

    XMLWordPrintable

Details

    • Feature Request
    • Resolution: Duplicate
    • Minor
    • None
    • None
    • mysql-connector
    • None
    • 0
    • 0% 0%

    Description

      Hi,

      I would like to request a new snapshot.mode for MySQL connector that tracks schema changes similar to schema_only mode and should generate events using the beginning of the current bin log file rather than reading the current binlog file at the time of snapshot which could mean we reading from recent events and discarding older events in the binlog file.

      In my case, I don't want to run Initial Snapshot which takes bootstrap from DB and emits events rather I wanted to use bin log file and connector should be aware any changes to the schema and data. Ultimately I could remove connector or I could reset offsets topic for some reason then re-add connector it should be able to generate events from current bin log file. It should not skip any events due to the downtime.

      Let me know if this makes sense or further clarification required.

      Thanks,
      Kasun Don

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              kasundon Kasun Don (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: