Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-666

Enable ordered snapshotting of data-Mysql Connector

    XMLWordPrintable

Details

    Description

      Currently the way debezium snapshots data in data inclusive mode is by reading the schemas in order and then reading 1 table at a time based upon the outcome of *SHOW FULL TABLES IN *

      This is good for most of the use cases but for cases when order needs to be maintained even for data snapshots, this approach wont work. One such use case would be event sourcing where we want a sequence of state-changing events which may need data across multiple tables.

      In such cases if we have table B and then then Table A which depends on B, then we may want Table B to be snapshotted first and then Table A.

      Note that this mode is applicable only when data inclusive snapshots are being performed because binlog parsing provides data in the order its written to the DB.

      I propose adding another field which gives the users the flexibilty to add tables in the order they want to have them snapshotted(in the format <schema>.<table>). Note that when this option is specified, then no other whitelist/blacklist modes should be allowed.

      Attachments

        Activity

          People

            Unassigned Unassigned
            vamossagar12 Sagar Rao (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: