Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4029

Support for heartbeat action queries for MySQL

    XMLWordPrintable

Details

    Description

      Hi team,

      We have a usecase where we are replicating mysql transactions along with 100 tables from a source and gtid enabled. These cdc events are then pushed into snowflake using a snowflake connector. The cdc events from the history tables are then loaded into staging tables using the GTIDs as watermarks.

      Usually the UUID portion in the GTID doesn't change and the transaction id is continually incrementing. But in the scenario when the mysql topology changes, the UUID and the transaction id changes. We need a way to be aware of this event when it happens so we can start using the new GTID to continue loading the events to staging.

      Is there a heartbeat event that can run every minute and detect this change and generate a new event with the new GTID? Something similar to what was done for (postgres)https://github.com/debezium/debezium/pull/1309/files?

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              abhishekkh-1 Abhishek Hodavdekar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: