Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-443

New snapshotting mode for recovery of DB history topic

    XMLWordPrintable

    Details

    • Type: Feature Request
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 0.7.2
    • Component/s: mysql-connector
    • Labels:
      None

      Description

      Our organization spoke with Randall Hauch last week to discuss the options for recovering the db-history topic should it be lost or corrupted in some way.

      Our schemas do not change very often (every couple weeks at most), so we are in a situation where if we lost the db-history topic, we could theoretically use the schema_only mode to regenerate this topic. However, when we tried this, the snapshot stamps the current binlog position for all the generated DDL statements. So when we restart the connector pointing to the new db-history topic, it cannot pickup at the position it left off because it has no DDL history yet at this position.

      So we discussed the possibility of a implementing "forced" schema_only mode. This would re-snapshot the schema only for a running connector, and set the binlog position for the generated DDL to the current position of the connector.

      This will only work in a use case where we know there have been no effective DDL changes during the recovery period.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              pgoransson Peter Goransson
              Reporter:
              pgoransson Peter Goransson
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: