Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7050

Support snapshot with automatic retry

XMLWordPrintable

    • Icon: Feature Request Feature Request
    • Resolution: Done
    • Icon: Major Major
    • 2.5.0.Alpha1
    • None
    • vitess-connector
    • None

      Feature request or enhancement

      Add automatic retry to Debezium Vitess Connector snapshots.

      In DBZ-5930 snapshot support was added without automatic retry. There have been changes/fixes in upstream vitess to make the vgtid an opaque state representation of how far along a snapshot is (e.g., https://github.com/vitessio/vitess/pull/12623). We can parse and use this vgtid information in order to allow for automatic retry of a snapshot upon failure.

      Which use case/requirement will be addressed by the proposed feature?

      This is a crucial feature for large production tables where snapshots will take a long time and we cannot guarantee the tasks will be able to run for the entirety of the snapshot. With the current logic there is not auto-retry or failure recovery. Meaning users have to start again from the beginning which can be very expensive/time-consuming.

      Implementation ideas (optional)

      Will put out a PR

            Unassigned Unassigned
            tthorn Thomas Thornton
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: