XMLWordPrintable

Details

    • False
    • None
    • False

    Description

      Which use case/requirement will be addressed by the proposed feature?

      Allow configuring connector to send incremental snapshot completion notifications into a Kafka topic.

      Implementation ideas (optional)

      Add an optional configuration property to switch between logging snapshot completion status (LogSnapshotStatusNotifications - default) and sending the notification into a Kafka topic (KafkaSnapshotStatusNotifications).

      A Kafka notification format:

      {{Key = `test_connector` }}
      Value = `{"id" : "1b8d98f4-53ec-4beb-aa14-73ea35f185e7", "type":"incremental-snapshot", "data-collections": "schema1.table1", "additional-condition" : "updated_at>='2022-09-20'", "status" : "SUCCEEDED"}`

      Snapshot completion statuses:
      {{}}

      EMPTY,
      NO_PRIMARY_KEY,
      SQL_EXCEPTION,
      STOPPED,
      SUCCEEDED,
      UNKNOWN_SCHEMA

       

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              kgalieva Kate Galieva (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: