Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-278

MySQL connector should automatically create database history topic

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 0.7.3
    • 0.5
    • mysql-connector
    • None

      Kafka clients are not able to explicitly create topics without resorting to Kafka server-side libraries that require Zookeeper clients, and thus rely upon Kafka to auto-create them when needed or to have users explicitly pre-create them ahead of time. Auto-creation requires setting up the broker's default topic-settings.

      Kafka 0.11.0.0 will have a new AdminClient (see KIP-117) that allows normal Kafka Clients to explicitly manage topics. The MySQL Connector should use this to create the database history topic.

      Kafka Connect will be changing to automatically create topics that are needed for a source connector's SourceRecord objects (see KIP-158), so this is what we should rely upon for normal topics. It is currently scheduled to be in 0.11.1.0.

              jpechane Jiri Pechanec
              rhauch Randall Hauch (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: