Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-278

MySQL connector should automatically create database history topic

    XMLWordPrintable

    Details

    • Type: Enhancement
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: 0.5
    • Fix Version/s: 0.7.3
    • Component/s: mysql-connector
    • Labels:
      None

      Description

      Kafka clients are not able to explicitly create topics without resorting to Kafka server-side libraries that require Zookeeper clients, and thus rely upon Kafka to auto-create them when needed or to have users explicitly pre-create them ahead of time. Auto-creation requires setting up the broker's default topic-settings.

      Kafka 0.11.0.0 will have a new AdminClient (see KIP-117) that allows normal Kafka Clients to explicitly manage topics. The MySQL Connector should use this to create the database history topic.

      Kafka Connect will be changing to automatically create topics that are needed for a source connector's SourceRecord objects (see KIP-158), so this is what we should rely upon for normal topics. It is currently scheduled to be in 0.11.1.0.

        Attachments

          Activity

            People

            Assignee:
            jpechanec Jiri Pechanec
            Reporter:
            rhauch Randall Hauch
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: