Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-305

Upgrade Docker images to Kafka 0.11.0.0

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Done
    • Major
    • 0.6
    • None
    • None
    • None

    Description

      The update should be seemless.

      An interesting improvement is better isolation between plug-ins for Kafka Connect. We'd have to adapt the set-up a bit to make use of the new "plugin.path" property and re-arrange the way our current connectors are put into archives. We agreed the simplest would be to have one fully independent plug-in per connector, i.e. the DBZ core JAR would be contained in each one of those. It means a bit of duplication, but makes things easier overall and the plug-ins truely independent, e.g. in terms of updates.

      One thing to keep in mind is implicitly created topics with a default replication factor of three which will break the tutorial as per Randall:

      I guess one thing to note when upgrading to 0.11.0.0. The distributed worker now will create the topics used to store configs, offsets, and statuses. You can specify in the worker config the partition count and replication factor for each of those internal topics. However, the default for the replication factor is 3, which is good for production but means you need 3 brokers.

      Attachments

        Issue Links

          Activity

            People

              jpechane Jiri Pechanec
              gunnar.morling Gunnar Morling
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: