Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1886

Don't try to database history topic if it exists already

    XMLWordPrintable

Details

    Description

      Currently db history topic is created automatically.
      Even if topic is in place, the `history.exists()` returns false unless there is some data in the topic.
      This means, `initializeStorage` always executes topic creation when connector starts for the first time. In terms of security ACLs topic creation requires extra permissions on Cluster level, which is not desired in some environments.

      https://docs.confluent.io/4.0.0/kafka/authorization.html#acl-format
      https://kafka.apache.org/documentation/#operations_resources_and_protocols

      So while topic could be already pre-created manually, `initializeStorage` may still fail (because of ACL rules) with the very confusing error:
      >> Creation of database history topic failed, please create the topic manually

      It would be good to have a config switch for auto-creation of database history topic

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ivan-klass Ivan Klass (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: