Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4180

Pluggable topic selector

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Done
    • Major
    • 2.0.0.Beta1
    • None
    • core-library
    • None

    Description

      The default TopicSelector routes messages to the topics named like <database>.<schema>.<table>. If a different routing logic is required, an org.apache.kafka.connect.transforms.RegexRouter SMT is usually added to the connector configuration.

      The challenge is that the object name separator in the default topic selector (the dot)  may also be part of a database object name.

      In multi-tenant environments, where the object names aren't restricted by a naming convention, a table named accounts.bak may break the logic implemented in an SMT that doesn't account for a dot in the object name.

      In cases like this, it would be more reliable to use a custom topic selector rather than a regex-based SMT.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sergeimorozov Sergei Morozov
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: