Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7375

Request for clarification on SMT for combining CDC messages from multiple DB Tables to 1 Kafka Topic

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Minor Minor
    • None
    • 2.5.1.Final
    • oracle-connector
    • False
    • None
    • False

      Hello,

      I am attempting to determine the best way to configure the DBZ Oracle connector for downstream processing by the Iceberg sink connector.  We are planning on mirroring a large number of Oracle DB transactional and lookup tables in Iceberg, but the Iceberg sink connector config does not seem to accommodate the Kafka topic per physical db table that is the DBZ default.

      I was looking into using an SMT to route the messages from many tables to a single Kafka topic, but the Debezium documentation seemed to indicate that the tables being directed to a single topic must share the same schema (example calls out partitioned tables as an example) which would not work for my use case.

      Any advice or information you can provide on how best to configure DBZ to work with the Iceberg sink connector would be greatly appreciated.

      ccranfor@redhat.com , I am hoping you have some input here.

      Thanks in advance,

      Chris Whelan 

       

       

            Unassigned Unassigned
            chris.f.whelan@gmail.com Chris Whelan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: