Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5815

Queries - Sql server property file

    XMLWordPrintable

Details

    • False
    • None
    • False

    Description

      Below is the configuration file which we are using to create the connector :

       

      {
        "name": "sql-server-kafkacdc-idm-all-001",
        "config":

      {     "snapshot.mode": "initial_schema_only",     "connector.class": "io.debezium.connector.sqlserver.SqlServerConnector",     "database.hostname": "localhost",     "database.port": "1433",     "database.user": "cdc_idm_owner",     "database.password": "cdcIdm@2022",     "database.dbname": "kafkacdc",     "database.server.name": "kafkacdc",     "tasks.max": "1",     "decimal.handling.mode": "string",     "tombstones.on.delete": false,     "table.include.list": "dbo.idm_workorder,dbo.idm_workorder_activity",     "transforms": "Reroute",     "transforms.Reroute.type": "io.debezium.transforms.ByLogicalTableRouter",     "transforms.Reroute.topic.regex": "(.*)",     "transforms.Reroute.topic.replacement": "debezium_events",     "database.history":"io.debezium.relational.history.MemoryDatabaseHistory"    }

      }

       

      Query 1: Our expectation from the above configuration is to push events to event hub "debezium_events" whenever there's a change captured from tables mentioned in the "table.include.list". But events are pushed to "debezium_events" whenever there are changes in other CDC enabled tables also which isn't expected. Pls let us know how to segregate this routing. 

      Note: We don't want to restrict "transforms.Reroute.topic.regex" to any specific string

       

      Query 2: What's the significance of "database.history" in the property file? What should be the value ideally? 

      Attachments

        1. AssetsProperty.json
          0.9 kB
        2. AssetsProperty-1.json
          0.8 kB
        3. ConnectLog.txt
          5 kB
        4. EventsProperty.json
          0.8 kB
        5. image-2022-11-14-13-45-14-431.png
          image-2022-11-14-13-45-14-431.png
          29 kB
        6. image-2022-11-14-13-45-43-118.png
          image-2022-11-14-13-45-43-118.png
          27 kB
        7. RoutingBehavior.pptx
          41 kB

        Activity

          People

            Unassigned Unassigned
            anvitha.bonthala Anvitha Bonthala (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: