Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5902

Create a more generic SMT to route events to specific partition

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Done
    • Major
    • 2.2.0.CR1
    • 1.9.6.Final
    • mysql-connector
    • None
    • False
    • None
    • False

    Description

      Many tables are connected to a database and sent to the same kafka topic. This kafka topic has multiple partitions, and the downstream receives real-time tasks to consume this topic. Now, it is hoped that the data with the same table name can always be sent to one kafka according to the table name. topic, this requirement is very important. In practical applications, this requirement is very extensive. I hope that the debezium community can focus on supporting this requirement

       

      I hope that debezium official can support setting parameters in the connector, so that the data of the same table can always be sent to the same topic partition

       

      Similar to my usage as follows
       
        "transforms":"InsertSource",
         "transforms.InsertSource.type":"org.apache.kafka.connect.transforms.InsertField$Value",
          "transforms.InsertSource.static.field":"hdfs_path_tableName",
          "transforms.InsertSource.static.value":"alltablename"
       
      I am very much looking forward to the official support of this function. This function is in great demand in practical applications. thank you very much

       

       

      Attachments

        Issue Links

          Activity

            People

              rh-ee-mvitale Mario Fiore Vitale
              fy18759 fei yang
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: