Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7631

Provide partition mode to guarantee order of events in same partition

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 2.6.0.CR1
    • None
    • cassandra-connector
    • None

      Which use case/requirement will be addressed by the proposed feature?

       

      When a connector reads commit logs, it processes them sequentially and inserts them into event queues. Currently, if there are multiple queues, events are distributed among the queues based on the hash of the file name. This behavior can result in messages from subsequent files being inserted into the Kafka broker before messages from the current file, which is not desirable.

      Implementation ideas (optional)

      I propose to change the hashing strategy to use the value of partition columns to guarantee the order of events within the same partitions.

       

      I will submit a PR myself for this issue.

              Unassigned Unassigned
              samssh Amir mohammad Sadat shokouhi (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: