Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3378

Scale up processing of change events

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Unresolved
    • Icon: Minor Minor
    • None
    • None
    • cassandra-connector
    • None
    • False
    • False
    • Undefined

      Increase the number of change event queues and queue processors to parallelize the processing and publishing of change events. Commit log files are only moved out from cdc_raw directory when all change events related with this file have been published to Kafka. Because of this, we want to make sure that change events are processed and published fast so that commit log files won't pile in cdc_raw directory, which will potentially cause write suspension in Cassandra DB.

              Unassigned Unassigned
              zhou.bing@husky.neu.edu Bingqin Zhou (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: