Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3378

Scale up processing of change events

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Unresolved
    • Minor
    • None
    • None
    • cassandra-connector
    • None
    • False
    • False
    • Undefined

    Description

      Increase the number of change event queues and queue processors to parallelize the processing and publishing of change events. Commit log files are only moved out from cdc_raw directory when all change events related with this file have been published to Kafka. Because of this, we want to make sure that change events are processed and published fast so that commit log files won't pile in cdc_raw directory, which will potentially cause write suspension in Cassandra DB.

      Attachments

        Activity

          People

            Unassigned Unassigned
            zhou.bing@husky.neu.edu Bingqin Zhou (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: