Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3378

Scale up processing of change events

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Unresolved
    • Minor
    • None
    • None
    • cassandra-connector
    • None
    • False
    • False
    • Undefined

    Description

      Increase the number of change event queues and queue processors to parallelize the processing and publishing of change events. Commit log files are only moved out from cdc_raw directory when all change events related with this file have been published to Kafka. Because of this, we want to make sure that change events are processed and published fast so that commit log files won't pile in cdc_raw directory, which will potentially cause write suspension in Cassandra DB.

      Attachments

        Activity

          Public project attachment banner

            context keys: [headless, issue, helper, isAsynchronousRequest, project, action, user]
            current Project key: DBZ

            People

              Unassigned Unassigned
              zhou.bing@husky.neu.edu Bingqin Zhou (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: