Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7184

Use buffer queue when reading MongoDB change stream events

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 2.5.0.Beta1
    • 2.5.0.Alpha2
    • mongodb-connector
    • None
    • False
    • None
    • False

      In order to mitigate the impact of batch fetching when processing MongoDB change events we should continuously pre-fetch change events into a buffer queue. This way new changes can be accumulated while processing previous changes.

      This was already prototyped during the recent MongoDB performance assessment and the approached posed roughly 20% increase in connector's performance.

            jcechace@redhat.com Jakub Čecháček
            jcechace@redhat.com Jakub Čecháček
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: