Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7184

Use buffer queue when reading MongoDB change stream events

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 2.5.0.Beta1
    • 2.5.0.Alpha2
    • mongodb-connector
    • None
    • False
    • None
    • False

      In order to mitigate the impact of batch fetching when processing MongoDB change events we should continuously pre-fetch change events into a buffer queue. This way new changes can be accumulated while processing previous changes.

      This was already prototyped during the recent MongoDB performance assessment and the approached posed roughly 20% increase in connector's performance.

              jcechace@redhat.com Jakub Čecháček
              jcechace@redhat.com Jakub Čecháček
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: