Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2713

Reduce latency for MongoDB streaming in high transactions/second environments

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Unresolved
    • Major
    • 1.9-backlog
    • 1.4.0.Alpha1
    • mongodb-connector
    • None
    • False
    • False
    • Undefined

    Description

      The connector uses a tryNext call to the MongoDB Cursor which is created using a TailableAwait type configuration. The documentation for this cursor type seems to indicate that MongoDB will apply its own "pause" mechanism if the batch it returns is empty to avoid high cpu utilization for loops that use this non-blocking IO strategy. If that's indeed the case, the Metronome isn't required and only adds additional latency that could be eliminated for high transactions/second environments to reduce event latency.

      See conversation https://gitter.im/debezium/user?at=5f9c3715d5a5a635f28eb78e

      Attachments

        Activity

          People

            Unassigned Unassigned
            ccranfor@redhat.com Chris Cranford
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: