Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-6170

Connect and stream from sharded clusters through mongos instances

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 2.2.0.Beta1
    • 2.2.0.Alpha2
    • mongodb-connector
    • None
    • False
    • None
    • False

      Currently for sharded clusters Debezium opens a connection to each shard's replica set directly for snapshot and streaming.

      While this approach should allow for a higher throughput due to utilised parallelism,[ it is not recommended by MongoDb|https://www.mongodb.com/docs/manual/sharding/#connecting-to-a-sharded-cluster]

      We should provide a way to utilise proper connection via mongos instance. However this solution should be backwards compatible – at least for the lifespan on 2.x release line.

      Additionally this will allow support of incremental snapshotting for sharded deployments as well as total ordering of captured change events.

              jcechace@redhat.com Jakub Čecháček
              jcechace@redhat.com Jakub Čecháček
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: