Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-6131

Support change stream filtering using MongoDB's aggregation pipeline step


    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 2.2.0.Alpha3
    • None
    • mongodb-connector
    • None
    • False
    • None
    • False

      Which use case/requirement will be addressed by the proposed feature?

      MongoDB Kafka Source Connector's pipeline property, which allows a user to configure:

      An array of aggregation pipelines to run in your change stream.

      For example:

      [{"$match": { "$and": [{"operationType": "insert"}, {"fullDocument.eventId": 1404 }] } }]

      This feature request is to support this capability in the Debezium MongoDB connector for both change stream and snapshot modes. This would also help to give parity with the Debezium Postgres connector's additional-condition configuration parameter for ad-hoc snapshots.

      Implementation ideas (optional)

      This has a dependency on https://issues.redhat.com/browse/DBZ-5102.

            Unassigned Unassigned
            btiernay Bob Tiernay (Inactive)
            0 Vote for this issue
            4 Start watching this issue