Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2

Ingest change data from MongoDB databases

XMLWordPrintable

    • Icon: Feature Request Feature Request
    • Resolution: Done
    • Icon: Blocker Blocker
    • 0.3
    • None
    • mongodb-connector
    • None

      Add support for monitoring MongoDB databases by tailing the oplog and writing those changes to Kafka using Kafka Connect.

      This involves creating a Kafka Connect source connector for MongoDB that creates source tasks as needed. Each source task remotely connects to a MongoDB database and tails the oplog to extract and return the individual data change events that include, among other things, the position in the oplog where the event was read. When run as part of Kafka Connect, the resulting data change events will be recorded in Kafka logs, and if anything fails Kafka Connect will figure out what was last successfully written and restart a source task to start reading from the next point.

      The connector should ideally provide the same behavior as the MySQL connector, although because this is a non-relational DB this may not be possible. Where possible, this connector should also use the same configuration fields as other connectors.

            rhauch Randall Hauch (Inactive)
            rhauch Randall Hauch (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: