Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-409

Allow easy consumption of MongoDB CDC events by other connectors

    XMLWordPrintable

Details

    • Feature Request
    • Resolution: Done
    • Major
    • 0.7.2
    • 0.6
    • mongodb-connector
    • None
    • 0
    • 0% 0%

    Description

      Right now we are serializing the JSON object into one of message fields and sent them into Kafka. The problem is that sink connectors (like Elasticsearch, maybe kafka streams have the same requirement) can have a problems to consume message in such format. We should then

      • either provide an SMT to extract the serialized message and convert it into Struct
      • or provide a configuration option in MongoDB connector to store the content as {{Structt} instead of serialized form

      Attachments

        Issue Links

          is related to

          Feature Request - Feature requests from customers and/or users DBZ-561 Provide option to flatten structs in MongoDB unwrapping SMT

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Feature Request - Feature requests from customers and/or users DBZ-562 MongoDB retrieval SMT: add support for arrays of arrays

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Feature Request - Feature requests from customers and/or users DBZ-563 Add option for dropping deletes and tombstone events to MongoDB struct recreation SMT

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Activity

            People

              Unassigned Unassigned
              jpechane Jiri Pechanec
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: