Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1608

Generify ExtractNewRecordState to support pluggable Messaging systems

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Unresolved
    • Major
    • None
    • None
    • core-library
    • None

    Description

      Right now ExtractNewRecordState.java is tightly coupled and implemented based on Kafka. We are using Debezium with Apache Pulsar for CDC but one missing feature is the Record Transformation in producer side before publishing to the topic.

      As per the Apache Pulsar Transformation support in Github issue, tight coupling nature of ExtractNewRecordState with Kafka is a blocker. Instead of writing our implementation of ExtractNewRecordState for Pulsar, it would be best to Generify the ExtractNewRecordState class in debezium to support any messaging system (which should be configurable at connector setup).

      PS: The comment in the provided Github issue link is by official maintainer / contributor of Apache Pulsar. I am just an end user of Apache Pulsar.

      Attachments

        Issue Links

          is incorporated by

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) DBZ-1523 Support SMTs in embedded engine

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Activity

            People

              Unassigned Unassigned
              krnaveen14 Naveen Kumar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: