Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7086

Support writing Parquet format

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False

      Feature request or enhancement

      For feature requests or enhancements, provide this information, please:

      Which use case/requirement will be addressed by the proposed feature?

      Today, Debezium writes individual change records. This can be configured using a Converter such as JsonConverter or AvroConverter.

      I propose to add an ArrowConverter/ParquetConverter that can write RecordBatches in Arrow format

      Implementation ideas (optional)

      One challenge is that Arrow works on RecordBatches while we currently provide a List of ChangeRecords to the sinks (in DBZ Server). 

              Unassigned Unassigned
              zalmane Oren Elias (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: