-
Enhancement
-
Resolution: Obsolete
-
Major
-
None
-
False
-
-
False
Feature request or enhancement
For feature requests or enhancements, provide this information, please:
Which use case/requirement will be addressed by the proposed feature?
Today, Debezium writes individual change records. This can be configured using a Converter such as JsonConverter or AvroConverter.
I propose to add an ArrowConverter/ParquetConverter that can write RecordBatches in Arrow format
Implementation ideas (optional)
One challenge is that Arrow works on RecordBatches while we currently provide a List of ChangeRecords to the sinks (in DBZ Server).