Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-390 Data are read from the binlog and not written into kafka
  3. DBZ-406

Modify BinlogReader to support transactions of unlimited size

XMLWordPrintable

    • Icon: Sub-task Sub-task
    • Resolution: Done
    • Icon: Major Major
    • 0.7.0
    • 0.6
    • mysql-connector
    • None

      DBZ-405 enables buffering of transactions but only of limited pre-configured size. If the transaction is bigger than configured buffer than the BinlogReader shold log a WARN message. Then it should continue with processing of binlog reader till the transaction is ended.
      If the transaction ends with ROLLBACK then buffer is cleared and normal processing continues. If it ends with commit then BinaryLogClient is disconnected. A new connection is establish from the beginning of transaction and the transaction is streamed directly to Kafka. When the transaction is completed the buffering is enabled again.

              jpechane Jiri Pechanec
              jpechane Jiri Pechanec
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: