Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-390 Data are read from the binlog and not written into kafka
  3. DBZ-406

Modify BinlogReader to support transactions of unlimited size

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: 0.6
    • Fix Version/s: 0.7.0
    • Component/s: mysql-connector
    • Labels:
      None

      Description

      DBZ-405 enables buffering of transactions but only of limited pre-configured size. If the transaction is bigger than configured buffer than the BinlogReader shold log a WARN message. Then it should continue with processing of binlog reader till the transaction is ended.
      If the transaction ends with ROLLBACK then buffer is cleared and normal processing continues. If it ends with commit then BinaryLogClient is disconnected. A new connection is establish from the beginning of transaction and the transaction is streamed directly to Kafka. When the transaction is completed the buffering is enabled again.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              jpechanec Jiri Pechanec
              Reporter:
              jpechanec Jiri Pechanec
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: