Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3477

Debezium MySQL connector encounter latency in large DML of MySQL

    XMLWordPrintable

Details

    Description

      Table size 65 GB

      Table records 106 million and affected rows number by SQL below is 53 million

      update table_name set available_at = "0001-01-01 00:00:00" where available_at = "0000-00-00 00:00:00";

      There are other tables in the same database, but they do not run such bulk update.

      The running connector encounter huge latency and keep accumulating in the six hours after DML above get triggered. We do see 6 hours latency for jmx avg:jmx.debezium.binlog.millisecondsbehindsourceĀ 

      Attachments

        Activity

          People

            Unassigned Unassigned
            victorxiang30 shuguang xiang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: