Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3477

Debezium MySQL connector encounter latency in large DML of MySQL

XMLWordPrintable

    • False
    • False
    • Undefined

      Table size 65 GB

      Table records 106 million and affected rows number by SQL below is 53 million

      update table_name set available_at = "0001-01-01 00:00:00" where available_at = "0000-00-00 00:00:00";

      There are other tables in the same database, but they do not run such bulk update.

      The running connector encounter huge latency and keep accumulating in the six hours after DML above get triggered. We do see 6 hours latency for jmx avg:jmx.debezium.binlog.millisecondsbehindsourceĀ 

        1. image-2022-01-26-11-36-49-736.png
          65 kB
          maksym Sherbinin
        2. image-2022-01-26-11-38-01-831.png
          56 kB
          maksym Sherbinin

              Unassigned Unassigned
              victorxiang30 shuguang xiang (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: