Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1524

Parallel snapshot not working with AWS RDS MySQL

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • 0.10.0.Final
    • mysql-connector
    • None
    • Hide

      1. Create one debezium connector for AWS RDS MySQL instance with property "snapshot.new.tables": "parallel", "snapshot.mode": "initial" and say one whitelisted table ABC as "table.whitelist": "abc.ABC".

      2. Let the initial snapshot get complete
      3. Update configuration to whitelist another table as well "table.whitelist": "abc.ABC, abc.XYZ".

      Parallel snapshot fails

      Show
      1. Create one debezium connector for AWS RDS MySQL instance with property "snapshot.new.tables": "parallel", "snapshot.mode": "initial" and say one whitelisted table ABC as "table.whitelist": "abc.ABC". 2. Let the initial snapshot get complete 3. Update configuration to whitelist another table as well "table.whitelist": "abc.ABC, abc.XYZ". Parallel snapshot fails

      Parallel snapshot (to whitelist tables later) fails on AWS RDS MySQL with exception:

      INFO Step 8: rolling back transaction after abort (io.debezium.connector.mysql.SnapshotReader:686)
ERROR Failed due to error: Aborting snapshot due to error when last running 'UNLOCK TABLES': Table 'Personnel' was not locked with LOCK TABLES (io.debezium.connector.mysql.SnapshotReader:209)
org.apache.kafka.connect.errors.ConnectException: Table 'X' was not locked with LOCK TABLES Error code: 1100; SQLSTATE: HY000.
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:208)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:773)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLException: Table 'Community' was not locked with LOCK TABLES
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
	at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
	at com.mysql.cj.jdbc.StatementImpl.executeQuery(StatementImpl.java:1218)
	at io.debezium.jdbc.JdbcConnection.query(JdbcConnection.java:442)
	at io.debezium.jdbc.JdbcConnection.query(JdbcConnection.java:385)
	at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:470)

              Unassigned Unassigned
              rajatgl17 Rajat Goel (Inactive)
              Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated: