Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2294

Schema changes for internal mysql tables are being captured

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Duplicate Issue
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: mysql-connector
    • Labels:
      None
    • Prod build version:
      1.2.final

      Description

      I'm getting the following error using Confluent and Debezium 1.1 and 1.2.final:

      org.apache.kafka.connect.errors.ConnectException: Table 'mysql.rds_sysinfo' doesn't exist Error code: 1146; SQLSTATE: 42S02. at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230) at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:207) at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:831) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11

      My database is an Aurora MySQL. 

      Was able to trace down the issue to:

      https://github.com/debezium/debezium/blob/master/debezium-connector-mysql/src/main/java/io/debezium/connector/mysql/SnapshotReader.java#L401

       

      because when I set database.history.store.only.monitored.tables.ddl to true the error vanishes. But the documentation say that it's not safe to do that in case the table filters change (which they probably will in the future).

      I guess I'm wondering why the knownTableIds are not being tested for internal tables.

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  creactiviti Arik Cohen
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: