Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-977

ConnectException during ALTER TABLE for non-whitelisted table

    XMLWordPrintable

Details

    Description

      Hi,

      we have configure the Debezium, to get only some tables from a MySQL.
      "table.whitelist": "schema_name_1.table_1,schema_name_1.table_2"

      But now, a table in another schema was used in source MySQL and Debezium reading the binlog of MySQL see the change in the schema_name_2 but in our connector we LIMIT with "table.whitelist": "schema_name_1.table_1,schema_name_1.table_2" the table we are integrated.
      Also we set the database schema that we looking for ignoring other schema:
      "database.whitelist": "schema_name_1"

      So why Debezium is complaining about:
      org.apache.kafka.connect.errors.ConnectException: Trying to alter table ,schema_name_2.hire_statuses, which does not exist. Query: ALTER TABLE `hire_statuses` ADD `data` text\n\tat io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:200)\n\tat io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:178)\n\tat io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:452)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1055)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:913)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:559)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:793)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: io.debezium.text.ParsingException: Trying to alter table z05.hire_statuses, which does not exist. Query: ALTER TABLE `hire_statuses` ADD `data` text\n\tat io.debezium.connector.mysql.antlr.listener.AlterTableParserListener.enterAlterTable(AlterTableParserListener.java:54)\n\tat io.debezium.ddl.parser.mysql.generated.MySqlParser$AlterTableContext.enterRule(MySqlParser.java:11473)\n\tat io.debezium.antlr.ProxyParseTreeListenerUtil.delegateEnterRule(ProxyParseTreeListenerUtil.java:46)\n\tat io.debezium.connector.mysql.antlr.listener.MySqlAntlrDdlParserListener.enterEveryRule(MySqlAntlrDdlParserListener.java:89)\n\tat org.antlr.v4.runtime.tree.ParseTreeWalker.enterRule(ParseTreeWalker.java:41)\n\tat org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:25)\n\tat org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)\n\tat org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)\n\tat org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)\n\tat org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)\n\tat io.debezium.antlr.AntlrDdlParser.parse(AntlrDdlParser.java:85)\n\tat io.debezium.connector.mysql.MySqlSchema.applyDdl(MySqlSchema.java:298)\n\tat io.debezium.connector.mysql.BinlogReader.handleQueryEvent(BinlogReader.java:637)\n\tat io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:436)\n\t... 5 more\n",
      "id": 0,
      "worker_id": "10.50.177.13:8083"
      }

      Regards,
      Eric

      Attachments

        Activity

          People

            jpechane Jiri Pechanec
            eric.franckx@ngahr.com Eric FRANCKX (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: