Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2290

DB operations on blacklisted database table impacting monitored table connectors

    Details

      Description

      I need a way to convey to MySQL connector to stop monitoring few databases. I have tried database.blacklist and database.history.store.only.monitored.tables.ddl but its not helping.

      Example: database_blacklist=db1 but still mysql connector is failing by reading a table in db1 database.

      [2020-06-23 09:48:20,542] DEBUG Received query command: Event\{header=EventHeaderV4{timestamp=1592905700000, eventType=QUERY, serverId=179860822, headerLength=19, dataLength=214, nextPosition=1241154, flags=0}, data=QueryEventData\{threadId=995742, executionTime=0, errorCode=0, database='db1', sql='alter table db1.tablename add constraint tablename_pk primary key (protocol_id,study_key,study_type_id,cohort_id)'}} (io.debezium.connector.mysql.BinlogReader)
      [2020-06-23 09:48:20,542] ERROR Error during binlog processing. Last offset stored = \{table_whitelist=pvaiintake.pvai_case_version, ts_sec=1592905695, file=mysql-bin-changelog.060888, table_blacklist=null, pos=1219833, database_whitelist=null, database_blacklist=db1, row=1, server_id=179860822, event=4}, binlog reader near position = mysql-bin-changelog.060888/1240921 (io.debezium.connector.mysql.BinlogReader)
      [2020-06-23 09:48:20,542] ERROR Failed due to error: Error processing binlog event (io.debezium.connector.mysql.BinlogReader)
      org.apache.kafka.connect.errors.ConnectException: The primary key cannot reference a non-existant column'study_type_id' in table 'db1.tablename'
      

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  crazyavi49 Abhishek Anand
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                  Dates

                  • Created:
                    Updated: