Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2290

DB operations on blacklisted database table impacting monitored table connectors

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Major
    • None
    • 1.1.0.Final
    • mysql-connector
    • None

    Description

      I need a way to convey to MySQL connector to stop monitoring few databases. I have tried database.blacklist and database.history.store.only.monitored.tables.ddl but its not helping.

      Example: database_blacklist=db1 but still mysql connector is failing by reading a table in db1 database.

      [2020-06-23 09:48:20,542] DEBUG Received query command: Event\{header=EventHeaderV4{timestamp=1592905700000, eventType=QUERY, serverId=179860822, headerLength=19, dataLength=214, nextPosition=1241154, flags=0}, data=QueryEventData\{threadId=995742, executionTime=0, errorCode=0, database='db1', sql='alter table db1.tablename add constraint tablename_pk primary key (protocol_id,study_key,study_type_id,cohort_id)'}} (io.debezium.connector.mysql.BinlogReader)
      [2020-06-23 09:48:20,542] ERROR Error during binlog processing. Last offset stored = \{table_whitelist=pvaiintake.pvai_case_version, ts_sec=1592905695, file=mysql-bin-changelog.060888, table_blacklist=null, pos=1219833, database_whitelist=null, database_blacklist=db1, row=1, server_id=179860822, event=4}, binlog reader near position = mysql-bin-changelog.060888/1240921 (io.debezium.connector.mysql.BinlogReader)
      [2020-06-23 09:48:20,542] ERROR Failed due to error: Error processing binlog event (io.debezium.connector.mysql.BinlogReader)
      org.apache.kafka.connect.errors.ConnectException: The primary key cannot reference a non-existant column'study_type_id' in table 'db1.tablename'
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              crazyavi49 Abhishek Anand (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: