Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-104

Tables created by “create table like” statement as per blacklist cannot create topic automatically.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Major
    • 0.3.2, 0.4
    • 0.3
    • mysql-connector
    • None

    Description

      Here is my scenario:

      The MySQL server exists following databases:

      mysql> show databases;
      +--------------------+
      | Database           |
      +--------------------+
      | information_schema |
      | cdc                |
      | jeffy              |
      | mysql              |
      | ods                |
      | performance_schema |
      | sys                |
      | tungsten_db3312    |
      | ud                 |
      | wd                 |
      +--------------------+
      10 rows in set (0.00 sec)
      

      I only synchronize the database cdc and ods. so I configure the database.whitelist to "cdc,ods". here is my all settings:

      curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" 10.1.234.191:8083/connectors/ -d '{ "name": "demo-connector", "config": { "connector.class": "io.debezium.connector.mysql.MySqlConnector", "tasks.max": "1", "database.hostname": "10.1.236.132", "database.port": "3312", "database.user": "debezium", "database.password": "debezium", "database.server.id": "3312", "database.server.name": "demo", "database.binlog": "mysql-bin.000001", "database.whitelist": "ods,cdc", "database.history.kafka.bootstrap.servers": "10.1.234.191:9092", "database.history.kafka.topic": "schema-changes.demo" } }'
      

      When I do following statement, the topic not automatic created.

      mysql> use cdc;
      mysql> create table warehouse like ud.warehouse;
      Query OK, 0 rows affected (0.25 sec)
      
      mysql> insert into warehouse select * from ud.warehouse;
      Query OK, 1 row affected (1.28 sec)
      Records: 1  Duplicates: 0  Warnings: 0
      

      Here is the debezium logs:

      2016-08-19 03:26:34,650 INFO   ||  Finished WorkerSourceTask{id=demo-connector-0} commitOffsets successfully in 5 ms   [org.apache.kafka.connect.runtime.WorkerSourceTask]
      

      I query all topics not found the topic named demo.cdc.warehouse

      kafka@ca2acf4d8d0e:~/bin$ ./kafka-topics.sh --zookeeper 10.1.234.191:2181 --list
      __consumer_offsets
      connect-status
      dbhistory.demo
      debezium_connect_configs
      debezium_connect_offsets
      demo
      demo.cdc.customer
      demo.cdc.item
      demo.cdc.order_line
      demo.cdc.pppp
      demo.cdc.stock
      demo.cdc.uuuu
      demo.cdc.xxxx
      demo.cdc.yyyy
      demo.ods.aaaa
      demo.ods.item
      demo.ods.jeffy
      demo.ods.mmmm
      demo.ods.uuuu
      demo.ods.wwww
      schema-changes.demo
      

      I think this SQL statement is very common. we need support it.

      Attachments

        Activity

          People

            rhauch Randall Hauch (Inactive)
            renwu58_jira RenZhu Zhang (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: