-
Bug
-
Resolution: Cannot Reproduce
-
Major
-
0.3
-
None
-
Debezium 3.0 Docker images
MySQL: 5.7.10-log MySQL Community Server (GPL)
MySQL Binlog Configuration：binlog_format = ROW binlog_row_image =FULL binlog_checksum = CRC32 log_bin =ON
MySQLGTID Configuration：
mysql> show variables like '%gtid%'; +----------------------------------+-----------+ | Variable_name | Value | +----------------------------------+-----------+ | binlog_gtid_simple_recovery | ON | | enforce_gtid_consistency | OFF | | gtid_executed_compression_period | 1000 | | gtid_mode | OFF | | gtid_next | AUTOMATIC | | gtid_owned | | | gtid_purged | | | session_track_gtids | OFF | +----------------------------------+-----------+Debezium 3.0 Docker images MySQL: 5.7.10-log MySQL Community Server (GPL) MySQL Binlog Configuration： binlog_format = ROW binlog_row_image =FULL binlog_checksum = CRC32 log_bin =ON MySQLGTID Configuration： mysql> show variables like '%gtid%' ; +----------------------------------+-----------+ | Variable_name | Value | +----------------------------------+-----------+ | binlog_gtid_simple_recovery | ON | | enforce_gtid_consistency | OFF | | gtid_executed_compression_period | 1000 | | gtid_mode | OFF | | gtid_next | AUTOMATIC | | gtid_owned | | | gtid_purged | | | session_track_gtids | OFF | +----------------------------------+-----------+
Here is my scenario：
The MySQL server exists following databases:
mysql> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | cdc | | jeffy | | mysql | | ods | | performance_schema | | sys | | tungsten_db3312 | | ud | | wd | +--------------------+ 10 rows in set (0.00 sec)
I only synchronize the database cdc and ods. so I configure the database.whitelist to "cdc,ods". here is my all settings:
curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" 10.1.234.191:8083/connectors/ -d '{ "name": "demo-connector", "config": { "connector.class": "io.debezium.connector.mysql.MySqlConnector", "tasks.max": "1", "database.hostname": "10.1.236.132", "database.port": "3312", "database.user": "debezium", "database.password": "debezium", "database.server.id": "3312", "database.server.name": "demo", "database.binlog": "mysql-bin.000001", "database.whitelist": "ods,cdc", "database.history.kafka.bootstrap.servers": "10.1.234.191:9092", "database.history.kafka.topic": "schema-changes.demo" } }'
When I do following statement, the topic not automatic created.
mysql> use cdc; mysql> create table warehouse like ud.warehouse; Query OK, 0 rows affected (0.25 sec) mysql> insert into warehouse select * from ud.warehouse; Query OK, 1 row affected (1.28 sec) Records: 1 Duplicates: 0 Warnings: 0
Here is the debezium logs:
2016-08-19 03:26:34,650 INFO || Finished WorkerSourceTask{id=demo-connector-0} commitOffsets successfully in 5 ms [org.apache.kafka.connect.runtime.WorkerSourceTask]
I query all topics not found the topic named demo.cdc.warehouse
kafka@ca2acf4d8d0e:~/bin$ ./kafka-topics.sh --zookeeper 10.1.234.191:2181 --list __consumer_offsets connect-status dbhistory.demo debezium_connect_configs debezium_connect_offsets demo demo.cdc.customer demo.cdc.item demo.cdc.order_line demo.cdc.pppp demo.cdc.stock demo.cdc.uuuu demo.cdc.xxxx demo.cdc.yyyy demo.ods.aaaa demo.ods.item demo.ods.jeffy demo.ods.mmmm demo.ods.uuuu demo.ods.wwww schema-changes.demo
I think this SQL statement is very common. we need support it.
