-
Enhancement
-
Resolution: Done
-
Critical
-
0.2.1
Kafka can be run with the auto.create.topics.enable boolean property that dictates whether Kafka will auto-create topics that are used by producers or consumers. The challenge is that when this is enabled, Kafka will create the topics with the default number of partitions and replicas. Most people suggest that in production this auto-create behavior be disabled.
Although a connector that is starting up might be able to log the topics that are missing (so they could be manually created by an admin), this doesn't really help when new tables can be added to the database at any time.
The MySQL connector should provide a number of topic creation strategies (e.g., never, with 1 partition and up to n replicas, etc.), so that users can configure the connector and specify the strategy for multiple sets of tables (likely list of regexes of table identifiers).
- is duplicated by
-
DBZ-1582 Support explicit configuration parameters for table topic creation
- Closed
-
DBZ-1897 How to specify the number of data topic partitions
- Closed
- is related to
-
DBZ-2654 Prepare customizing auto-created topics doc for downstream
- Closed
- relates to
-
DBZ-1886 Don't try to database history topic if it exists already
- Closed