-
Feature Request
-
Resolution: Done
-
Major
-
None
-
None
-
False
-
None
-
False
-
0
-
0%
In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.
Bug report
For bug reports, provide this information, please:
i have 22,000 tables, when debezium snapshot the schemas is too slow.(spent abot 1.5h)
i need all the tables binlog becuase i have two categories tables, one have 10,000 tables, anthor have 10,000 tables.
What Debezium connector do you use and what version?
2.1.2
What is the connector configuration?
{ "name": "prod-aurora-phemex-phemex02", "config": { "database.server.id": "39102", "topic.prefix": "prod-aurora-phemex-phemex02", "transforms.Reroute.table.sync.config.instance": "prod-aurora-phemex-phemex02", "schema.history.internal.kafka.topic": "schema-changes.prod-aurora-phemex-phemex02", "transforms.Reroute.table.sync.config.kafka.topic": "prod-aurora-phemex-phemex02-table-sync-config", "signal.kafka.topic": "prod-aurora-phemex-phemex02-signal", "signals.consumer.group.id": "prod-aurora-phemex-phemex02-signal-consumer", "database.include.list": ".*", "table.include.list": ".*", "connector.class": "io.debezium.connector.mysql.MySqlConnector", "connector.displayName": "MySQL", "connector.id": "mysql", "decimal.handling.mode": "double", "include.schema.changes": "false", "schema.history.internal.store.only.captured.tables.ddl": "false", "snapshot.locking.mode": "none", "snapshot.mode": "schema_only", "tombstones.on.delete": "false", "topic.creation.default.partitions": "1", "topic.creation.default.replication.factor": "3", "transforms": "Reroute", "transforms.Reroute.type": "com.phemex.dbz.ByLogicalTableRouterV3", "transforms.Reroute.logical.table.cache.size": "10000", "signals.consumer.auto.offset.reset": "latest", "signals.consumer.enable.auto.commit": "true", "read.only": "true" } }
What is the captured database version and mode of depoyment?
(E.g. on-premises, with a specific cloud provider, etc.)
<Your answer>
What behaviour do you expect?
MySqlSnapshotChangeEventSour parallel execute cecreateSchemaEventsForTables
reduce the schema snapshot time
What behaviour do you see?
<Your answer>
Do you see the same behaviour using the latest relesead Debezium version?
(Ideally, also verify with latest Alpha/Beta/CR version)
No
Do you have the connector logs, ideally from start till finish?
(You might be asked later to provide DEBUG/TRACE level log)
<Your answer>
How to reproduce the issue using our tutorial deployment?
<Your answer>
Feature request or enhancement
For feature requests or enhancements, provide this information, please:
Which use case/requirement will be addressed by the proposed feature?
<Your answer>
Implementation ideas (optional)
<Your answer>
- links to
-
RHEA-2024:129636 Red Hat build of Debezium 2.5.4 release