-
Feature Request
-
Resolution: Done
-
Major
-
None
-
None
-
False
-
None
-
False
-
0
-
0%
In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.
Bug report
For bug reports, provide this information, please:
i have 22,000 tables, when debezium snapshot the schemas is too slow.(spent abot 1.5h)
i need all the tables binlog becuase i have two categories tables, one have 10,000 tables, anthor have 10,000 tables.
What Debezium connector do you use and what version?
2.1.2
What is the connector configuration?
{
"name": "prod-aurora-phemex-phemex02",
"config": {
"database.server.id": "39102",
"topic.prefix": "prod-aurora-phemex-phemex02",
"transforms.Reroute.table.sync.config.instance": "prod-aurora-phemex-phemex02",
"schema.history.internal.kafka.topic": "schema-changes.prod-aurora-phemex-phemex02",
"transforms.Reroute.table.sync.config.kafka.topic": "prod-aurora-phemex-phemex02-table-sync-config",
"signal.kafka.topic": "prod-aurora-phemex-phemex02-signal",
"signals.consumer.group.id": "prod-aurora-phemex-phemex02-signal-consumer",
"database.include.list": ".*",
"table.include.list": ".*",
"connector.class": "io.debezium.connector.mysql.MySqlConnector",
"connector.displayName": "MySQL",
"connector.id": "mysql",
"decimal.handling.mode": "double",
"include.schema.changes": "false",
"schema.history.internal.store.only.captured.tables.ddl": "false",
"snapshot.locking.mode": "none",
"snapshot.mode": "schema_only",
"tombstones.on.delete": "false",
"topic.creation.default.partitions": "1",
"topic.creation.default.replication.factor": "3",
"transforms": "Reroute",
"transforms.Reroute.type": "com.phemex.dbz.ByLogicalTableRouterV3",
"transforms.Reroute.logical.table.cache.size": "10000",
"signals.consumer.auto.offset.reset": "latest",
"signals.consumer.enable.auto.commit": "true",
"read.only": "true"
}
}
What is the captured database version and mode of depoyment?
(E.g. on-premises, with a specific cloud provider, etc.)
<Your answer>
What behaviour do you expect?
MySqlSnapshotChangeEventSour parallel execute cecreateSchemaEventsForTables
reduce the schema snapshot time
What behaviour do you see?
<Your answer>
Do you see the same behaviour using the latest relesead Debezium version?
(Ideally, also verify with latest Alpha/Beta/CR version)
No
Do you have the connector logs, ideally from start till finish?
(You might be asked later to provide DEBUG/TRACE level log)
<Your answer>
How to reproduce the issue using our tutorial deployment?
<Your answer>
Feature request or enhancement
For feature requests or enhancements, provide this information, please:
Which use case/requirement will be addressed by the proposed feature?
<Your answer>
Implementation ideas (optional)
<Your answer>
- links to
-
RHEA-2024:129636
Red Hat build of Debezium 2.5.4 release
