Details
-
Type:
Bug
-
Status: Closed (View Workflow)
-
Priority:
Major
-
Resolution: Done
-
Affects Version/s: None
-
Fix Version/s: 0.9.0.Alpha2
-
Component/s: mongodb-connector
-
Labels:None
-
Steps to Reproduce:
Description
If a mongo collection contains characters that are not compatible with the Kafka topic naming conventions (it contains a character other than ASCII alphanumerics, '.', '_' and '-'), the connector will fail when trying to create and write the data down to a topic.
Moreover, the connecter is unable to stop throwing the error, continuing retrying and ending up filling up the logs.
Suggested fix:
The source connector should be able to identify invalid characters for kafka topics on the mongo collection and skip them when creating the topic.
Extra notes:
Transforms did not seem to do as work around. Topic with original collection name is still tried to be created.
transforms=Reroute transforms.Reroute.type=io.debezium.transforms.ByLogicalTableRouter transforms.Reroute.topic.regex=(.*)my@collection(.*) transforms.Reroute.topic.replacement=$1my_collection
Attachments
Issue Links
- is related to
-
DBZ-878 MySQL identifier with dot or space could not be parsed
-
- Closed
-