-
Bug
-
Resolution: Duplicate
-
Major
-
None
-
None
-
None
-
None
-
False
-
False
-
1.4
-
Undefined
-
-
Connector configuration with "transform" and "topic.creation" options failed.
REST returns OK, when configration applyed, but in debezium logs exeption appears and transforms doesn't work:
org.apache.kafka.connect.errors.ConnectException: org.apache.kafka.common.config.ConfigException: Unknown configuration 'transforms.route.type' at org.apache.kafka.connect.runtime.ConnectorConfig.transformations(ConnectorConfig.java:296) at org.apache.kafka.connect.runtime.Worker.buildWorkerTask(Worker.java:605) at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:555) at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1251) at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127) at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1266) at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1262) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.kafka.common.config.ConfigException: Unknown configuration 'transforms.route.type' at org.apache.kafka.common.config.AbstractConfig.get(AbstractConfig.java:159) at org.apache.kafka.connect.runtime.SourceConnectorConfig$EnrichedSourceConnectorConfig.get(SourceConnectorConfig.java:57) at org.apache.kafka.connect.runtime.SourceConnectorConfig.get(SourceConnectorConfig.java:141) at org.apache.kafka.common.config.AbstractConfig.getClass(AbstractConfig.java:216) at org.apache.kafka.connect.runtime.ConnectorConfig.transformations(ConnectorConfig.java:281) ... 10 more
Configuration example:
{
"connector.class": "io.debezium.connector.postgresql.PostgresConnector",
"plugin.name": "pgoutput",
"database.hostname": "db",
"database.port": "5432",
"database.user": "postgres",
"database.password": "postgres",
"database.dbname" : "my-db",
"database.server.name": "my",
"slot.name": "dbz_my",
"publication.name": "dbz_publication",
"table.include.list": "events.transactions",
"tasks.max": "1",
"value.converter.schemas.enable": "false",
"key.converter.schemas.enable": "false",
"tombstones.on.delete": "false",
"heartbeat.interval.ms": "30000",
"message.key.columns": "events.transactions:trx_id",
"transforms": "route,createKey,createValue",
"transforms.route.type": "io.debezium.transforms.ContentBasedRouter",
"transforms.route.language": "jsr223.groovy",
"transforms.route.topic.expression": "\"$value.source.name-$value.after.model_name\".toString()",
"transforms.route.topic.regex": "^.*\\.(events\\.transactions)$",
"transforms.createKey.type":"org.apache.kafka.connect.transforms.ExtractField$Key",
"transforms.createKey.field":"trx_id",
"transforms.createKey.predicate":"myTopics",
"transforms.createValue.type":"org.apache.kafka.connect.transforms.ExtractField$Value",
"transforms.createValue.field":"after",
"transforms.createValue.predicate":"myTopics",
"predicates": "myTopics",
"predicates.myTopics.type": "org.apache.kafka.connect.transforms.predicates.TopicNameMatches",
"predicates.myTopics.pattern": "^my-.*$",
"topic.creation.groups": "events",
"topic.creation.default.replication.factor": "1",
"topic.creation.default.partitions": "3",
"topic.creation.events.replication.factor": "1",
"topic.creation.events.partitions": "3"
}
Same configuration without topic.creation. or "transforms. block applies normally.
- duplicates
-
DBZ-2630 Upgrade to Apache Kafka Connect 2.6.1
-
- Closed
-