Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5530

Add support for SMT predicates in Debezium Engine

XMLWordPrintable

    • False
    • None
    • False

      Hi there,

      I think I've run into what I think is a bug in how debezium server handles Kafka Connect predicates. I'm trying to add a predicate that filters out messages that go to a specific topic. I created the below transform for this in the config:

      debezium.transforms=Filter
      debezium.transforms.Filter.type=org.apache.kafka.connect.transforms.Filter
      debezium.transforms.Filter.predicate=IsFoo
      debezium.predicates=IsFoo
      debezium.predicates.IsFoo.type=org.apache.kafka.connect.transforms.predicates.TopicNameMatches
      debezium.predicates.IsFoo.pattern=foo
      

      It seems though that as soon as I added this, no messages are sent to any topics in my setup (sink is pubsub). I thought this was potentially related to the way the debezium server application.properties inputs get mapped so I added the below to DebeziumServer.java. Unfortunately, this hasn't resolved the issue

              final Optional<String> predicates = config.getOptionalValue(PROP_PREDICATES, String.class);
              if (predicates.isPresent()) {
                  props.setProperty("predicates", predicates.get());
                  configToProperties(config, props, PROP_PREDICATES_PREFIX, "predicates.");
              }
      

              Unassigned Unassigned
              nathan-smit-1 Nathan Smit
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: