Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-555

EmbeddedEngine strips settings required to use KafkaOffsetBackingStore

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical Critical
    • 0.7.2
    • 0.7.1
    • core-library
    • None
    • Hide
      Configuration config = Configuration.create()
              .with("connector.class", "io.debezium.connector.postgresql.PostgresConnector")
              .with("offset.storage", "org.apache.kafka.connect.storage.KafkaOffsetBackingStore")
              .with(DistributedConfig.OFFSET_STORAGE_TOPIC_CONFIG, "connect-offsets")
              .with(DistributedConfig.OFFSET_STORAGE_PARTITIONS_CONFIG, 1)
              .with(DistributedConfig.OFFSET_STORAGE_REPLICATION_FACTOR_CONFIG, 1)
              .with("bootstrap.servers", "localhost:9092")
              .with("group.id", "test-java-consumer")
              .with("name", "foo")
              .with("database.hostname", "localhost")
              .with("database.port", 5432)
              .with("database.dbname", "postgres")
              .with("database.user", "notxcain")
              .with("database.password", "pwd")
              .with("database.server.name", "java.baz")
              .build();
      
      Show
      Configuration config = Configuration.create() .with( "connector.class" , "io.debezium.connector.postgresql.PostgresConnector" ) .with( "offset.storage" , "org.apache.kafka.connect.storage.KafkaOffsetBackingStore" ) .with(DistributedConfig.OFFSET_STORAGE_TOPIC_CONFIG, "connect-offsets" ) .with(DistributedConfig.OFFSET_STORAGE_PARTITIONS_CONFIG, 1) .with(DistributedConfig.OFFSET_STORAGE_REPLICATION_FACTOR_CONFIG, 1) .with( "bootstrap.servers" , "localhost:9092" ) .with( "group.id" , "test-java-consumer" ) .with( "name" , "foo" ) .with( "database.hostname" , "localhost" ) .with( "database.port" , 5432) .with( "database.dbname" , "postgres" ) .with( "database.user" , "notxcain" ) .with( "database.password" , "pwd" ) .with( "database.server.name" , "java.baz" ) .build();

      It looks like EmbeddedConfig strips all KafkaOffsetBackingStore keys except offset.storage.topic. So method KafkaOffsetBackingStore#configure fails at line 84

              Unassigned Unassigned
              notxcain Denis Mikhaylov (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: