Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2144

Don't validate internal database.history.connector.* config parameters

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 1.2.0.CR1
    • 1.2.0.Beta2
    • mysql-connector
    • None
    • Hide

      Request:

      PUT /connector-plugins/io.debezium.connector.mysql.MySqlConnector/config/validate HTTP/1.1
      Host: localhost:18083
      User-Agent: Go-http-client/1.1
      Content-Length: 936
      Content-Type: application/json
      Accept-Encoding: gzip
      
      {
          "column.propagate.source.type": ".*",
          "connector.class": "io.debezium.connector.mysql.MySqlConnector",
          "database.history.kafka.bootstrap.servers": "kafka:19092",
          "database.history.kafka.topic": "schema-changes.inventory",
          "database.history.store.only.monitored.tables.ddl": "true",
          "database.hostname": "mysql",
          "database.password": "123456",
          "database.port": "3306",
          "database.server.name": "inventory",
          "database.user": "binlog",
          "database.whitelist": "inventory",
          "decimal.handling.mode": "string",
          "include.query": "true",
          "include.schema.changes": "true",
          "key.converter": "io.confluent.connect.avro.AvroConverter",
          "key.converter.schema.registry.url": "http://schema-registry:8081",
          "max.batch.size": "81920",
          "max.queue.size": "327680",
          "name": "inventory_debezium",
          "snapshot.mode": "schema_only",
          "table.whitelist": "inventory.customers",
          "value.converter": "io.confluent.connect.avro.AvroConverter",
          "value.converter.schema.registry.url": "http://schema-registry:8081"
      }
      
      

      Response:

      Since Kafka Connect returns all config parameters for validation enpoint, I've only added the ones with error.

       {
                  "definition": null,
                  "value": {
                      "name": "database.history.connector.id",
                      "value": null,
                      "recommended_values": [],
                      "errors": [
                          "Configuration is not defined: database.history.connector.id"
                      ],
                      "visible": true
                  }
              },
              {
                  "definition": null,
                  "value": {
                      "name": "database.history.connector.class",
                      "value": null,
                      "recommended_values": [],
                      "errors": [
                          "Configuration is not defined: database.history.connector.class"
                      ],
                      "visible": true
                  }
              }
      
      Show
      Request: PUT /connector-plugins/io.debezium.connector.mysql.MySqlConnector/config/validate HTTP/1.1 Host: localhost:18083 User-Agent: Go-http-client/1.1 Content-Length: 936 Content-Type: application/json Accept-Encoding: gzip { "column.propagate.source.type" : ".*" , "connector.class" : "io.debezium.connector.mysql.MySqlConnector" , "database.history.kafka.bootstrap.servers" : "kafka:19092" , "database.history.kafka.topic" : "schema-changes.inventory" , "database.history.store.only.monitored.tables.ddl" : " true " , "database.hostname" : "mysql" , "database.password" : "123456" , "database.port" : "3306" , "database.server.name" : "inventory" , "database.user" : "binlog" , "database.whitelist" : "inventory" , "decimal.handling.mode" : "string" , "include.query" : " true " , "include.schema.changes" : " true " , "key.converter" : "io.confluent.connect.avro.AvroConverter" , "key.converter.schema.registry.url" : "http: //schema-registry:8081" , "max.batch.size" : "81920" , "max.queue.size" : "327680" , "name" : "inventory_debezium" , "snapshot.mode" : "schema_only" , "table.whitelist" : "inventory.customers" , "value.converter" : "io.confluent.connect.avro.AvroConverter" , "value.converter.schema.registry.url" : "http: //schema-registry:8081" } Response: Since Kafka Connect returns all config parameters for validation enpoint, I've only added the ones with error. { "definition" : null , "value" : { "name" : "database.history.connector.id" , "value" : null , "recommended_values" : [], "errors" : [ "Configuration is not defined: database.history.connector.id" ], "visible" : true } }, { "definition" : null , "value" : { "name" : "database.history.connector.class" , "value" : null , "recommended_values" : [], "errors" : [ "Configuration is not defined: database.history.connector.class" ], "visible" : true } }

      Hi there! While we were testing MySQL Connector 1.2.0.Beta2, we encountered following error during connector config validation.

      • We were unable to find any documentation on database.history.connector.class and database.history.connector.id
      • These two do not have a value for definition field, unlike others

      Since definitions are missing and there's no documentation, we're not sure about if these fields are really required and what values they should have.

              jpechane Jiri Pechanec
              selmankayrancioglu Selman Kayrancioglu (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: