Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2144

Don't validate internal database.history.connector.* config parameters

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • 1.2.0.CR1
    • 1.2.0.Beta2
    • mysql-connector
    • None
    • Hide

      Request:

      PUT /connector-plugins/io.debezium.connector.mysql.MySqlConnector/config/validate HTTP/1.1
      Host: localhost:18083
      User-Agent: Go-http-client/1.1
      Content-Length: 936
      Content-Type: application/json
      Accept-Encoding: gzip
      
      {
          "column.propagate.source.type": ".*",
          "connector.class": "io.debezium.connector.mysql.MySqlConnector",
          "database.history.kafka.bootstrap.servers": "kafka:19092",
          "database.history.kafka.topic": "schema-changes.inventory",
          "database.history.store.only.monitored.tables.ddl": "true",
          "database.hostname": "mysql",
          "database.password": "123456",
          "database.port": "3306",
          "database.server.name": "inventory",
          "database.user": "binlog",
          "database.whitelist": "inventory",
          "decimal.handling.mode": "string",
          "include.query": "true",
          "include.schema.changes": "true",
          "key.converter": "io.confluent.connect.avro.AvroConverter",
          "key.converter.schema.registry.url": "http://schema-registry:8081",
          "max.batch.size": "81920",
          "max.queue.size": "327680",
          "name": "inventory_debezium",
          "snapshot.mode": "schema_only",
          "table.whitelist": "inventory.customers",
          "value.converter": "io.confluent.connect.avro.AvroConverter",
          "value.converter.schema.registry.url": "http://schema-registry:8081"
      }
      
      

      Response:

      Since Kafka Connect returns all config parameters for validation enpoint, I've only added the ones with error.

       {
                  "definition": null,
                  "value": {
                      "name": "database.history.connector.id",
                      "value": null,
                      "recommended_values": [],
                      "errors": [
                          "Configuration is not defined: database.history.connector.id"
                      ],
                      "visible": true
                  }
              },
              {
                  "definition": null,
                  "value": {
                      "name": "database.history.connector.class",
                      "value": null,
                      "recommended_values": [],
                      "errors": [
                          "Configuration is not defined: database.history.connector.class"
                      ],
                      "visible": true
                  }
              }
      
      Show
      Request: PUT /connector-plugins/io.debezium.connector.mysql.MySqlConnector/config/validate HTTP/1.1 Host: localhost:18083 User-Agent: Go-http-client/1.1 Content-Length: 936 Content-Type: application/json Accept-Encoding: gzip { "column.propagate.source.type" : ".*" , "connector.class" : "io.debezium.connector.mysql.MySqlConnector" , "database.history.kafka.bootstrap.servers" : "kafka:19092" , "database.history.kafka.topic" : "schema-changes.inventory" , "database.history.store.only.monitored.tables.ddl" : " true " , "database.hostname" : "mysql" , "database.password" : "123456" , "database.port" : "3306" , "database.server.name" : "inventory" , "database.user" : "binlog" , "database.whitelist" : "inventory" , "decimal.handling.mode" : "string" , "include.query" : " true " , "include.schema.changes" : " true " , "key.converter" : "io.confluent.connect.avro.AvroConverter" , "key.converter.schema.registry.url" : "http: //schema-registry:8081" , "max.batch.size" : "81920" , "max.queue.size" : "327680" , "name" : "inventory_debezium" , "snapshot.mode" : "schema_only" , "table.whitelist" : "inventory.customers" , "value.converter" : "io.confluent.connect.avro.AvroConverter" , "value.converter.schema.registry.url" : "http: //schema-registry:8081" } Response: Since Kafka Connect returns all config parameters for validation enpoint, I've only added the ones with error. { "definition" : null , "value" : { "name" : "database.history.connector.id" , "value" : null , "recommended_values" : [], "errors" : [ "Configuration is not defined: database.history.connector.id" ], "visible" : true } }, { "definition" : null , "value" : { "name" : "database.history.connector.class" , "value" : null , "recommended_values" : [], "errors" : [ "Configuration is not defined: database.history.connector.class" ], "visible" : true } }

    Description

      Hi there! While we were testing MySQL Connector 1.2.0.Beta2, we encountered following error during connector config validation.

      • We were unable to find any documentation on database.history.connector.class and database.history.connector.id
      • These two do not have a value for definition field, unlike others

      Since definitions are missing and there's no documentation, we're not sure about if these fields are really required and what values they should have.

      Attachments

        Activity

          People

            jpechane Jiri Pechanec
            selmankayrancioglu Selman Kayrancioglu (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: