Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-6805

Schema names are not compatible with Protobuf

XMLWordPrintable

    • False
    • None
    • False
    • Important

      In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.

      Bug report

      What Debezium connector do you use and what version?

      io.debezium.connector.mysql.MySqlConnector version 2.2.1

      What is the connector configuration?

      Using AWS Schema Registry with Protobuf converter.

      What behaviour do you expect?

      Expect valid protobuf schema.

      What behaviour do you see?

      com.google.protobuf.Descriptors$DescriptorValidationException

      Do you have the connector logs, ideally from start till finish?

      Schema names are generated from topic-prefix, database name, and table name separated by "." This results in a Descriptors$DescriptorValidationException. Setting the "schema.name.adjustment.mode"="avro" as an attempt to replace the "." with "_" doesn't have any affect.

      Caused by: com.google.protobuf.Descriptors$DescriptorValidationException:com.amazonaws.services.schemaregistry.kafkaconnect.autogenerated.debezium.database_name.table_name.Value.debezium.database_name.table_name.Value: \"debezium.database_name.table_name.Value\" is not a valid identifier. at com.google.protobuf.Descriptors$DescriptorPool.validateSymbolName(Descriptors.java:2703) at com.google.protobuf.Descriptors$DescriptorPool.addSymbol(Descriptors.java:2575) at com.google.protobuf.Descriptors$Descriptor.<init>(Descriptors.java:971) at com.google.protobuf.Descriptors$Descriptor.<init>(Descriptors.java:648) at com.google.protobuf.Descriptors$FileDescriptor.<init>(Descriptors.java:548) at com.google.protobuf.Descriptors$FileDescriptor.buildFrom(Descriptors.java:319) at com.google.protobuf.Descriptors$FileDescriptor.buildFrom(Descriptors.java:290) at com.amazonaws.services.schemaregistry.kafkaconnect.protobuf.fromconnectschema.ConnectSchemaToProtobufSchemaConverter.buildFileDescriptor(ConnectSchemaToProtobufSchemaConverter.java:88) at com.amazonaws.services.schemaregistry.kafkaconnect.protobuf.fromconnectschema.ConnectSchemaToProtobufSchemaConverter.convert(ConnectSchemaToProtobufSchemaConverter.java:43) at com.amazonaws.services.schemaregistry.kafkaconnect.protobuf.ProtobufSchemaConverter.fromConnectData(ProtobufSchemaConverter.java:105) at org.apache.kafka.connect.storage.Converter.fromConnectData(Converter.java:63) at org.apache.kafka.connect.runtime.WorkerSourceTask.lambda$convertTransformedRecord$3(WorkerSourceTask.java:321)
      ```

            Unassigned Unassigned
            buenos79 Mark D (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: