Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1532

pgoutput string decoding depends on JVM default charset

    Details

      Description

      Debezium prescribe using of UTF-8 for database.
      When a string arrives it is decoded by pgoutput decoder in
      io.debezium.connector.postgresql.connection.pgoutput.PgOutputMessageDecoder.readColumnValueAsString(ByteBuffer)
      Unfortunately the coming valus is UTF-* but the conversion is platform specific so if the system is not using UTF-8 as the default one then the string is garbled.

      Workaround - when Kafka Connect is started, set env variable KAFKA_OPTS=-Dfile.encoding=UTF-8 which switches default JVM encoding.

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                ccranfor Chris Cranford
                Reporter:
                jpechanec Jiri Pechanec
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: