Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4518

Make KAFKA_QUERY_TIMEOUT configurable

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Done
    • Major
    • 1.9.0.Alpha2
    • 1.8.0.Final
    • core-library
    • None

    Description

      When creating history topic, debezium core module's KafkaDatabaseHistory class make an API call using KafkaAdminClient to get broker default replication factor.

      Currently there is a timeout configured hardcoded of 3 sec.

      Method

      KafkaDatabaseHistory#getKafkaBrokerConfig

      Variable

      KAFKA_QUERY_TIMEOUT

      Why?

      When using AWS MSK cluster which had IAM auth enabled along with TLS encryption, 3 sec isn't enough to make the request. Every time it will be timed out.

      If we increase that to 30 sec, the connection can proceed.
      Note: This is not minimum time that it required, it just a random number.

      The aim here is to make that configurable.

      Attachments

        Activity

          People

            Unassigned Unassigned
            snigdhajyoti Snigdhajyoti Ghosh (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: