Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1889

High log volume from: "Awaiting end of restart backoff period" logs

    XMLWordPrintable

Details

    • Hide

      Run connect.
      Force a disconnect from the database (via increased IOPS if on AWS RDS).
      You should see this log message come in at very high frequencies.

      Show
      Run connect. Force a disconnect from the database (via increased IOPS if on AWS RDS). You should see this log message come in at very high frequencies.

    Description

      The following INFO log output events at very high volumes: 7,000 events/second.

      Connect version: 1.1.0.CR1
      PG Version: 11.5
      Plugin: pgoutput
      JDBC Driver: postgresql-42.2.10

      Infra: All on AWS (RDS, ECS, MKS, etc..)
      Config:

      {
  "name": "postgres-source",
  "config": {
    "connector.class": "io.debezium.connector.postgresql.PostgresConnector",
    "tasks.max": "1",
    "plugin.name": "pgoutput",
    "database.hostname": "postgres",
    "database.port": "5432",
    "database.user": "user",
    "database.password": "password",
    "database.dbname": "dbname",
    "database.server.name": "dbserver1",
    "database.whitelist": "dbname",
    "table.whitelist": "ListOfWhitelist",
    "column.blacklist": "ListOfBlacklist",
    "database.history.kafka.bootstrap.servers": "kafka:9092",
    "database.history.kafka.topic": "schema-changes.topic",
    "key.converter": "org.apache.kafka.connect.storage.StringConverter",
    "value.converter": "org.apache.kafka.connect.json.JsonConverter",
    "value.converter.schemas.enable": "false",
    "schema.refresh.mode": "columns_diff_exclude_unchanged_toast",
    "decimal.handling.mode": "string",
    "offset.flush.timeout.ms": 30000,
    "snapshot.mode": "never"
  }
}

      Specifically,`poll.interval.ms` is undefined and should be defaulted to 1000

      Attachments

        Issue Links

          is related to

          Bug - A problem that impairs or prevents the functions of the product. DBZ-1918 Connector restart logic throttles for the first 2 seconds

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Activity

            People

              jpechane Jiri Pechanec
              nguyenct7 Chuong Nguyen (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: