Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4362

getTableColumnsFromDatabase - Failed to read column metadata with I/O Error

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Critical
    • None
    • 1.7.1.Final
    • postgresql-connector
    • None
    • False
    • False

    Description

      We experience an exception that is causing the task to stop in our postgres connector.

      We see the following error in the logs.

       

      [ERROR] 2021-11-25 10:29:25,245 [debezium-postgresconnector-GatewayDepot87-change-event-source-coordinator] io.debezium.connector.postgresql.connection.pgoutput.PgOutputMessageDecoder getTableColumnsFromDatabase - Failed to read column metadata for 'public.tbeventqueue'
      [ERROR] 2021-11-25 10:29:25,245 [debezium-postgresconnector-GatewayDepot87-change-event-source-coordinator] io.debezium.pipeline.ErrorHandler setProducerThrowable - Producer failure
      org.postgresql.util.PSQLException: An I/O error occurred while sending to the backend.

       

      We are connecting Postgres Connector 1.7.1 to PostgreSQL Database version 13.5. This error occurs sometimes (i.e. we can't replicate this reliably) under the following conditions:

      • The connector is created
      • A certain timespan passes (some hours) without inserting data to the table we specify in table.include.list
      • After the timespan we insert some data to the table -> then the exception occurs, connector task fails.

       

      We are aware of DBZ-3769 which reports a similar error, however we fail explicitly with Error "An I/O error occurred while sending to the backend" and are already on 1.7.1.

       

      Attachments

        1. Connectlog_BS_psqlexception_ioerror.log
          14 kB
        2. kc-log.txt
          9 kB
        3. tpc-log.txt
          11 kB

        Issue Links

          Activity

            People

              Unassigned Unassigned
              basil35543 Basil Sattler (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: