Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2653

WAL logs are not flushed in Postgres Connector

    XMLWordPrintable

Details

    Description

      In Debezium Postgres Connector of versions 1.2.2.Final to 1.2.5.Final or 1.3.0.Final, if the connector config contains parameter provide.transaction.metadata set as true then lsn_commit in connect_offsets does not get updated after the connector restarts while lsn_proc keeps on increasing. Thus confirmed_flush_lsn of the replication slot does not get updated, resulting in an ever-increasing replication slot size.

      ["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"602","lsn_proc":34090616,"lsn":34090616,"txId":602,"ts_usec":1602599369749104}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"602","lsn_proc":34090616,"lsn":34090616,"txId":602,"ts_usec":1602599369749104}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"603","lsn_proc":34091704,"lsn":34091704,"transaction_data_collection_order_inventory.customers":1,"txId":603,"ts_usec":1602599467052014}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"604","lsn_proc":34092408,"lsn":34092408,"transaction_data_collection_order_inventory.customers":1,"txId":604,"ts_usec":1602599516413012}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"605","lsn_proc":34093816,"lsn_commit":34092408,"lsn":34093816,"transaction_data_collection_order_inventory.customers":1,"txId":605,"ts_usec":1602599608291939}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"606","lsn_proc":34094384,"lsn_commit":34092408,"lsn":34094384,"transaction_data_collection_order_inventory.customers":1,"txId":606,"ts_usec":1602599698748016}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"609","lsn_proc":34095136,"lsn_commit":34092408,"lsn":34095136,"transaction_data_collection_order_inventory.customers":1,"txId":609,"ts_usec":1602599776699490}
      

      Attachments

        Activity

          People

            jpechane Jiri Pechanec
            akshayagarwal Akshay Agarwal (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: