Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2653

WAL logs are not flushed in Postgres Connector

XMLWordPrintable

      In Debezium Postgres Connector of versions 1.2.2.Final to 1.2.5.Final or 1.3.0.Final, if the connector config contains parameter provide.transaction.metadata set as true then lsn_commit in connect_offsets does not get updated after the connector restarts while lsn_proc keeps on increasing. Thus confirmed_flush_lsn of the replication slot does not get updated, resulting in an ever-increasing replication slot size.

      ["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"602","lsn_proc":34090616,"lsn":34090616,"txId":602,"ts_usec":1602599369749104}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"602","lsn_proc":34090616,"lsn":34090616,"txId":602,"ts_usec":1602599369749104}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"603","lsn_proc":34091704,"lsn":34091704,"transaction_data_collection_order_inventory.customers":1,"txId":603,"ts_usec":1602599467052014}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"604","lsn_proc":34092408,"lsn":34092408,"transaction_data_collection_order_inventory.customers":1,"txId":604,"ts_usec":1602599516413012}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"605","lsn_proc":34093816,"lsn_commit":34092408,"lsn":34093816,"transaction_data_collection_order_inventory.customers":1,"txId":605,"ts_usec":1602599608291939}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"606","lsn_proc":34094384,"lsn_commit":34092408,"lsn":34094384,"transaction_data_collection_order_inventory.customers":1,"txId":606,"ts_usec":1602599698748016}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"609","lsn_proc":34095136,"lsn_commit":34092408,"lsn":34095136,"transaction_data_collection_order_inventory.customers":1,"txId":609,"ts_usec":1602599776699490}
      

              jpechane Jiri Pechanec
              akshayagarwal Akshay Agarwal (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: