Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2653

WAL logs are not flushed in Postgres Connector

    XMLWordPrintable

    Details

      Description

      In Debezium Postgres Connector of versions 1.2.2.Final to 1.2.5.Final or 1.3.0.Final, if the connector config contains parameter provide.transaction.metadata set as true then lsn_commit in connect_offsets does not get updated after the connector restarts while lsn_proc keeps on increasing. Thus confirmed_flush_lsn of the replication slot does not get updated, resulting in an ever-increasing replication slot size.

      ["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"602","lsn_proc":34090616,"lsn":34090616,"txId":602,"ts_usec":1602599369749104}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"602","lsn_proc":34090616,"lsn":34090616,"txId":602,"ts_usec":1602599369749104}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"603","lsn_proc":34091704,"lsn":34091704,"transaction_data_collection_order_inventory.customers":1,"txId":603,"ts_usec":1602599467052014}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"604","lsn_proc":34092408,"lsn":34092408,"transaction_data_collection_order_inventory.customers":1,"txId":604,"ts_usec":1602599516413012}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"605","lsn_proc":34093816,"lsn_commit":34092408,"lsn":34093816,"transaction_data_collection_order_inventory.customers":1,"txId":605,"ts_usec":1602599608291939}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"606","lsn_proc":34094384,"lsn_commit":34092408,"lsn":34094384,"transaction_data_collection_order_inventory.customers":1,"txId":606,"ts_usec":1602599698748016}["inventory-connector",{"server":"dbserver1"}] {"transaction_id":"609","lsn_proc":34095136,"lsn_commit":34092408,"lsn":34095136,"transaction_data_collection_order_inventory.customers":1,"txId":609,"ts_usec":1602599776699490}
      

        Attachments

          Activity

            People

            Assignee:
            jpechanec Jiri Pechanec
            Reporter:
            akshayagarwal Akshay Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: