Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-892

Connector Postgres runs out of disk space

    XMLWordPrintable

Details

    Description

      After deploying the Debezium connector for Postgres in our unstable environment we faced our Postgres instance quickly running out of space.

      We have a Postgres instance where we have two databases: production and unstable.

      The connector is configured to capture changes from the unstable database. The changes on unstable are few and the connector works correctly.
      However, the traffic on the production database is quite high and we noticed that the disk space increases monotonically until we almost ran out of disk space.

      After stopping the connector and deleting the replication slot, the disk space was freed up.
      It appears to me that `replication_slots` in Postgres work across databases and the Connector is not listening to the event of other databases.

      Attachments

        1. Transaction Logs Usage.png
          Transaction Logs Usage.png
          190 kB
        2. Screenshot 2018-12-11 at 10.44.54.png
          Screenshot 2018-12-11 at 10.44.54.png
          40 kB
        3. Screenshot 2018-12-11 at 10.44.35.png
          Screenshot 2018-12-11 at 10.44.35.png
          41 kB
        4. Screen Shot 2018-09-03 at 09.58.53.png
          Screen Shot 2018-09-03 at 09.58.53.png
          130 kB
        5. leak.JPG
          leak.JPG
          60 kB
        6. heartbeat.jpg
          heartbeat.jpg
          50 kB
        7. free.jpg
          free.jpg
          65 kB
        8. debezium.png
          debezium.png
          42 kB

        Issue Links

          Activity

            People

              jpechane Jiri Pechanec
              andreybratus Andrii Bratus (Inactive)
              Votes:
              7 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: