Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-892

Connector Postgres runs out of disk space

    XMLWordPrintable

    Details

      Description

      After deploying the Debezium connector for Postgres in our unstable environment we faced our Postgres instance quickly running out of space.

      We have a Postgres instance where we have two databases: production and unstable.

      The connector is configured to capture changes from the unstable database. The changes on unstable are few and the connector works correctly.
      However, the traffic on the production database is quite high and we noticed that the disk space increases monotonically until we almost ran out of disk space.

      After stopping the connector and deleting the replication slot, the disk space was freed up.
      It appears to me that `replication_slots` in Postgres work across databases and the Connector is not listening to the event of other databases.

        Attachments

        1. debezium.png
          debezium.png
          42 kB
        2. free.jpg
          free.jpg
          65 kB
        3. heartbeat.jpg
          heartbeat.jpg
          50 kB
        4. leak.JPG
          leak.JPG
          60 kB
        5. Screen Shot 2018-09-03 at 09.58.53.png
          Screen Shot 2018-09-03 at 09.58.53.png
          130 kB
        6. Screenshot 2018-12-11 at 10.44.35.png
          Screenshot 2018-12-11 at 10.44.35.png
          41 kB
        7. Screenshot 2018-12-11 at 10.44.54.png
          Screenshot 2018-12-11 at 10.44.54.png
          40 kB
        8. Transaction Logs Usage.png
          Transaction Logs Usage.png
          190 kB

          Issue Links

            Activity

              People

              Assignee:
              jpechanec Jiri Pechanec
              Reporter:
              andreybratus Andrii Bratus (Inactive)
              Votes:
              7 Vote for this issue
              Watchers:
              16 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: