Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-892

Connector Postgres runs out of disk space

    Details

      Description

      After deploying the Debezium connector for Postgres in our unstable environment we faced our Postgres instance quickly running out of space.

      We have a Postgres instance where we have two databases: production and unstable.

      The connector is configured to capture changes from the unstable database. The changes on unstable are few and the connector works correctly.
      However, the traffic on the production database is quite high and we noticed that the disk space increases monotonically until we almost ran out of disk space.

      After stopping the connector and deleting the replication slot, the disk space was freed up.
      It appears to me that `replication_slots` in Postgres work across databases and the Connector is not listening to the event of other databases.

        Gliffy Diagrams

          Attachments

          1. debezium.png
            debezium.png
            42 kB
          2. free.jpg
            free.jpg
            65 kB
          3. heartbeat.jpg
            heartbeat.jpg
            50 kB
          4. leak.JPG
            leak.JPG
            60 kB
          5. Screen Shot 2018-09-03 at 09.58.53.png
            Screen Shot 2018-09-03 at 09.58.53.png
            130 kB
          6. Screenshot 2018-12-11 at 10.44.35.png
            Screenshot 2018-12-11 at 10.44.35.png
            41 kB
          7. Screenshot 2018-12-11 at 10.44.54.png
            Screenshot 2018-12-11 at 10.44.54.png
            40 kB
          8. Transaction Logs Usage.png
            Transaction Logs Usage.png
            190 kB

            Issue Links

              Activity

                People

                • Assignee:
                  jpechanec Jiri Pechanec
                  Reporter:
                  andreybratus Andrii Bratus
                • Votes:
                  7 Vote for this issue
                  Watchers:
                  16 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: