Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2662

Control ChangeEventQueue by the size in bytes

    XMLWordPrintable

Details

    • Feature Request
    • Resolution: Done
    • Major
    • 1.4.0.Alpha2
    • 1.3.0.Final
    • core-library
    • None
    • False
    • False
    • 0
    • 0% 0%
    • Undefined

    Description

      Hi Team,

       

      We are using debezium server with postgres connector, and the issue we are facing is that the database that we subscribe to having a lot of records with big size in bytes each.

      We know that the platform is providing a way to control the number of messages that will be buffered in memory (`max.queue.size`). So we are requesting a feature that also has an option to cache messages in bytes with a specific threshold similar to max.queue.size parameter. And then we can combine 2 of those parameters together.

      With this feature, we will avoid Java Heap Memory issue since we don't have knowledge of the message size in bytes.

       

      Thanks,

      Hoa.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              vanhoael Hoa Le (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: