Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7008

Provide a configurable limit for number of rows returned by change query

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False

      hello everyone

      after doing a debezium upgrade (version 2.1.1.Final) restarting the container and running the snapshot successfully (of a huge database), after one day we had an OutOfMemoryError problem. Do you have any idea what the problem might be?

      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "mysql-cj-abandoned-connection-cleanup"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "SourceTaskOffsetCommitter-1"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "kafka-producer-network-thread | connector-producer-sage-connector-0"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "debezium-sqlserverconnector-_cdc-change-event-source-coordinator"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-1-thread-2"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "kafka-producer-network-thread | _cdc-schemahistory"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connector-Scheduler-46f73ffa-1"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp605472344-26"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp605472344-29"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp605472344-28"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp605472344-25"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp605472344-24"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp605472344-27"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp605472344-30"
      Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Session-HouseKeeper-2296127-1"

      debezium for sqlserver has been active for over 3 years and has a value of -Xmx2G. Is this value still sufficient? how can it be increased?

      We tryed to increase the xmx with environment variable HEAP_OPTS but without success.

      Thanks in advance for those who have any suggestions.

        1. heap.png
          36 kB
          Damiano Pisconti

              Unassigned Unassigned
              damiano01 Damiano Pisconti (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: