Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5129

Avoid reading entire schema history file into memory in the test suite

    XMLWordPrintable

Details

    • False
    • None
    • False

    Description

      In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.

      Which use case/requirement will be addressed by the proposed feature?

      Developers can use the test suite to reproduce issues in isolation. When testing database schema recovery, the number of history messages may be significantly larger than the number of objects in the resulting schema (e.g. many repetitive CREATE and DROP statements related to the same object).

      In this case, even if the resulting schema perfectly fits into memory, the history may not. As a result, an attempt to recover large history in the test suite results in an OOM error:

      java.lang.OutOfMemoryError: Java heap space

      Implementation ideas

      Instead of reading the entire file at once and iterating the resulting list, read the file line by line.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sergeimorozov Sergei Morozov
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: