Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-9128

Implement caching in table inclusion filter

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Major Major
    • 3.2.0.CR1
    • None
    • core-library
    • None
    • False
    • Hide

      None

      Show
      None
    • False

      the `isIncluded` here would be called for each and every change event received from the binary log. The table include list for a task can not be updated without re-creating the task, hence it would make sense to cache the results of this table filtering in-memory rather than doing this seemingly repititive table filter computation on every change event.

      We recently encountered a case where CPU usage was extremely high and this was found to be the culprit. The regex specified for the task was very suboptimal, which lead to huge time being spent in the filtering part.

              Unassigned Unassigned
              akanimesh7 Animesh Kumar
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: