Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7777

Improve processing speed of async engine processors which use List#get()

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • Major
    • 2.7.0.Alpha1
    • 2.6.2.Final
    • embedded-engine
    • None

    Description

      Some async engine processors use List#get() method in a cycle iterating over all the records, sometimes several times, e.g. iterating also over created Future objects.
      It seems that calling this method is very slow and causes huge slowness of these processors, see attached picture from async profiler, showing that about 99.5% of time is spent in List#get(). Using List.stream() or iterating over the record via iterator is much faster and should be used in all these processors instead of calling List#get().

      Attachments

        Activity

          People

            vjuranek@redhat.com Vojtech Juranek
            vjuranek@redhat.com Vojtech Juranek
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: