Uploaded image for project: 'Hybrid Cloud Console'
  1. Hybrid Cloud Console
  2. RHCLOUD-28314

[QE] [payload-tracker] [High] Modify PT so that it is possible to use bulk insertion of records

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Won't Do
    • Icon: Normal Normal
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Unset
    • No

      Payload-tracker normally has a 5+ million kafka lag.

      As a first step to work towards improving this, I think we should modify PT to use bulk inserts.  Locally, buik inserts cuts the insertion time of 10,000 records in half.

      I think we should make a new implemntation of the InsertPayloadStatus() method which uses a configurable batch size.  We should also make it possible to switch between the 2 implementations (bulk, non-bulk).

      I would start out with a batch size of 10 as the default and go from there depending on how it goes.

              bschneid@redhat.com Brandon Schneider
              bschneid@redhat.com Brandon Schneider
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: