Uploaded image for project: 'Hybrid Cloud Console'
  1. Hybrid Cloud Console
  2. RHCLOUD-28037

[payload-tracker] [tech-debt] Modify PT so that it is possible to use bulk insertion of records

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Won't Do
    • Icon: Normal Normal
    • None
    • None
    • None
    • 8
    • False
    • Hide

      None

      Show
      None
    • False
    • Unset
    • No
    • Platform Pipeline Tech Debt

      Payload-tracker normally has a 5+ million kafka lag.

      As a first step to work towards improving this, I think we should modify PT to use bulk inserts.  Locally, buik inserts cuts the insertion time of 10,000 records in half.

      I think we should make a new implemntation of the InsertPayloadStatus() method which uses a configurable batch size.  We should also make it possible to switch between the 2 implementations (bulk, non-bulk).

      I would start out with a batch size of 10 as the default and go from there depending on how it goes.

              Unassigned Unassigned
              rhn-support-dehort Derek Horton
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: