Uploaded image for project: 'Red Hat Advanced Cluster Security'
  1. Red Hat Advanced Cluster Security
  2. ROX-30867

Batch process indicators adds in the datastore

    • Icon: Task Task
    • Resolution: Done
    • Icon: Critical Critical
    • 4.9.0, 4.7.7, 4.8.5
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Rox Sprint 4.9H - Global

      Process indicators are collected over a period and written in batches.  This often results in it going down the path of copyFrom in the store.  CopyFrom batches them in batches of 10000.  However, copyfrom requires a lock because it does a delete and we want to avoid deadlocks and odd states of rows getting written  So we have a lock. This is also done under a single transaction. The problem is that under large batches of indicators we wind up holding a lock and a transaction for a long time.  This puts strain on central and central-db.  In benchmark testing I could not even successfully add groups of 500K indicators because the mutex would timeout.   

              rh-ee-dashrews David Shrewsberry
              rh-ee-dashrews David Shrewsberry
              ACS Core Workflows
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: