Uploaded image for project: 'Red Hat Advanced Cluster Security'
  1. Red Hat Advanced Cluster Security
  2. ROX-32658

[ENG] Hash Table Architecture Redesign and Optimization

    • Icon: Feature Feature
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • False
    • Not Selected
    • 50% To Do, 0% In Progress, 50% Done
    • Hide

      Progress:  We have updated what gets hashed to be inclusive instead of exclusive.  Which means we are not hashing as many things as we did before.  Relatively static things like Compliance Operator profiles we do not bother to dedupe.  We also do are not storing hashes for volatile things like node index reports that would essentially be different every time.  These changes have reduced the amount of things we hash.
      Additionally we have put in changes for things like with lists of items where the order is irrelevant.  Such objects were flagging as new when in essence they were actually dupes.  So this as well helps with the amount of data we are storing into the hashes table.

      Problem:

      Plan:  With the information provided above and the extra metrics that were added into 4.9, we recommend pushing this to 4.11 (or later) after we see what the real impact of the changes above are.

      Show
      Progress:  We have updated what gets hashed to be inclusive instead of exclusive.  Which means we are not hashing as many things as we did before.  Relatively static things like Compliance Operator profiles we do not bother to dedupe.  We also do are not storing hashes for volatile things like node index reports that would essentially be different every time.  These changes have reduced the amount of things we hash. Additionally we have put in changes for things like with lists of items where the order is irrelevant.  Such objects were flagging as new when in essence they were actually dupes.  So this as well helps with the amount of data we are storing into the hashes table. Problem: Plan:  With the information provided above and the extra metrics that were added into 4.9, we recommend pushing this to 4.11 (or later) after we see what the real impact of the changes above are.

      Goal Summary:

      An elevator pitch (value statement) that describes the Feature in a clear, concise way. Complete during New status.

      The uses of the hashes table has caused various installations to have runaway growth in the amount of space the database consumes.  The hashes table should be redesigned to ensure it is properly deduping records and only storing records that can be duplicates.  If it stores objects that are always unique it will only ever grow.

      Goals and expected user outcomes:

      The observable functionality that the user now has as a result of receiving this feature. Include the anticipated primary user type/persona and which existing features, if any, will be expanded. Complete during New status.

      Stable and predictable space consumption of the hashes table.

      Acceptance Criteria:

      A list of specific needs or objectives that a feature must deliver in order to be considered complete. Be sure to include nonfunctional requirements such as security, reliability, performance, maintainability, scalability, usability, etc. Initial completion during Refinement status.

      <enter general Feature acceptance here>

      Success Criteria or KPIs measured:

      A list of specific, measurable criteria that will be used to determine if the feature is successful. Include key performance indicators (KPIs) or other metrics., etc. Initial completion during Refinement status.

      <enter success criteria and/or KPIs here>

      Use Cases (Optional):

      Include use case diagrams, main success scenarios, alternative flow scenarios together with user type/persona. Initial completion during Refinement status.

      <your text here>

      Out of Scope (Optional):

      High-level list of items that are out of scope. Initial completion during Refinement status.

      <your text here>

              vle@redhat.com Vu Le
              rh-ee-dashrews David Shrewsberry
              David Shrewsberry David Shrewsberry
              ACS Core Workflows
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: