Uploaded image for project: 'Red Hat Advanced Cluster Security'
  1. Red Hat Advanced Cluster Security
  2. ROX-31012

Minimize deduper memory usage in TransitionBased update computer

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • 4.10.0
    • None
    • None
    • Future Sustainability
    • False
    • Hide

      None

      Show
      None
    • False
    • Not Selected
    • Hide
      Sensor Network Flows pipeline consumes now less memory, which can translate to saving ~50MB of entire Sensor's memory for typical scenarios.

      For clusters with very intensive workload (with ~6k new opened connections per minute), the memory consumption saving can reach even 1GB.
      Show
      Sensor Network Flows pipeline consumes now less memory, which can translate to saving ~50MB of entire Sensor's memory for typical scenarios. For clusters with very intensive workload (with ~6k new opened connections per minute), the memory consumption saving can reach even 1GB.
    • Yes

      This is about implementing the following plan:

      binary_key_optimization_plan.md

      The goal is to reduce memory footprint of `TransitionBased.endpointsDeduper` by switching the string key and values to `[8]byte` instead. Cursor estimates the memory savings to be 75% but that feels a bit too much. I think that ~50% savings may be possible.

        1. binary_key_optimization_plan.md
          7 kB

              prygiels@redhat.com Piotr Rygielski
              prygiels@redhat.com Piotr Rygielski
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: