Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-14199

nova_libvirt container creating many open files and not closing them

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Minor Minor
    • None
    • rhos-16.2.z
    • nova-operator
    • None
    • 4
    • False
    • Hide

      None

      Show
      None
    • False
    • ?
    • None
    • Moderate

      To Reproduce Steps to reproduce the behavior:

      1. deploy RHOSP 16.2.4
      2. check `lsof |grep -c libvirt` on a compute node
      3. allow time to pass/create and delete many instances on this compute node
      4. check `lsof |grep -c libvirt` again on the same compute node
      5. observe the number of open files is significantly higher than before

      Expected behavior

      • Number of open files remains relatively unchanged or at least proportional to the number of running instances

      Bug impact

      • If left unchecked the open files can grow high enough to cause libvirt to crash with a too many open files error:
      2025-02-12 23:21:41.183+0000: 3721136: error : virPortAllocatorBindToPort:164 : Unable to open test socket: Too many open files 

      Known workaround

      • Restarting the nova_libvirt container will close out the stale open files but these will continue to increase over time again

      Additional context

      • This is a very busy environment with 400+ instances per compute node and these instances are being created/deleted often

              ksambor@redhat.com Kamil Sambor
              rhn-support-nalmond Nick Almond
              rhos-dfg-compute
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: