Uploaded image for project: 'Satellite'
  1. Satellite
  2. SAT-41093

"Too many open files" error during capsule content consumption (especially Streamed capsules)

XMLWordPrintable

    • False
    • Artemis Refinement Backlog
    • sat-artemis
    • None
    • None
    • None
    • None
    • Yes

      Description of problem:

      Capsule content consumption by clients on Satellite 6.18 (any version with Pulpcore 3.73) are reportedly eventually halted by too many files being opened on the file system. It is more noticeable with Streamed capsules. The cause seems to be that /dev/urandom is left open too many times.

      This bug report comes from https://github.com/pulp/pulpcore/issues/7157

      How reproducible:

      According to the bug report, 100%

      Is this issue a regression from an earlier version:

      Yes, 6.17

      Steps to Reproduce:

      1. Set up a capsule with the streamed download policy and consume RPMs from it using a few registered hosts.

      2. Use the following to view the number of open files:

       

      for pid in $(ps aux | grep pulpcore-content | awk '{ print $2 }'); do echo "PID: $pid"; lsof -p "$pid" | grep urandom  | wc -l; done 

       

       

      3. See OSError: [Errno 24] Too many open files during content consumption (e.g. installing RPMs)

      Actual behavior:
      Consuming content from Pulp on the capsule fails

      Expected behavior:
      Consuming content works

      Business Impact / Additional info:

      This issue is reportedly much better on Pulpcore 3.85, however there are still counts of /dev/urandom being left open.

      Note that we haven't yet seen reports about this issue, but it could be due to how new 6.18 is. This should be investigated proactively.

              Unassigned Unassigned
              iballou@redhat.com Ian Ballou
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: