Uploaded image for project: 'Data Foundation Bugs'
  1. Data Foundation Bugs
  2. DFBUGS-2293

noobaa process memory consumption should come down when no IO is active

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Undefined Undefined
    • None
    • odf-4.18.2
    • noobaa-nc
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • ?
    • ?
    • ppc64le
    • ?
    • ?
    • Hide

      Memory consumption should ideally come down..

      Show
      Memory consumption should ideally come down..
    • None

      Previous issue (https://issues.redhat.com/browse/DFBUGS-2292)

      For the workload described in the above defect, the noobaa process has allotted memory while running the job and it was aborted due to timeout. However the noobaa process memory consumption stay as-is even after 2hrs min when there is no other workload running in the system. Is there a possible reason for the memory leak here ?

      systemctl status noobaa
      ● noobaa.service - The NooBaa service.
           Loaded: loaded (/usr/lib/systemd/system/noobaa.service; disabled; preset: disabled)
           Active: active (running) since Thu 2025-04-17 06:27:52 EDT; 3 days ago
         Main PID: 788541 (noobaa)
            Tasks: 69 (limit: 417394)
           Memory: 9.2G
              CPU: 3h 24min 22.983s
           CGroup: /system.slice/noobaa.service
                   ├─788541 noobaa
                   ├─788988 noobaa
                   └─788989 noobaa

      Apr 21 01:57:57 node-gui0 [788988]: [nsfs/788988]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hostn>
      Apr 21 01:57:57 node-gui0 [788988]: [nsfs/788988]   [LOG] CONSOLE:: { timestamp: 1745215077654, group_name: 'default-endpoint-group', hostname: 'gpfs-p10>
      Apr 21 02:07:57 node-gui0 [788989]: [nsfs/788989]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hostn>
      Apr 21 02:07:57 node-gui0 [788989]: [nsfs/788989]   [LOG] CONSOLE:: { timestamp: 1745215677646, group_name: 'default-endpoint-group', hostname: 'gpfs-p10>
      Apr 21 02:07:57 node-gui0 [788988]: [nsfs/788988]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hostn>
      Apr 21 02:07:57 node-gui0 [788988]: [nsfs/788988]   [LOG] CONSOLE:: { timestamp: 1745215677653, group_name: 'default-endpoint-group', hostname: 'gpfs-p10>
      Apr 21 02:17:57 node-gui0 [788989]: [nsfs/788989]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hostn>
      Apr 21 02:17:57 node-gui0 [788989]: [nsfs/788989]   [LOG] CONSOLE:: { timestamp: 1745216277647, group_name: 'default-endpoint-group', hostname: 'gpfs-p10>
      Apr 21 02:17:57 node-gui0 [788988]: [nsfs/788988]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hostn>
      Apr 21 02:17:57 node-gui0 [788988]: [nsfs/788988]   [LOG] CONSOLE:: { timestamp: 1745216277657, group_name: 'default-endpoint-group', hostname: 'gpfs-p10>

      systemctl status noobaa
      ● noobaa.service - The NooBaa service.
           Loaded: loaded (/usr/lib/systemd/system/noobaa.service; disabled; preset: disabled)
           Active: active (running) since Thu 2025-04-17 06:27:53 EDT; 3 days ago
         Main PID: 1042516 (noobaa)
            Tasks: 69 (limit: 202357)
           Memory: 4.3G
              CPU: 3h 28min 46.263s
           CGroup: /system.slice/noobaa.service
                   ├─1042516 noobaa
                   ├─1042815 noobaa
                   └─1042816 noobaa

      Apr 21 01:27:58 node-gui1 [1042816]: [nsfs/1042816]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hos>
      Apr 21 01:27:58 node-gui1 [1042816]: [nsfs/1042816]   [LOG] CONSOLE:: { timestamp: 1745213278521, group_name: 'default-endpoint-group', hostname: 'gpfs-p>
      Apr 21 01:37:58 node-gui1 [1042815]: [nsfs/1042815]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hos>
      Apr 21 01:37:58 node-gui1 [1042815]: [nsfs/1042815]   [LOG] CONSOLE:: { timestamp: 1745213878499, group_name: 'default-endpoint-group', hostname: 'gpfs-p>
      Apr 21 01:37:58 node-gui1 [1042816]: [nsfs/1042816]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hos>
      Apr 21 01:37:58 node-gui1 [1042816]: [nsfs/1042816]   [LOG] CONSOLE:: { timestamp: 1745213878521, group_name: 'default-endpoint-group', hostname: 'gpfs-p>
      Apr 21 01:47:58 node-gui1 [1042815]: [nsfs/1042815]    [L0] core.endpoint.endpoint:: Sending endpoint report: { group_name: 'default-endpoint-group', hos>

      uptime on the node-gui nodes ,

      node-gui1.:   02:24:11 up 25 days, 21:56,  3 users,  load average: 0.77, 0.28, 0.14
      node-gui0.:   02:24:11 up 25 days, 22:09,  2 users,  load average: 0.00, 0.00, 0.07

              rayalon@redhat.com Rom Ayalon (Inactive)
              rkomandu@in.ibm.com Ravi Kumar Komanduri (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

                Created:
                Updated:
                Resolved: