OCP 4.16.16 - the issue doesn't reproduce.

Verifying.

Upgraded the setup to 4.16.16.

Let's give it 2-3 weeks to gather some data.

achuzhoy@redhat.com the advisory is talking about 4.16.16, can you try this version?

rhn-engineering-dtantsurjadha I was forced to re-open this issue.

12 days ago I upgraded my 4.16 setup to 4.16.15
The issue still reproduces.

jadha Please add version and verification steps when you verify the issue.

Since the problem described in this issue should be resolved in a recent advisory, it has been closed.

For information on the advisory (Important: OpenShift Container Platform 4.16.16 bug fix and security update), and where to find the updated files, follow the link below.

If the solution does not work for you, open a new bug report.
https://access.redhat.com/errata/RHSA-2024:7599

jadha What version was that?
rhn-engineering-dtantsur Do you know what Z version we should upgrade to to have the fix in?

Thanks.

used below script:
while true; do
date -u;
date -u >> ~/report;
oc exec -n openshift-machine-api -c metal3-ironic-inspector metal3-6b75d75847-xzmhh – \
grep Rss /proc/1/status >> ~/report;
sleep 600;
done
 
cat report
Sun Sep 29 14:21:48 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 14:31:49 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 14:41:56 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 14:52:03 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 15:02:09 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 15:12:16 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 15:22:22 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 15:32:29 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 15:42:37 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 15:52:44 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 16:02:52 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 16:13:00 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 16:23:08 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 16:33:16 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 16:43:25 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 16:53:32 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 17:03:41 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 17:13:49 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 17:23:58 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 17:34:06 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 17:44:14 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 17:54:22 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 18:04:30 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 18:14:38 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 18:24:47 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 18:34:55 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 18:45:03 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 18:55:11 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 19:05:19 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 19:15:28 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 19:25:36 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 19:35:45 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
Sun Sep 29 19:45:53 UTC 2024
RssAnon: 84404 kB
RssFile: 16512 kB
RssShmem: 0 kB
 

Ooops, my bad, I forgot to backport to 4.16. Will do now.

This seems like the issue we reported on 4.15 (https://issues.redhat.com/browse/OCPBUGS-32261)

The issue seems to reproduce on 4.16.6

The graph again shows constant growth of memory usage.