Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-55512

Abnormal memory usage is observed in kube-apiserver pods whereas memory spikes is upto 256 GB.

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Critical Critical
    • None
    • 4.16.z
    • kube-apiserver
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Critical
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      The kube-apiserver pods are consuming memory at an unusually high rate, with the maximum consumption reaching 256GB.
      
      There is no usage on the cluster. 
      
      $ omc etcd status
      +----------------------------+------------------+---------+----------------+----------+-----------+------------+-----------+------------+--------------------+--------+
      |          ENDPOINT          |        ID        | VERSION | DB SIZE/IN USE | NOT USED | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS |
      +----------------------------+------------------+---------+----------------+----------+-----------+------------+-----------+------------+--------------------+--------+
      | https://10.110.145.68:2379 | c312c0a6033fd713 | 3.5.14  | 894 MB/618 MB  | 31%      | false     | false      |       219 | 3228027057 |         3228027057 |        |
      | https://10.110.145.67:2379 | c63b93a1c4db6e4d | 3.5.14  | 898 MB/618 MB  | 32%      | false     | false      |       219 | 3228027061 |         3228027061 |        |
      | https://10.110.145.69:2379 | d95aaf3f128dc031 | 3.5.14  | 905 MB/618 MB  | 32%      | true      | false      |       219 | 3228027061 |         3228027061 |        |
      +----------------------------+------------------+---------+----------------+----------+-----------+------------+-----------+------------+--------------------+--------+

       

       

      Version-Release number of selected component (if applicable):

           Cluster version is 4.16.17

      How reproducible:

          

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

          

      Expected results:

          

      Additional info:

          All the logs and data is uploaded in the folder : https://drive.google.com/drive/u/0/folders/1SdRpRT0EXk4aW0d-SKEDEdSQI0y5059M

              Unassigned Unassigned
              rhn-support-zekhan Zeba Khan
              None
              None
              Ke Wang Ke Wang
              None
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: