Uploaded image for project: 'OpenShift Workloads'
  1. OpenShift Workloads
  2. WRKLDS-291

Reducing watch requests in operators

    XMLWordPrintable

Details

    • Story
    • Resolution: Done
    • Critical
    • None
    • None
    • 5
    • False
    • False
    • Undefined
    • Workloads Sprint 201, Workloads Sprint 202, Workloads Sprint 203

    Description

      Two sides of the issue:

      To get the biggest watch offenders, one can run:
      ```
      $ /kubectl-dev_tool audit -f /home/jchaloup/Projects/src/github.com/openshift/installer/must-gather/audit_logs/kube-apiserver/audit.log -otop=50 --verb=watch --by=user
      had 1 line read failures
      count: 44948, first: 2021-05-11T09:48:47+02:00, last: 2021-05-11T11:43:20+02:00, duration: 1h54m32.592105s
      7391x system:serviceaccount:openshift-monitoring:prometheus-operator
      4398x system:serviceaccount:openshift-operator-lifecycle-manager:olm-operator-serviceaccount
      3644x system:serviceaccount:openshift-monitoring:prometheus-k8s
      2704x system:kube-controller-manager
      2000x system:serviceaccount:openshift-cluster-csi-drivers:aws-ebs-csi-driver-operator
      1950x system:serviceaccount:openshift-controller-manager-operator:openshift-controller-manager-operator
      1909x system:node:ip-10-0-166-5.ec2.internal
      1770x system:node:ip-10-0-132-124.ec2.internal
      1745x system:node:ip-10-0-147-213.ec2.internal
      1217x system:node:ip-10-0-170-41.ec2.internal
      1101x system:node:ip-10-0-143-23.ec2.internal
      1098x system:serviceaccount:openshift-ingress-operator:ingress-operator
      ...
      ```

      Attachments

        1. apirequestcounts-4.8-aws.png
          apirequestcounts-4.8-aws.png
          50 kB
        2. apirequestcounts-4.8-azure.png
          apirequestcounts-4.8-azure.png
          42 kB
        3. apirequestcounts-4.8-gcp.png
          apirequestcounts-4.8-gcp.png
          54 kB
        4. apirequestcounts-4.8-metal.png
          apirequestcounts-4.8-metal.png
          44 kB
        5. apirequestcounts-4.8-openstack.png
          apirequestcounts-4.8-openstack.png
          51 kB
        6. apirequestcounts-4.8-ppc64le.png
          apirequestcounts-4.8-ppc64le.png
          44 kB
        7. apirequestcounts-4.8-s390x.png
          apirequestcounts-4.8-s390x.png
          38 kB
        8. apirequestcounts-4.8-vsphere.png
          apirequestcounts-4.8-vsphere.png
          47 kB
        9. collect-must-gather.sh
          4 kB
        10. compute-apirequestsmax.py
          3 kB
        11. plotapirequests.py
          2 kB

        Activity

          People

            jchaloup@redhat.com Jan Chaloupka
            jchaloup@redhat.com Jan Chaloupka
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: