Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-14187

APIRemovedInNextEUSReleaseInUse alerts for flowschemas/prioritylevelconfigurations v1beta2 version

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done-Errata
    • Major
    • None
    • 4.14.0
    • kube-apiserver
    • No
    • Rejected
    • False
    • Hide

      None

      Show
      None

    Description

      Description of problem:

      APIRemovedInNextEUSReleaseInUse alerts for flowschemas/prioritylevelconfigurations, in OCP 4.14, api version for flowschemas/prioritylevelconfigurations is v1beta3, not v1beta2

      $ token=`oc create token prometheus-k8s -n openshift-monitoring`
      $ oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "Authorization: Bearer $token" 'https://thanos-querier.openshift-monitoring.svc:9091/api/v1/query?' --data-urlencode 'query=ALERTS{alertname="APIRemovedInNextEUSReleaseInUse"}' | jq
      {
        "status": "success",
        "data": {
          "resultType": "vector",
          "result": [
            {
              "metric": {
                "__name__": "ALERTS",
                "alertname": "APIRemovedInNextEUSReleaseInUse",
                "alertstate": "firing",
                "group": "flowcontrol.apiserver.k8s.io",
                "namespace": "openshift-kube-apiserver",
                "prometheus": "openshift-monitoring/k8s",
                "removed_release": "1.29",
                "resource": "flowschemas",
                "severity": "info",
                "version": "v1beta2"
              },
              "value": [
                1685344116.843,
                "1"
              ]
            },
            {
              "metric": {
                "__name__": "ALERTS",
                "alertname": "APIRemovedInNextEUSReleaseInUse",
                "alertstate": "firing",
                "group": "flowcontrol.apiserver.k8s.io",
                "namespace": "openshift-kube-apiserver",
                "prometheus": "openshift-monitoring/k8s",
                "removed_release": "1.29",
                "resource": "prioritylevelconfigurations",
                "severity": "info",
                "version": "v1beta2"
              },
              "value": [
                1685344116.843,
                "1"
              ]
            }
          ]
        }
      }
      $ oc explain flowschemas
      KIND:     FlowSchema
      VERSION:  flowcontrol.apiserver.k8s.io/v1beta3
      ...
      
      $ oc explain prioritylevelconfigurations
      KIND:     PriorityLevelConfiguration
      VERSION:  flowcontrol.apiserver.k8s.io/v1beta3
      ... 

      apirequest,  flowschemas/prioritylevelconfigurations v1beta2 are used by openshift-oauth-apiserver

      $ oc get apirequestcounts flowschemas.v1beta2.flowcontrol.apiserver.k8s.io -o yaml
      apiVersion: apiserver.openshift.io/v1
      kind: APIRequestCount
      metadata:
        creationTimestamp: "2023-05-29T03:43:20Z"
        generation: 1
        name: flowschemas.v1beta2.flowcontrol.apiserver.k8s.io
        resourceVersion: "105247"
        uid: 8d56ba66-c996-438f-ba1f-2529afab912b
      spec:
        numberOfUsersToReport: 10
      status:
        currentHour:
          byNode:
          - byUser:
            - byVerb:
              - requestCount: 2
                verb: watch
              requestCount: 2
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 2
          requestCount: 2
        last24h:
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 3
                verb: list
              - requestCount: 24
                verb: patch
              - requestCount: 14
                verb: watch
              requestCount: 41
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 41
          requestCount: 41
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 23
                verb: watch
              requestCount: 23
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 23
          requestCount: 23
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 26
                verb: watch
              requestCount: 26
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 26
          requestCount: 26
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 24
                verb: watch
              requestCount: 24
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 24
          requestCount: 24
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 2
                verb: watch
              requestCount: 2
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 2
          requestCount: 2
        - requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        removedInRelease: "1.29"
        requestCount: 116
      $ oc get apirequestcounts prioritylevelconfigurations.v1beta2.flowcontrol.apiserver.k8s.io -oyaml
      apiVersion: apiserver.openshift.io/v1
      kind: APIRequestCount
      metadata:
        creationTimestamp: "2023-05-29T03:44:28Z"
        generation: 1
        name: prioritylevelconfigurations.v1beta2.flowcontrol.apiserver.k8s.io
        resourceVersion: "106847"
        uid: 8e4306a4-2de0-44af-a0e4-e630e30ca68e
      spec:
        numberOfUsersToReport: 10
      status:
        currentHour:
          byNode:
          - byUser:
            - byVerb:
              - requestCount: 3
                verb: watch
              requestCount: 3
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 3
          requestCount: 3
        last24h:
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 3
                verb: list
              - requestCount: 13
                verb: watch
              requestCount: 16
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 16
          requestCount: 16
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 24
                verb: watch
              requestCount: 24
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 24
          requestCount: 24
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 23
                verb: watch
              requestCount: 23
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 23
          requestCount: 23
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 25
                verb: watch
              requestCount: 25
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 25
          requestCount: 25
        - byNode:
          - byUser:
            - byVerb:
              - requestCount: 3
                verb: watch
              requestCount: 3
              userAgent: oauth-apiserver/v0.0.0
              username: system:serviceaccount:openshift-oauth-apiserver:oauth-apiserver-sa
            nodeName: 10.0.145.219
            requestCount: 3
          requestCount: 3
        - requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        - byNode:
          - nodeName: 10.0.145.219
            requestCount: 0
          requestCount: 0
        removedInRelease: "1.29"
        requestCount: 91 

      Version-Release number of selected component (if applicable):

      $ oc get clusterversion
      NAME      VERSION                              AVAILABLE   PROGRESSING   SINCE   STATUS
      version   4.14.0-0.nightly-2023-05-28-015206   True        False         3h42m   Cluster version is 4.14.0-0.nightly-2023-05-28-015206
      

      How reproducible:

      always

      Steps to Reproduce:

      1. check alerts
      2.
      3.
      

      Actual results:

      APIRemovedInNextEUSReleaseInUse alerts for flowschemas/prioritylevelconfigurations v1beta2 version

      Expected results:

      no such alert

      Attachments

        Issue Links

          Activity

            People

              dgrisonn@redhat.com Damien Grisonnet
              juzhao@redhat.com Junqi Zhao
              Ke Wang Ke Wang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: