Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-3850

Populate APIRequestCount removedInRelease for deprecated v1.apps.openshift.io

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Do
    • Icon: Undefined Undefined
    • 4.15
    • 4.12, 4.14
    • openshift-apiserver
    • Moderate
    • None
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      Seen in 4.12.0-rc.0 CI, PromeCIeus:

      count by (apiserver, group, version, removed_release) (apiserver_requested_deprecated_apis)
      

      includes:

      {apiserver="kube-apiserver", group="storage.k8s.io", removed_release="1.27", version="v1beta1"}
      {apiserver="openshift-apiserver", group="apps.openshift.io", removed_release="1.16", version="v1"}
      

      However, the must-gather's APIRequestCount for those types do not seem to include that removed-release information:

      $ curl -s https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/origin-ci-test/logs/periodic-ci-openshift-release-master-nightly-4.12-e2e-aws-sdn-serial/1590785266463805440/artifacts/e2e-aws-sdn-serial/gather-must-gather/artifacts/must-gather.tar >must-gather.tar.gz
      $ tar tz <must-gather.tar.gz | grep '/apirequestcounts/.*\(v1beta1[.]storage[.]k8s[.]io\|v1[.]apps[.]openshift[.]io\)' | while read P; do tar xOz "${P}" <must-gather.tar.gz | yaml2json | jq -r '.metadata.name as $n | .status
       | .removedInRelease as $r | .last24h[] | (.byNode // [])[] | (.byUser // [])[].username | $r + " " + $n + " " + .'; done | sort | uniq
       csistoragecapacities.v1beta1.storage.k8s.io system:admin
       deploymentconfigs.v1.apps.openshift.io e2e-test-cli-idling-gsj2v-user
       deploymentconfigs.v1.apps.openshift.io e2e-test-cli-idling-pqxmb-user
       deploymentconfigs.v1.apps.openshift.io e2e-test-oc-status-xhwpf-user
       deploymentconfigs.v1.apps.openshift.io system:admin
       deploymentconfigs.v1.apps.openshift.io system:kube-controller-manager
       deploymentconfigs.v1.apps.openshift.io system:serviceaccount:kube-system:namespace-controller
       deploymentconfigs.v1.apps.openshift.io system:serviceaccount:openshift-controller-manager:openshift-controller-manager-sa
       deploymentconfigs.v1.apps.openshift.io system:serviceaccount:openshift-e2e-loki:event-exporter
       deploymentconfigs.v1.apps.openshift.io system:serviceaccount:openshift-infra:deploymentconfig-controller
       deploymentconfigs.v1.apps.openshift.io system:serviceaccount:openshift-infra:unidling-controller
       deploymentconfigs.v1.apps.openshift.io system:serviceaccount:openshift-monitoring:openshift-state-metrics
      $ tar tz <must-gather.tar.gz | grep '/apirequestcounts/.*\(v1beta1[.]storage[.]k8s[.]io\|v1[.]apps[.]openshift[.]io\)' | while read P; do tar xOz "${P}" <must-gather.tar.gz | grep '1[.]\(16\|27\)'; done
      ...no hits...
      

      Version-Release number of selected component (if applicable):

      4.12.0-rc.0 CI. Presumably other 4.12 nightlies are also affected.

      How reproducible:

      No reproduction attempted, but seems likely to be 100% reproduceable.

      Steps to Reproduce:

      1. Run 4.12 CI.
      2. Grep through the must-gather, as shown above, and compare with PromeCIeus count by (apiserver, group, version, removed_release) (apiserver_requested_deprecated_apis) results.

      Actual results:

      Gathered APIRequestCounts and apiserver_requested_deprecated_apis metrics do not agree on a removed-in version for these two {{apiVersion}}s.

      Expected results:

      Gathered APIRequestCounts and apiserver_requested_deprecated_apis metrics agree on a removed-in version for these two {{apiVersion}}s.

              jchaloup@redhat.com Jan Chaloupka
              trking W. Trevor King
              Ke Wang Ke Wang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated:
                Resolved: