Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-46414

[sig-arch][Late] [It] operators should not create watch channels very often [apigroup:apiserver.openshift.io] [Suite:openshift/conformance/parallel] is flaky

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Critical Critical
    • None
    • 4.18.0
    • kube-apiserver
    • None
    • Important
    • None
    • Proposed
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      This test is flaky and causes e2e-ovn-ipsec-step-registry CI lane to fail.

         [sig-arch][Late] operators should not create watch channels very often [apigroup:apiserver.openshift.io] [Suite:openshift/conformance/parallel]
        github.com/openshift/origin/test/extended/apiserver/api_requests.go:142
          STEP: Creating a kubernetes client @ 12/12/24 17:02:42.933
        I1212 17:02:42.933845  106209 discovery.go:214] Invalidating discovery information
        I1212 17:02:43.857558 106209 client.go:275] configPath is now "/tmp/configfile233456018"
        I1212 17:02:43.857591 106209 client.go:324] The user is now "e2e-test-monitoring-collection-profiles-8bbcd-user"
        I1212 17:02:43.857598 106209 client.go:326] Creating project "e2e-test-monitoring-collection-profiles-8bbcd"
        I1212 17:02:43.985837 106209 client.go:334] Waiting on permissions in project "e2e-test-monitoring-collection-profiles-8bbcd" ...
        I1212 17:02:44.249452 106209 client.go:363] DeploymentConfig capability is enabled, adding 'deployer' SA to the list of default SAs
        I1212 17:02:44.314931 106209 client.go:378] Waiting for ServiceAccount "default" to be provisioned...
        I1212 17:02:44.544827 106209 client.go:378] Waiting for ServiceAccount "builder" to be provisioned...
        I1212 17:02:44.780290 106209 client.go:378] Waiting for ServiceAccount "deployer" to be provisioned...
        I1212 17:02:45.010680 106209 client.go:388] Waiting for RoleBinding "system:image-pullers" to be provisioned...
        I1212 17:02:45.010856  106209 reflector.go:305] Starting reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.010882  106209 reflector.go:341] Listing and watching *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.073901  106209 reflector.go:368] Caches populated for *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.136050  106209 reflector.go:311] Stopping reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.136115 106209 client.go:388] Waiting for RoleBinding "system:image-builders" to be provisioned...
        I1212 17:02:45.136309  106209 reflector.go:305] Starting reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.136329  106209 reflector.go:341] Listing and watching *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.198889  106209 reflector.go:368] Caches populated for *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.261161  106209 reflector.go:311] Stopping reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.261328 106209 client.go:388] Waiting for RoleBinding "system:deployers" to be provisioned...
        I1212 17:02:45.261522  106209 reflector.go:305] Starting reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.261571  106209 reflector.go:341] Listing and watching *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.324538  106209 reflector.go:368] Caches populated for *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.386904  106209 reflector.go:311] Stopping reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243
        I1212 17:02:45.701249 106209 client.go:421] Project "e2e-test-monitoring-collection-profiles-8bbcd" has been fully provisioned.
          STEP: Creating a kubernetes client @ 12/12/24 17:02:45.701
        I1212 17:02:45.703174  106209 discovery.go:214] Invalidating discovery information
        I1212 17:02:46.400809 106209 api_requests.go:399] operator=ingress-operator, watchrequestcount=878, upperbound=1112, ratio=0.79
        I1212 17:02:46.400849 106209 api_requests.go:399] operator=authentication-operator, watchrequestcount=374, upperbound=1038, ratio=0.36
        I1212 17:02:46.400861 106209 api_requests.go:399] operator=kube-apiserver-operator, watchrequestcount=365, upperbound=746, ratio=0.49
        I1212 17:02:46.400871 106209 api_requests.go:399] operator=openshift-apiserver-operator, watchrequestcount=263, upperbound=838, ratio=0.31
        I1212 17:02:46.400879 106209 api_requests.go:399] operator=etcd-operator, watchrequestcount=246, upperbound=490, ratio=0.5
        I1212 17:02:46.400888 106209 api_requests.go:399] operator=cluster-samples-operator, watchrequestcount=210, upperbound=152, ratio=1.38
        I1212 17:02:46.400908 106209 api_requests.go:401] Operator "cluster-samples-operator" produces more watch requests than expected
        I1212 17:02:46.400928 106209 api_requests.go:389] Operator cluster-network-operator not found in upper bounds for AWS
        I1212 17:02:46.400943 106209 api_requests.go:390] operator=system:serviceaccount:openshift-network-operator:cluster-network-operator, watchrequestcount=199
        I1212 17:02:46.400953 106209 api_requests.go:399] operator=console-operator, watchrequestcount=186, upperbound=412, ratio=0.45
        I1212 17:02:46.400966 106209 api_requests.go:389] Operator machine-config-operator not found in upper bounds for AWS
        I1212 17:02:46.400974 106209 api_requests.go:390] operator=system:serviceaccount:openshift-machine-config-operator:machine-config-operator, watchrequestcount=183
        I1212 17:02:46.400988 106209 api_requests.go:399] operator=kube-controller-manager-operator, watchrequestcount=161, upperbound=564, ratio=0.29
        I1212 17:02:46.400998 106209 api_requests.go:399] operator=openshift-controller-manager-operator, watchrequestcount=161, upperbound=572, ratio=0.28
        I1212 17:02:46.401010 106209 api_requests.go:399] operator=cluster-image-registry-operator, watchrequestcount=146, upperbound=378, ratio=0.39
        I1212 17:02:46.401019 106209 api_requests.go:399] operator=cluster-storage-operator, watchrequestcount=119, upperbound=644, ratio=0.18
        I1212 17:02:46.401031 106209 api_requests.go:399] operator=cluster-node-tuning-operator, watchrequestcount=111, upperbound=230, ratio=0.48
        I1212 17:02:46.401039 106209 api_requests.go:399] operator=prometheus-operator, watchrequestcount=91, upperbound=444, ratio=0.2
        I1212 17:02:46.401051 106209 api_requests.go:399] operator=aws-ebs-csi-driver-operator, watchrequestcount=85, upperbound=398, ratio=0.21
        I1212 17:02:46.401059 106209 api_requests.go:399] operator=openshift-kube-scheduler-operator, watchrequestcount=71, upperbound=504, ratio=0.14
        I1212 17:02:46.401071 106209 api_requests.go:399] operator=cluster-monitoring-operator, watchrequestcount=66, upperbound=372, ratio=0.18
        I1212 17:02:46.401079 106209 api_requests.go:399] operator=machine-api-operator, watchrequestcount=59, upperbound=252, ratio=0.23
        I1212 17:02:46.401090 106209 api_requests.go:399] operator=cluster-autoscaler-operator, watchrequestcount=57, upperbound=264, ratio=0.22
        I1212 17:02:46.401099 106209 api_requests.go:399] operator=dns-operator, watchrequestcount=51, upperbound=188, ratio=0.27
        I1212 17:02:46.401110 106209 api_requests.go:399] operator=cloud-credential-operator, watchrequestcount=46, upperbound=352, ratio=0.13
        I1212 17:02:46.401120 106209 api_requests.go:399] operator=csi-snapshot-controller-operator, watchrequestcount=41, upperbound=240, ratio=0.17
        I1212 17:02:46.401131 106209 api_requests.go:389] Operator cluster-olm-operator not found in upper bounds for AWS
        I1212 17:02:46.401140 106209 api_requests.go:390] operator=system:serviceaccount:openshift-cluster-olm-operator:cluster-olm-operator, watchrequestcount=32
        I1212 17:02:46.401153 106209 api_requests.go:399] operator=kube-storage-version-migrator-operator, watchrequestcount=23, upperbound=222, ratio=0.1
        I1212 17:02:46.401163 106209 api_requests.go:399] operator=cluster-baremetal-operator, watchrequestcount=23, upperbound=250, ratio=0.09
        I1212 17:02:46.401171 106209 api_requests.go:389] Operator control-plane-machine-set-operator not found in upper bounds for AWS
        I1212 17:02:46.401182 106209 api_requests.go:390] operator=system:serviceaccount:openshift-machine-api:control-plane-machine-set-operator, watchrequestcount=22
        I1212 17:02:46.401192 106209 api_requests.go:399] operator=marketplace-operator, watchrequestcount=16, upperbound=104, ratio=0.15
        I1212 17:02:46.401225 106209 api_requests.go:399] operator=openshift-config-operator, watchrequestcount=12, upperbound=174, ratio=0.07
        I1212 17:02:46.401237 106209 api_requests.go:399] operator=service-ca-operator, watchrequestcount=9, upperbound=340, ratio=0.03
        I1212 17:02:46.401246 106209 api_requests.go:389] Operator install-test-sa-quay-operator not found in upper bounds for AWS
        I1212 17:02:46.401257 106209 api_requests.go:390] operator=system:serviceaccount:e2e-test-openshift-operator-controller-r7p8w:install-test-sa-quay-operator, watchrequestcount=2
          [FAILED] in [It] - github.com/openshift/origin/test/extended/apiserver/api_requests.go:406 @ 12/12/24 17:02:46.401
          STEP: Collecting events from namespace "e2e-test-monitoring-collection-profiles-8bbcd". @ 12/12/24 17:02:46.402
          STEP: Found 0 events. @ 12/12/24 17:02:46.466
        I1212 17:02:46.531451 106209 resource.go:168] POD  NODE  PHASE  GRACE  CONDITIONS
        I1212 17:02:46.531535 106209 resource.go:178] 
        I1212 17:02:46.597680 106209 dump.go:81] skipping dumping cluster info - cluster too large
        I1212 17:02:46.668948 106209 client.go:637] Deleted {user.openshift.io/v1, Resource=users  e2e-test-monitoring-collection-profiles-8bbcd-user}, err: <nil>
        I1212 17:02:46.736522 106209 client.go:637] Deleted {oauth.openshift.io/v1, Resource=oauthclients  e2e-client-e2e-test-monitoring-collection-profiles-8bbcd}, err: <nil>
        I1212 17:02:46.807294 106209 client.go:637] Deleted {oauth.openshift.io/v1, Resource=oauthaccesstokens  sha256~-jb7tuRZrouMz1scs7edBclYCZK_j_AGeD9ne86qohg}, err: <nil>
          STEP: Destroying namespace "e2e-test-monitoring-collection-profiles-8bbcd" for this suite. @ 12/12/24 17:02:46.807
        • [FAILED] [3.954 seconds]
        [sig-arch][Late] [It] operators should not create watch channels very often [apigroup:apiserver.openshift.io] [Suite:openshift/conformance/parallel]
        github.com/openshift/origin/test/extended/apiserver/api_requests.go:142
      
          [FAILED] Expected
              <[]string | len:1, cap:1>: [
                  "Operator \"cluster-samples-operator\" produces more watch requests than expected: watchrequestcount=210, upperbound=152, ratio=1.38",
              ]
          to be empty
          In [It] at: github.com/openshift/origin/test/extended/apiserver/api_requests.go:406 @ 12/12/24 17:02:46.401
        ------------------------------
      
        Summarizing 1 Failure:
          [FAIL] [sig-arch][Late] [It] operators should not create watch channels very often [apigroup:apiserver.openshift.io] [Suite:openshift/conformance/parallel]
          github.com/openshift/origin/test/extended/apiserver/api_requests.go:406
      
        Ran 1 of 1 Specs in 3.955 seconds
        FAIL! -- 0 Passed | 1 Failed | 0 Pending | 0 Skipped
      fail [github.com/openshift/origin/test/extended/apiserver/api_requests.go:406]: Expected
          <[]string | len:1, cap:1>: [
              "Operator \"cluster-samples-operator\" produces more watch requests than expected: watchrequestcount=210, upperbound=152, ratio=1.38",
          ]
      to be empty
      Ginkgo exit error 1: exit with code 1   

      Version-Release number of selected component (if applicable):

          

      How reproducible:

          

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

          

      Expected results:

          

      Additional info:

      https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_cluster-network-operator/2593/pull-ci-openshift-cluster-network-operator-release-4.18-e2e-ovn-ipsec-step-registry/1867270464737382400
      https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_cluster-network-operator/2593/pull-ci-openshift-cluster-network-operator-release-4.18-e2e-ovn-ipsec-step-registry/1867205463196569600

              Unassigned Unassigned
              pepalani@redhat.com Periyasamy Palanisamy
              Ke Wang Ke Wang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: