Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-39531

Failed to list secrets when a large number exist on the cluster

XMLWordPrintable

    • Important
    • None
    • False
    • Hide

      None

      Show
      None
    • Hide
      *Cause*: A large number of secrets in the cluster causes the API to timeout when they are fetched in a single call.
      *Consequence*: Cloud credential operator throws an error on startup and restarts.
      *Fix*: Cloud credential operator now pulls the list in smaller batches of 100.
      *Result*: Cloud credential operator no longer errors when there is a large number of secrets in the cluster.
      Show
      *Cause*: A large number of secrets in the cluster causes the API to timeout when they are fetched in a single call. *Consequence*: Cloud credential operator throws an error on startup and restarts. *Fix*: Cloud credential operator now pulls the list in smaller batches of 100. *Result*: Cloud credential operator no longer errors when there is a large number of secrets in the cluster.
    • Bug Fix
    • In Progress
    • Customer Escalated

      -> While upgrading the cluster from 4.13.38 -> 4.14.18, it is stuck on CCO, clusterversion is complaining about

      "Working towards 4.14.18: 690 of 860 done (80% complete), waiting on cloud-credential".

      While checking further we see that CCO deployment is yet to rollout.

      -> ClusterOperator status.versions[name=operator] isn't a narrow "CCO Deployment is updated", it's "the CCO asserts the whole CC component is updated", which requires (among other things) a functional CCO Deployment. Seems like you don't have a functional CCO Deployment, because logs have it stuck talking about asking for a leader lease. You don't have Kube API audit logs to say if it's stuck generating the Lease request, or waiting for a response from the Kube API server.

            jstuever@redhat.com Jeremiah Stuever
            rhn-support-puplench Pratik Uplenchwar
            Jianping Shu Jianping Shu
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

              Created:
              Updated: