Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-66411

openshift-kube-controller-manager panic in CI payload job

XMLWordPrintable

    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • Proposed
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      A panic in openshift-kube-controller-manager appeared in one of the CI payload jobs.

      Relevant payload: https://amd64.ocp.releases.ci.openshift.org/releasestream/4.21.0-0.ci/release/4.21.0-0.ci-2025-12-04-060622

      Job: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-ci-4.21-e2e-gcp-ovn-upgrade/1996462008693690368

      Stack trace appeared in this file:

      E1204 09:30:46.464704       1 runtime.go:142] "Observed a panic" panic="close of closed channel" panicGoValue="\"close of closed channel\"" stacktrace=<
      	goroutine 969 [running]:
      	k8s.io/apimachinery/pkg/util/runtime.logPanic({0x37b96f0, 0xc0008fef50}, {0x2c69cc0, 0x3774ee0})
      		k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:132 +0xbc
      	k8s.io/apimachinery/pkg/util/runtime.handleCrash({0x37b96f0, 0xc0008fef50}, {0x2c69cc0, 0x3774ee0}, {0x0, 0x0, 0xc0020ff660?})
      		k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:107 +0x116
      	k8s.io/apimachinery/pkg/util/runtime.HandleCrashWithContext({0x37b96f0, 0xc0008fef50}, {0x0, 0x0, 0x0})
      		k8s.io/apimachinery@v0.34.2/pkg/util/runtime/runtime.go:78 +0x5a
      	panic({0x2c69cc0?, 0x3774ee0?})
      		runtime/panic.go:792 +0x132
      	k8s.io/kubernetes/pkg/controller/resourcequota.(*QuotaMonitor).SyncMonitors(0xc000d98480, {0x37b9528, 0xc00042f1d0}, 0xc000f185d0)
      		k8s.io/kubernetes@v1.34.2/pkg/controller/resourcequota/resource_quota_monitor.go:238 +0xbc5
      	github.com/openshift/cluster-policy-controller/pkg/quota/clusterquotareconciliation.(*ClusterQuotaReconcilationController).resyncMonitors(0xc000d983f0, {0x37b9528, 0xc00042f1d0}, 0x55148a0?)
      		github.com/openshift/cluster-policy-controller/pkg/quota/clusterquotareconciliation/reconciliation_controller.go:262 +0x26
      	github.com/openshift/cluster-policy-controller/pkg/quota/clusterquotareconciliation.(*ClusterQuotaReconcilationController).Sync.func1()
      		github.com/openshift/cluster-policy-controller/pkg/quota/clusterquotareconciliation/reconciliation_controller.go:215 +0x425
      	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1({0x100e456?, 0xc003739880?})
      		k8s.io/apimachinery@v0.34.2/pkg/util/wait/backoff.go:233 +0x13
      	k8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1({0x37b96f0?, 0xc0008fef50?}, 0x41b0f4?)
      		k8s.io/apimachinery@v0.34.2/pkg/util/wait/backoff.go:255 +0x51
      	k8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext({0x37b96f0, 0xc0008fef50}, 0xc0020ffed8, {0x377bfe0, 0xc000c10030}, 0x1)
      		k8s.io/apimachinery@v0.34.2/pkg/util/wait/backoff.go:256 +0xe5
      	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0008fef50?, {0x377bfe0?, 0xc000c10030?}, 0x0?, 0x0?)
      		k8s.io/apimachinery@v0.34.2/pkg/util/wait/backoff.go:233 +0x46
      	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c3b760, 0x6fc23ac00, 0x0, 0x1, 0xc0008fef50)
      		k8s.io/apimachinery@v0.34.2/pkg/util/wait/backoff.go:210 +0x7f
      	k8s.io/apimachinery/pkg/util/wait.Until(...)
      		k8s.io/apimachinery@v0.34.2/pkg/util/wait/backoff.go:163
      	github.com/openshift/cluster-policy-controller/pkg/quota/clusterquotareconciliation.(*ClusterQuotaReconcilationController).Sync(0xc000d983f0, 0xc00071d4a0, 0x6fc23ac00, {0x37b9528, 0xc00042f1d0})
      		github.com/openshift/cluster-policy-controller/pkg/quota/clusterquotareconciliation/reconciliation_controller.go:167 +0xc5
      	created by github.com/openshift/cluster-policy-controller/pkg/cmd/controller.RunClusterQuotaReconciliationController in goroutine 765
      		github.com/openshift/cluster-policy-controller/pkg/cmd/controller/quota.go:131 +0x7f7
       >
      

              aos-workloads-staff Workloads Team Bot Account
              kenzhang@redhat.com Ken Zhang
              None
              None
              Ying Zhou Ying Zhou
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: