Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-27959

Panic: send on closed channel

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done-Errata
    • Icon: Minor Minor
    • 4.16.0
    • 4.13.z, 4.12.z, 4.14.z, 4.15.z, 4.16.0
    • Etcd
    • None
    • No
    • False
    • Hide

      None

      Show
      None
    • Hide
      * Previously, the etcd Cluster Operator entered a state of panic during pod health checks and this caused requests to an `etcd` cluster to fail. With this release, the issue is resovled so that these panic situatuions no longer occur.(link:https://issues.redhat.com/browse/OCPBUGS-27959[*OCPBUGS-27959*])
      Show
      * Previously, the etcd Cluster Operator entered a state of panic during pod health checks and this caused requests to an `etcd` cluster to fail. With this release, the issue is resovled so that these panic situatuions no longer occur.(link: https://issues.redhat.com/browse/OCPBUGS-27959 [* OCPBUGS-27959 *])
    • Bug Fix
    • Done

      In a CI run of etcd-operator-e2e I've found the following panic in the operator logs:

      E0125 11:04:58.158222       1 health.go:135] health check for member (ip-10-0-85-12.us-west-2.compute.internal) failed: err(context deadline exceeded)
panic: send on closed channel

goroutine 15608 [running]:
github.com/openshift/cluster-etcd-operator/pkg/etcdcli.getMemberHealth.func1()
	github.com/openshift/cluster-etcd-operator/pkg/etcdcli/health.go:58 +0xd2
created by github.com/openshift/cluster-etcd-operator/pkg/etcdcli.getMemberHealth
	github.com/openshift/cluster-etcd-operator/pkg/etcdcli/health.go:54 +0x2a5

      which unfortunately is an incomplete log file. The operator recovered itself by restarting, we should fix the panic nonetheless.

      Job run for reference:
      https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_cluster-etcd-operator/1186/pull-ci-openshift-cluster-etcd-operator-master-e2e-operator/1750466468031500288

        1. openshift-etcd-operator_etcd-operator-6b96c5f978-dsktr_etcd-operator_previous.log
          418 kB

              tjungblu@redhat.com Thomas Jungblut
              tjungblu@redhat.com Thomas Jungblut
              Ge Liu Ge Liu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: