Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-48400

Etcd leader resigns due to lack of quorum shortly after bootstrap member removal

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • 4.19.0
    • 4.18.0, 4.19.0
    • Etcd
    • None
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      4.18: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-cluster-etcd-operator-1384-ci-4.18-e2e-gcp-ovn/1877471255607644160
      
      40e0ff5ee27c98d0 = bootstrap
      1edfd46c2c62c92c = master-0
      a0dabab5ae6f967b = master-1
      7a509502206916e3 = master-2
      
      22:20:03 (term 2)      1 bootstrap_teardown_controller.go:144] Removing bootstrap member [40e0ff5ee27c98d0]
      22:20:03 (term 2)      1 bootstrap_teardown_controller.go:151] Successfully removed bootstrap member [40e0ff5ee27c98d0]
      22:20:04 (term 2) leader lost
      22:20:04 (term 3) leader=master-1
      {"level":"warn","ts":"2025-01-09T22:20:19.459912Z","logger":"raft","caller":"etcdserver/zap_raft.go:85","msg":"a0dabab5ae6f967b stepped down to follower since quorum is not active"}
      
      4.19: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-ci-4.19-e2e-gcp-ovn-upgrade/1877300145469526016
      
      26129ddf465384ed = bootstrap 10.0.0.3
      fb4ff9e6f7280fcb = master-0  10.0.0.5
      283343bd1d4e0df2 = master-1  10.0.0.6
      896ca4df9c7807c1 = master-2  10.0.0.4
      
      bootstrap_teardown_controller.go:144] Removing bootstrap member [26129ddf465384ed]
      I0109 10:48:33.201639       1 bootstrap_teardown_controller.go:151] Successfully removed bootstrap member [26129ddf465384ed]
      {"level":"info","ts":"2025-01-09T10:48:34.588799Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"896ca4df9c7807c1 became leader at term 3"}
      {"level":"warn","ts":"2025-01-09T10:48:51.583385Z","logger":"raft","caller":"etcdserver/zap_raft.go:85","msg":"896ca4df9c7807c1 stepped down to follower since quorum is not active"}
      
      

      Version-Release number of selected component (if applicable):

       

      How reproducible:

          

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

          

      Expected results:

          

      Additional info:

          

              rhn-coreos-htariq Haseeb Tariq
              bluddy Ben Luddy
              Ge Liu Ge Liu
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated: