-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
4.19.0
-
None
-
Quality / Stability / Reliability
-
False
-
-
None
-
None
-
None
-
None
-
Rejected
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Description of problem:
[sig-api-machinery][Feature:APIServer][Late] kubelet terminates kube-apiserver gracefully extended [Suite:openshift/conformance/parallel] github.com/openshift/origin/test/extended/apiserver/graceful_termination.go:70 STEP: Creating a kubernetes client @ 11/28/24 21:29:47.506 I1128 21:29:47.507893 112195 discovery.go:214] Invalidating discovery information I1128 21:29:47.654828 112195 client.go:275] configPath is now "/tmp/configfile1322929535" I1128 21:29:47.654870 112195 client.go:324] The user is now "e2e-test-monitoring-collection-profiles-kl2f7-user" I1128 21:29:47.654880 112195 client.go:326] Creating project "e2e-test-monitoring-collection-profiles-kl2f7" I1128 21:29:47.809525 112195 client.go:334] Waiting on permissions in project "e2e-test-monitoring-collection-profiles-kl2f7" ... I1128 21:29:47.877389 112195 client.go:363] DeploymentConfig capability is enabled, adding 'deployer' SA to the list of default SAs I1128 21:29:47.944955 112195 client.go:378] Waiting for ServiceAccount "default" to be provisioned... I1128 21:29:48.071367 112195 client.go:378] Waiting for ServiceAccount "builder" to be provisioned... I1128 21:29:48.273655 112195 client.go:378] Waiting for ServiceAccount "deployer" to be provisioned... I1128 21:29:48.421700 112195 client.go:388] Waiting for RoleBinding "system:image-pullers" to be provisioned... I1128 21:29:48.421789 112195 reflector.go:305] Starting reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.421804 112195 reflector.go:341] Listing and watching *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.423382 112195 reflector.go:368] Caches populated for *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.917651 112195 reflector.go:311] Stopping reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.917673 112195 client.go:388] Waiting for RoleBinding "system:image-builders" to be provisioned... I1128 21:29:48.917724 112195 reflector.go:305] Starting reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.917737 112195 reflector.go:341] Listing and watching *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.919555 112195 reflector.go:368] Caches populated for *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.921172 112195 reflector.go:311] Stopping reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.921188 112195 client.go:388] Waiting for RoleBinding "system:deployers" to be provisioned... I1128 21:29:48.921221 112195 reflector.go:305] Starting reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.921231 112195 reflector.go:341] Listing and watching *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.922856 112195 reflector.go:368] Caches populated for *v1.RoleBinding from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:48.924269 112195 reflector.go:311] Stopping reflector *v1.RoleBinding (0s) from k8s.io/client-go@v0.31.1/tools/cache/reflector.go:243 I1128 21:29:49.178341 112195 client.go:421] Project "e2e-test-monitoring-collection-profiles-kl2f7" has been fully provisioned. STEP: Creating a kubernetes client @ 11/28/24 21:29:49.178 I1128 21:29:49.179214 112195 discovery.go:214] Invalidating discovery information STEP: Getting log files for kube-apiserver on master: ip-10-0-54-155.ec2.internal @ 11/28/24 21:29:49.189 I1128 21:29:49.189260 112195 client.go:934] Running 'oc --kubeconfig=/tmp/kubeconfig-2702259231 adm node-logs ip-10-0-54-155.ec2.internal --path=kube-apiserver/' STEP: Getting and processing termination.log file for kube-apiserver on master: ip-10-0-54-155.ec2.internal @ 11/28/24 21:29:49.282 I1128 21:29:49.283096 112195 client.go:934] Running 'oc --kubeconfig=/tmp/kubeconfig-2702259231 adm node-logs ip-10-0-54-155.ec2.internal --path=kube-apiserver/termination.log' STEP: Getting log files for kube-apiserver on master: ip-10-0-58-220.ec2.internal @ 11/28/24 21:29:49.38 I1128 21:29:49.380339 112195 client.go:934] Running 'oc --kubeconfig=/tmp/kubeconfig-2702259231 adm node-logs ip-10-0-58-220.ec2.internal --path=kube-apiserver/' STEP: Getting and processing termination.log file for kube-apiserver on master: ip-10-0-58-220.ec2.internal @ 11/28/24 21:29:49.475 I1128 21:29:49.475213 112195 client.go:934] Running 'oc --kubeconfig=/tmp/kubeconfig-2702259231 adm node-logs ip-10-0-58-220.ec2.internal --path=kube-apiserver/termination.log' STEP: Getting log files for kube-apiserver on master: ip-10-0-90-35.ec2.internal @ 11/28/24 21:29:50.205 I1128 21:29:50.205378 112195 client.go:934] Running 'oc --kubeconfig=/tmp/kubeconfig-2702259231 adm node-logs ip-10-0-90-35.ec2.internal --path=kube-apiserver/' STEP: Getting and processing termination.log file for kube-apiserver on master: ip-10-0-90-35.ec2.internal @ 11/28/24 21:29:50.303 I1128 21:29:50.303380 112195 client.go:934] Running 'oc --kubeconfig=/tmp/kubeconfig-2702259231 adm node-logs ip-10-0-90-35.ec2.internal --path=kube-apiserver/termination.log' [FAILED] in [It] - github.com/openshift/origin/test/extended/apiserver/graceful_termination.go:99 @ 11/28/24 21:29:50.413 STEP: Collecting events from namespace "e2e-test-monitoring-collection-profiles-kl2f7". @ 11/28/24 21:29:50.414 STEP: Found 0 events. @ 11/28/24 21:29:50.426 I1128 21:29:50.442577 112195 resource.go:168] POD NODE PHASE GRACE CONDITIONS I1128 21:29:50.442619 112195 resource.go:178] I1128 21:29:50.460559 112195 dump.go:81] skipping dumping cluster info - cluster too large ... STEP: Destroying namespace "e2e-test-monitoring-collection-profiles-kl2f7" for this suite. @ 11/28/24 21:29:50.492 • [FAILED] [3.009 seconds] [sig-api-machinery][Feature:APIServer][Late] [It] kubelet terminates kube-apiserver gracefully extended [Suite:openshift/conformance/parallel] github.com/openshift/origin/test/extended/apiserver/graceful_termination.go:70 [FAILED] The following API Servers weren't gracefully terminated: kube-apiserver on node ip-10-0-58-220.ec2.internal wasn't gracefully terminated, reason: Previous pod kube-apiserver-ip-10-0-58-220.ec2.internal started at 2024-11-28 20:07:59.664221609 +0000 UTC did not terminate gracefully kube-apiserver on node ip-10-0-90-35.ec2.internal wasn't gracefully terminated, reason: Previous pod kube-apiserver-ip-10-0-90-35.ec2.internal started at 2024-11-28 20:24:50.339782962 +0000 UTC did not terminate gracefully In [It] at: github.com/openshift/origin/test/extended/apiserver/graceful_termination.go:99 @ 11/28/24 21:29:50.413
Version-Release number of selected component (if applicable):
How reproducible:
Steps to Reproduce:
1. 2. 3.
Actual results:
Expected results:
Additional info:
Job history: https://prow.ci.openshift.org/job-history/gs/test-platform-results/pr-logs/directory/pull-ci-openshift-cluster-network-operator-master-e2e-ovn-ipsec-step-registry e2e log: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/openshift_cluster-network-operator/2527/pull-ci-openshift-cluster-network-operator-master-e2e-ovn-ipsec-step-registry/1862197242052481024/artifacts/e2e-ovn-ipsec-step-registry/openshift-e2e-test/artifacts/e2e.log