-
Bug
-
Resolution: Done-Errata
-
Undefined
-
4.14
-
Moderate
-
No
-
False
-
This is a clone of issue OCPBUGS-20481. The following is the description of the original issue:
—
Multi-vcenter and wrong user/password in secret/vmware-vsphere-cloud-credentials causes the vSphere CSI Driver controller pods restarting
Description of problem:
When there are Multi-vcenter in secret/vmware-vsphere-cloud-credentials in ns/openshift-cluster-csi-drivers (see bug https://issues.redhat.com/browse/OCPBUGS-20478), the vSphere CSI Driver controller pods restarting are always restarting.
vmware-vsphere-csi-driver-controller-545dc5679f-mdsjt 0/13 Pending 0 0s vmware-vsphere-csi-driver-controller-545dc5679f-mdsjt 0/13 ContainerCreating 0 0s vmware-vsphere-csi-driver-controller-587f78b9c7-br4gs 0/13 Terminating 0 3s vmware-vsphere-csi-driver-controller-545dc5679f-mdsjt 0/13 Terminating 0 1s vmware-vsphere-csi-driver-controller-587f78b9c7-9pfmp 0/13 Pending 0 0s vmware-vsphere-csi-driver-controller-587f78b9c7-9pfmp 0/13 Pending 0 0s vmware-vsphere-csi-driver-controller-587f78b9c7-9pfmp 0/13 ContainerCreating 0 0s vmware-vsphere-csi-driver-controller-587f78b9c7-qdb89 12/13 Terminating 0 9s vmware-vsphere-csi-driver-controller-b946b657-7t74p 13/13 Terminating 0 9s vmware-vsphere-csi-driver-controller-545dc5679f-mdsjt 0/13 Terminating 0 3s vmware-vsphere-csi-driver-controller-587f78b9c7-qdb89 0/13 Terminating 0 10s vmware-vsphere-csi-driver-controller-545dc5679f-75wfm 12/13 Terminating 0 9s vmware-vsphere-csi-driver-controller-587f78b9c7-9pfmp 0/13 ContainerCreating 0 2s vmware-vsphere-csi-driver-controller-587f78b9c7-qdb89 0/13 Terminating 0 11s vmware-vsphere-csi-driver-controller-587f78b9c7-qdb89 0/13 Terminating 0 11s vmware-vsphere-csi-driver-controller-587f78b9c7-qdb89 0/13 Terminating 0 11s vmware-vsphere-csi-driver-controller-545dc5679f-75wfm 0/13 Terminating 0 10s vmware-vsphere-csi-driver-controller-545dc5679f-75wfm 0/13 Terminating 0 11s vmware-vsphere-csi-driver-controller-545dc5679f-75wfm 0/13 Terminating 0 11s vmware-vsphere-csi-driver-controller-545dc5679f-75wfm 0/13 Terminating 0 11s
$ oc get co storage
storage 4.14.0-0.nightly-2023-10-10-084534 False True False 15s VSphereCSIDriverOperatorCRAvailable: VMwareVSphereDriverControllerServiceControllerAvailable: Waiting for Deployment
$ oc logs -f deployment.apps/vmware-vsphere-csi-driver-controller --tail=500 {"level":"error","time":"2023-10-12T11:40:38.920487342Z","caller":"service/driver.go:189","msg":"failed to init controller. Error: ServerFaultCode: Cannot complete login due to an incorrect user name or password.","TraceId":"5e60e6c5-efeb-4080-888c-74182e4fb1f4","TraceId":"ec636d3d-1ddb-43a5-b9f7-8541dacff583","stacktrace":"sigs.k8s.io/vsphere-csi-driver/v3/pkg/csi/service.(*vsphereCSIDriver).BeforeServe\n\t/go/src/github.com/kubernetes-sigs/vsphere-csi-driver/pkg/csi/service/driver.go:189\nsigs.k8s.io/vsphere-csi-driver/v3/pkg/csi/service.(*vsphereCSIDriver).Run\n\t/go/src/github.com/kubernetes-sigs/vsphere-csi-driver/pkg/csi/service/driver.go:202\nmain.main\n\t/go/src/github.com/kubernetes-sigs/vsphere-csi-driver/cmd/vsphere-csi/main.go:71\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:250"} {"level":"info","time":"2023-10-12T11:40:38.920536779Z","caller":"service/driver.go:109","msg":"Configured: \"csi.vsphere.vmware.com\" with clusterFlavor: \"VANILLA\" and mode: \"controller\"","TraceId":"5e60e6c5-efeb-4080-888c-74182e4fb1f4","TraceId":"ec636d3d-1ddb-43a5-b9f7-8541dacff583"} {"level":"error","time":"2023-10-12T11:40:38.920572294Z","caller":"service/driver.go:203","msg":"failed to run the driver. Err: +ServerFaultCode: Cannot complete login due to an incorrect user name or password.","TraceId":"5e60e6c5-efeb-4080-888c-74182e4fb1f4","stacktrace":"sigs.k8s.io/vsphere-csi-driver/v3/pkg/csi/service.(*vsphereCSIDriver).Run\n\t/go/src/github.com/kubernetes-sigs/vsphere-csi-driver/pkg/csi/service/driver.go:203\nmain.main\n\t/go/src/github.com/kubernetes-sigs/vsphere-csi-driver/cmd/vsphere-csi/main.go:71\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:250"}
$ oc logs vmware-vsphere-csi-driver-operator-b4b8d5d56-f76pc I1012 11:43:08.973130 1 event.go:298] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"vmware-vsphere-csi-driver-operator", UID:"a8492b8c-8c13-4b15-aedc-6f3ced80618e", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'DeploymentUpdateFailed' Failed to update Deployment.apps/vmware-vsphere-csi-driver-controller -n openshift-cluster-csi-drivers: Operation cannot be fulfilled on deployments.apps "vmware-vsphere-csi-driver-controller": the object has been modified; please apply your changes to the latest version and try again E1012 11:43:08.996554 1 base_controller.go:268] VMwareVSphereDriverControllerServiceController reconciliation failed: Operation cannot be fulfilled on deployments.apps "vmware-vsphere-csi-driver-controller": the object has been modified; please apply your changes to the latest version and try again W1012 11:43:08.999148 1 driver_starter.go:206] CSI driver can only connect to one vcenter, more than 1 set of credentials found for CSI driver W1012 11:43:09.390489 1 driver_starter.go:206] CSI driver can only connect to one vcenter, more than 1 set of credentials found for CSI driver
Version-Release number of selected component (if applicable):
4.14.0-0.nightly-2023-10-10-084534
How reproducible:
Always
Steps to Reproduce:
See Description
Actual results:
Storage CSI Driver pods are restarting
Expected results:
Storage CSI Driver pods should not restarting
- clones
-
OCPBUGS-20481 Multi-vcenter and wrong user/password in secret/vmware-vsphere-cloud-credentials causes the vSphere CSI Driver controller pods restarting
- Closed
- is blocked by
-
OCPBUGS-20481 Multi-vcenter and wrong user/password in secret/vmware-vsphere-cloud-credentials causes the vSphere CSI Driver controller pods restarting
- Closed
- links to
-
RHBA-2023:7831 OpenShift Container Platform 4.14.z bug fix update