Description of problem (please be detailed as possible and provide log
snippests):
The customer is spinning up pods but they are unable as this event being throwing in the application pod logs:

Warning FailedAttachVolume 43s (x8 over 15m) attachdetach-controller AttachVolume.Attach failed for volume "pvc-59fa01c9-b866-4daa-8c49-667ff3a2d5e2" : timed out waiting for external-attacher of openshift-storage.cephfs.csi.ceph.com CSI driver to attach volume 0001-0011-openshift-storage-0000000000000001-c9e827bb-7e7e-4b7d-b9fa-a5a11382362a

The two csi-cephfs-provisioner pods are saying:

[root@belmgtn01om101 NCP]# oc get pods -o wide|grep csi-cephfsplugin-provisioner
csi-cephfsplugin-provisioner-7f787947bd-4vdqg 5/5 Running 0 60m 10.130.1.148 belmgtn01ss101.belimsnapp01.t-mobile.lab <none> <none>
csi-cephfsplugin-provisioner-7f787947bd-5qknw 5/5 Running 0 35s 10.130.4.194 belmgtn01ss102.belimsnapp01.t-mobile.lab <none> <none>
[root@belmgtn01om101 NCP]# oc logs csi-cephfsplugin-provisioner-7f787947bd-5qknw -c csi-attacher -f
I1007 21:27:33.026375 1 main.go:96] Version: v4.14.0-202401292111.p0.g06e8ce0.assembly.stream-0-ge458f1f-dirty
W1007 21:27:43.028622 1 connection.go:183] Still connecting to unix:///csi/csi-provisioner.sock
I1007 21:27:44.103029 1 common.go:111] Probing CSI driver for readiness
I1007 21:27:44.107428 1 leaderelection.go:245] attempting to acquire leader lease openshift-storage/external-attacher-leader-openshift-storage-cephfs-csi-ceph-com...

[root@belmgtn01om101 NCP]#
[root@belmgtn01om101 NCP]#
[root@belmgtn01om101 NCP]#
[root@belmgtn01om101 NCP]# oc logs csi-cephfsplugin-provisioner-7f787947bd-4vdqg -c csi-attacher -f
I1007 20:27:13.312358 1 main.go:96] Version: v4.14.0-202401292111.p0.g06e8ce0.assembly.stream-0-ge458f1f-dirty
I1007 20:27:14.325401 1 common.go:111] Probing CSI driver for readiness
I1007 20:27:14.330996 1 leaderelection.go:245] attempting to acquire leader lease openshift-storage/external-attacher-leader-openshift-storage-cephfs-csi-ceph-com...
I1007 20:29:59.710171 1 leaderelection.go:255] successfully acquired lease openshift-storage/external-attacher-leader-openshift-storage-cephfs-csi-ceph-com
I1007 20:29:59.710271 1 controller.go:130] Starting CSI attacher

Which seem normal to me... Reviewing [1], seems the request to mount the pvc was sent to the external-attacher sidecar container but it's not responding. If you feel this needs to be opened with the OCP storage team, please move this case over to that team.

[1] https://github.com/openshift/csi-external-attacher/tree/master

Version of all relevant components (if applicable):
ODF 4.14
OCP 4.14

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?
Yes, cannot spin up application pods as they cannot mount a PVC

Is there any workaround available to the best of your knowledge?
No

openshift-storage namespace inspect, and OCP must-gather are on supportshell
—
Jira created for openshift-kubernetes as requested in BZ https://bugzilla.redhat.com/show_bug.cgi?id=2317089