-
Bug
-
Resolution: Done
-
Minor
-
2.11.0.GA
-
None
-
False
-
False
-
I was trying to start IntelliJ Idea workspace with IntelliJ image built in https://issues.redhat.com/browse/CRW-1358.
I've created this devfile: https://gist.githubusercontent.com/rhopp/2a4b893cff5544827213e734fc07f29e/raw/3bbed34e3e7c74790e6c0bfcd0cb798b1114c367/idea.yaml
Together with this plugin definition: https://gist.githubusercontent.com/rhopp/b1e40df24c02c0e29f492608d4bb66aa/raw/fb2e4bcf28cda2c6c7907e3a84a973cd9cd8fee9/meta.yaml
(these are just copy+paste from upstrem + changed image to use the productized one).
This devfile works fine on OCP 4.x, but when I'm trying to start it on OCP 3.11 (using factory link) I get this error:
failed to create subPath directory for volumeMount "claim-che-workspace-workspaceozi4g8xrpfata01f" of container "pluginbroker-artifacts-rhel8-latest"
This error is comming from the initi container of the workspace pod (the mkdir pod etc. finished successfully)
This seems pretty weird as other default devfiles are starting fine on that OCP instance.
I've started looking for a problem, so I ssh'd to the node, where the pod is being started and investigated the volume there directly:
[root@node2 ~]# ls -la /var/lib/origin/openshift.local.volumes/pods/7d988396-1239-11ec-9fff-fa163eb7bad5/volumes/kubernetes.io~nfs/pv17/workspaceozi4g8xrpfata01f/ total 0 drwxr-xr-x. 6 1000090000 nfsnobody 112 Sep 10 09:17 . drwxrwxrwx. 3 nfsnobody nfsnobody 55 Sep 10 09:17 .. drwxrwxrwx. 2 1000090000 nfsnobody 6 Sep 10 09:17 che-logs-che-plugin-broker drwxrwxrwx. 2 1000090000 nfsnobody 6 Sep 10 09:17 che-logs-che-workspace-pod drwxrwxrwx. 2 1000090000 nfsnobody 6 Sep 10 09:17 projector-user drwxrwxrwx. 2 1000090000 nfsnobody 6 Sep 10 09:17 projects
Seems like most of the needed folders are already created.
Then I took a look into journal on that machine:
[root@node2 ~]# journalctl --since "15 minutes ago" |tail -n 15
Sep 10 09:23:41 node2.crw-qe.com atomic-openshift-node[1857]: E0910 09:23:41.258763 1857 kubelet_pods.go:198] failed to create subPath directory for volumeMount "claim-che-workspace-workspaceozi4g8xrpfata01f" of container "pluginbroker-artifacts-rhel8-latest": cannot create directory /var/lib/origin/openshift.local.volumes/pods/7d988396-1239-11ec-9fff-fa163eb7bad5/volumes/kubernetes.io~nfs/pv17/workspaceozi4g8xrpfata01f/plugins: permission denied
Sep 10 09:23:41 node2.crw-qe.com atomic-openshift-node[1857]: E0910 09:23:41.259015 1857 kuberuntime_manager.go:703] init container start failed: CreateContainerConfigError: failed to create subPath directory for volumeMount "claim-che-workspace-workspaceozi4g8xrpfata01f" of container "pluginbroker-artifacts-rhel8-latest"
Sep 10 09:23:41 node2.crw-qe.com atomic-openshift-node[1857]: E0910 09:23:41.259067 1857 pod_workers.go:186] Error syncing pod 7d988396-1239-11ec-9fff-fa163eb7bad5 ("workspaceozi4g8xrpfata01f.che-workspace-pod-6d6879f8c4-c94d6_user-codeready(7d988396-1239-11ec-9fff-fa163eb7bad5)"), skipping: failed to "StartContainer" for "pluginbroker-artifacts-rhel8-latest" with CreateContainerConfigError: "failed to create subPath directory for volumeMount \"claim-che-workspace-workspaceozi4g8xrpfata01f\" of container \"pluginbroker-artifacts-rhel8-latest\""
Sep 10 09:23:43 node2.crw-qe.com atomic-openshift-node[1857]: I0910 09:23:43.267255 1857 container_manager_linux.go:428] [ContainerManager]: Discovered runtime cgroups name: /systemd/system.slice
Sep 10 09:23:51 node2.crw-qe.com dnsmasq[1126]: setting upstream servers from DBus
Sep 10 09:23:51 node2.crw-qe.com dnsmasq[1126]: using nameserver 10.5.30.160#53
Sep 10 09:23:51 node2.crw-qe.com dnsmasq[1126]: using nameserver 10.11.5.19#53
Sep 10 09:23:51 node2.crw-qe.com dnsmasq[1126]: using nameserver 10.0.207.159#53 for domain crw-qe.com
Sep 10 09:23:51 node2.crw-qe.com dnsmasq[1126]: using nameserver 127.0.0.1#53 for domain in-addr.arpa
Sep 10 09:23:51 node2.crw-qe.com dnsmasq[1126]: using nameserver 127.0.0.1#53 for domain cluster.local
Sep 10 09:23:53 node2.crw-qe.com atomic-openshift-node[1857]: I0910 09:23:53.946276 1857 provider.go:119] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 09:23:54 node2.crw-qe.com atomic-openshift-node[1857]: I0910 09:23:54.282164 1857 kube_docker_client.go:348] Stop pulling image "quay.io/crw/pluginbroker-artifacts-rhel8:latest": "Status: Image is up to date for quay.io/crw/pluginbroker-artifacts-rhel8:latest"
Sep 10 09:23:54 node2.crw-qe.com atomic-openshift-node[1857]: E0910 09:23:54.292154 1857 kubelet_pods.go:198] failed to create subPath directory for volumeMount "claim-che-workspace-workspaceozi4g8xrpfata01f" of container "pluginbroker-artifacts-rhel8-latest": cannot create directory /var/lib/origin/openshift.local.volumes/pods/7d988396-1239-11ec-9fff-fa163eb7bad5/volumes/kubernetes.io~nfs/pv17/workspaceozi4g8xrpfata01f/plugins: permission denied
Sep 10 09:23:54 node2.crw-qe.com atomic-openshift-node[1857]: E0910 09:23:54.292274 1857 kuberuntime_manager.go:703] init container start failed: CreateContainerConfigError: failed to create subPath directory for volumeMount "claim-che-workspace-workspaceozi4g8xrpfata01f" of container "pluginbroker-artifacts-rhel8-latest"
Sep 10 09:23:54 node2.crw-qe.com atomic-openshift-node[1857]: E0910 09:23:54.292320 1857 pod_workers.go:186] Error syncing pod 7d988396-1239-11ec-9fff-fa163eb7bad5 ("workspaceozi4g8xrpfata01f.che-workspace-pod-6d6879f8c4-c94d6_user-codeready(7d988396-1239-11ec-9fff-fa163eb7bad5)"), skipping: failed to "StartContainer" for "pluginbroker-artifacts-rhel8-latest" with CreateContainerConfigError: "failed to create subPath directory for volumeMount \"claim-che-workspace-workspaceozi4g8xrpfata01f\" of container \"pluginbroker-artifacts-rhel8-latest\""
It seems that for some reason, the pod is unable to create /plugins/ subfolder in the workspace.
- relates to
-
CRW-1358 Feature: Support IntelliJ IDEA as optional editor
-
- Closed
-
