Uploaded image for project: 'Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces) '
  1. Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces)
  2. CRW-1189

"chmod: changing permissions of '/home/user/cacerts': Operation not permitted" error of quay.io/crw/server-rhel8:2.4-4 server container start

XMLWordPrintable

      Installation of CRW CRW 2.4.0.ER-08-27 failed because of Codeready deployment error:

      Codeready pod logs
      Using custom assembly from /home/user/codeready Found a custom cert. Adding it to java trust store /home/user/cacerts chmod: changing permissions of '/home/user/cacerts': Operation not permitted Trust this certificate? [no]: Certificate was added to keystore chmod: changing permissions of '/home/user/cacerts': Operation not permitted
      Command to install CRW on OCP 3.11
      crwctl server:start --che-operator-cr-patch-yaml=/mnt/hudson_workspace/workspace/install-crw-using-crwctl/custom-resource-patch.yaml --che-operator-image=quay.io/crw/crw-2-rhel8-operator:latest --listr-renderer=verbose --k8spodreadytimeout=300000 -n crw-crwctl-tls-oauth
      Crwctl log

      10:42:12 Current Kubernetes context: 'default/console-ocp311-crw:8443/admin'
      10:42:12 Installer type is set to: 'operator'
      10:42:12 [03:42:11] Verify Kubernetes API [started]
      10:42:12 [03:42:11] Verify Kubernetes API...OK [title changed]
      10:42:12 [03:42:11] Verify Kubernetes API...OK (it's OpenShift) [title changed]
      10:42:12 [03:42:11] Verify Kubernetes API...OK (it's OpenShift) [completed]
      10:42:12 [03:42:11] Looking for an already existing CodeReady Workspaces instance [started]
      10:42:12 [03:42:11] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl-tls-oauth" [started]
      10:42:12 [03:42:11] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl-tls-oauth"...it is not [title changed]
      10:42:12 [03:42:11] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl-tls-oauth"...it is not [completed]
      10:42:12 [03:42:11] Looking for an already existing CodeReady Workspaces instance [completed]
      10:42:12 [03:42:11] Openshift preflight checklist [started]
      10:42:12 [03:42:11] Verify if oc is installed [started]
      10:42:12 [03:42:11] Verify if oc is installed...done. [title changed]
      10:42:12 [03:42:11] Verify if oc is installed...done. [completed]
      10:42:12 [03:42:11] Verify if openshift is running [started]
      10:42:12 [03:42:12] Verify if openshift is running...done. [title changed]
      10:42:12 [03:42:12] Verify if openshift is running...done. [completed]
      10:42:12 [03:42:12] Check OpenShift version [started]
      10:42:13 [03:42:12] Check OpenShift version: v3.11.248. [title changed]
      10:42:13 [03:42:12] Check OpenShift version: v3.11.248. [completed]
      10:42:13 [03:42:12] Check Kubernetes version [started]
      10:42:13 [03:42:12] Check Kubernetes version: Found v1.11.0+d4cacc0. [title changed]
      10:42:13 [03:42:12] Check Kubernetes version: Found v1.11.0+d4cacc0. [completed]
      10:42:13 [03:42:12] Openshift preflight checklist [completed]
      10:42:13 [03:42:12] Verify Openshift oauth. [started]
      10:42:13 [03:42:12] Verify Openshift oauth....done. [title changed]
      10:42:13 [03:42:12] Verify Openshift oauth....done. [completed]
      10:42:13 CodeReady Workspaces logs will be available in '/tmp/crwctl-logs/1598600531724'
      10:42:13 [03:42:12] Start following logs [started]
      10:42:13 [03:42:12] Start following Operator logs [started]
      10:42:13 [03:42:12] Start following Operator logs...done [title changed]
      10:42:13 [03:42:12] Start following Operator logs...done [completed]
      10:42:13 [03:42:12] Start following CodeReady Workspaces logs [started]
      10:42:13 [03:42:12] Start following CodeReady Workspaces logs...done [title changed]
      10:42:13 [03:42:12] Start following CodeReady Workspaces logs...done [completed]
      10:42:13 [03:42:12] Start following Postgres logs [started]
      10:42:13 [03:42:12] Start following Postgres logs...done [title changed]
      10:42:13 [03:42:12] Start following Postgres logs...done [completed]
      10:42:13 [03:42:12] Start following Keycloak logs [started]
      10:42:13 [03:42:12] Start following Keycloak logs...done [title changed]
      10:42:13 [03:42:12] Start following Keycloak logs...done [completed]
      10:42:13 [03:42:12] Start following Plugin registry logs [started]
      10:42:13 [03:42:12] Start following Plugin registry logs...done [title changed]
      10:42:13 [03:42:12] Start following Plugin registry logs...done [completed]
      10:42:13 [03:42:12] Start following Devfile registry logs [started]
      10:42:13 [03:42:12] Start following Devfile registry logs...done [title changed]
      10:42:13 [03:42:12] Start following Devfile registry logs...done [completed]
      10:42:13 [03:42:12] Start following logs [completed]
      10:42:13 [03:42:12] Start following events [started]
      10:42:13 [03:42:12] Start following namespace events [started]
      10:42:13 [03:42:12] Start following namespace events...done [title changed]
      10:42:13 [03:42:12] Start following namespace events...done [completed]
      10:42:13 [03:42:12] Start following events [completed]
      10:42:13 [03:42:12] Running the CodeReady Workspaces operator [started]
      10:42:13 [03:42:12] Copying operator resources [started]
      10:42:13 [03:42:12] Copying operator resources...done. [title changed]
      10:42:13 [03:42:12] Copying operator resources...done. [completed]
      10:42:13 [03:42:12] Create Namespace (crw-crwctl-tls-oauth) [started]
      10:42:13 [03:42:12] Create Namespace (crw-crwctl-tls-oauth)...done. [title changed]
      10:42:13 [03:42:12] Create Namespace (crw-crwctl-tls-oauth)...done. [completed]
      10:42:13 [03:42:12] Create ServiceAccount codeready-operator in namespace crw-crwctl-tls-oauth [started]
      10:42:13 [03:42:12] Create ServiceAccount codeready-operator in namespace crw-crwctl-tls-oauth...done. [title changed]
      10:42:13 [03:42:12] Create ServiceAccount codeready-operator in namespace crw-crwctl-tls-oauth...done. [completed]
      10:42:13 [03:42:12] Create Role codeready-operator in namespace crw-crwctl-tls-oauth [started]
      10:42:13 [03:42:13] Create Role codeready-operator in namespace crw-crwctl-tls-oauth...done. [title changed]
      10:42:13 [03:42:13] Create Role codeready-operator in namespace crw-crwctl-tls-oauth...done. [completed]
      10:42:13 [03:42:13] Create ClusterRole crw-crwctl-tls-oauth-codeready-operator [started]
      10:42:13 [03:42:13] Create ClusterRole crw-crwctl-tls-oauth-codeready-operator...done. [title changed]
      10:42:13 [03:42:13] Create ClusterRole crw-crwctl-tls-oauth-codeready-operator...done. [completed]
      10:42:13 [03:42:13] Create RoleBinding codeready-operator in namespace crw-crwctl-tls-oauth [started]
      10:42:13 [03:42:13] Create RoleBinding codeready-operator in namespace crw-crwctl-tls-oauth...done. [title changed]
      10:42:13 [03:42:13] Create RoleBinding codeready-operator in namespace crw-crwctl-tls-oauth...done. [completed]
      10:42:13 [03:42:13] Create ClusterRoleBinding crw-crwctl-tls-oauth-codeready-operator [started]
      10:42:13 [03:42:13] Create ClusterRoleBinding crw-crwctl-tls-oauth-codeready-operator...done. [title changed]
      10:42:13 [03:42:13] Create ClusterRoleBinding crw-crwctl-tls-oauth-codeready-operator...done. [completed]
      10:42:13 [03:42:13] Create CRD checlusters.org.eclipse.che [started]
      10:42:14 [03:42:13] Create CRD checlusters.org.eclipse.che...It already exists. [title changed]
      10:42:14 [03:42:13] Create CRD checlusters.org.eclipse.che...It already exists. [completed]
      10:42:14 [03:42:13] Waiting 5 seconds for the new Kubernetes resources to get flushed [started]
      10:42:19 [03:42:18] Waiting 5 seconds for the new Kubernetes resources to get flushed...done. [title changed]
      10:42:19 [03:42:18] Waiting 5 seconds for the new Kubernetes resources to get flushed...done. [completed]
      10:42:19 [03:42:18] Create deployment codeready-operator in namespace crw-crwctl-tls-oauth [started]
      10:42:19 [03:42:18] Create deployment codeready-operator in namespace crw-crwctl-tls-oauth...done. [title changed]
      10:42:19 [03:42:18] Create deployment codeready-operator in namespace crw-crwctl-tls-oauth...done. [completed]
      10:42:19 [03:42:18] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl-tls-oauth [started]
      10:42:19 [03:42:18] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl-tls-oauth...done. [title changed]
      10:42:19 [03:42:18] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl-tls-oauth...done. [completed]
      10:42:19 [03:42:18] Running the CodeReady Workspaces operator [completed]
      10:42:19 [03:42:18] Post installation checklist [started]
      10:42:19 [03:42:18] PostgreSQL pod bootstrap [started]
      10:42:19 [03:42:18] scheduling [started]
      10:42:31 [03:42:30] scheduling...done. [title changed]
      10:42:31 [03:42:30] scheduling...done. [completed]
      10:42:31 [03:42:30] downloading images [started]
      10:42:34 [03:42:33] downloading images...done. [title changed]
      10:42:34 [03:42:33] downloading images...done. [completed]
      10:42:34 [03:42:33] starting [started]
      10:43:13 [03:43:11] starting...done. [title changed]
      10:43:13 [03:43:11] starting...done. [completed]
      10:43:13 [03:43:11] PostgreSQL pod bootstrap [completed]
      10:43:13 [03:43:11] Keycloak pod bootstrap [started]
      10:43:13 [03:43:11] scheduling [started]
      10:43:14 [03:43:14] scheduling...done. [title changed]
      10:43:14 [03:43:14] scheduling...done. [completed]
      10:43:14 [03:43:14] downloading images [started]
      10:43:17 [03:43:16] downloading images...done. [title changed]
      10:43:17 [03:43:16] downloading images...done. [completed]
      10:43:17 [03:43:16] starting [started]
      10:44:13 [03:44:04] starting...done. [title changed]
      10:44:13 [03:44:04] starting...done. [completed]
      10:44:13 [03:44:04] Keycloak pod bootstrap [completed]
      10:44:13 [03:44:04] Devfile registry pod bootstrap [started]
      10:44:13 [03:44:04] scheduling [started]
      10:45:34 [03:45:22] scheduling...done. [title changed]
      10:45:34 [03:45:22] scheduling...done. [completed]
      10:45:34 [03:45:22] downloading images [started]
      10:45:34 [03:45:31] downloading images...done. [title changed]
      10:45:34 [03:45:31] downloading images...done. [completed]
      10:45:34 [03:45:31] starting [started]
      10:45:38 [03:45:37] starting...done. [title changed]
      10:45:38 [03:45:37] starting...done. [completed]
      10:45:38 [03:45:37] Devfile registry pod bootstrap [completed]
      10:45:38 [03:45:37] Plugin registry pod bootstrap [started]
      10:45:38 [03:45:37] scheduling [started]
      10:45:38 [03:45:37] scheduling...done. [title changed]
      10:45:38 [03:45:37] scheduling...done. [completed]
      10:45:38 [03:45:37] downloading images [started]
      10:45:56 [03:45:53] downloading images...done. [title changed]
      10:45:56 [03:45:53] downloading images...done. [completed]
      10:45:56 [03:45:53] starting [started]
      10:45:58 [03:45:57] starting...done. [title changed]
      10:45:58 [03:45:57] starting...done. [completed]
      10:45:58 [03:45:57] Plugin registry pod bootstrap [completed]
      10:45:58 [03:45:57] CodeReady Workspaces pod bootstrap [started]
      10:45:58 [03:45:57] scheduling [started]
      10:45:58 [03:45:57] scheduling...done. [title changed]
      10:45:58 [03:45:57] scheduling...done. [completed]
      10:45:58 [03:45:57] downloading images [started]
      10:46:10 [03:46:08] downloading images...done. [title changed]
      10:46:10 [03:46:08] downloading images...done. [completed]
      10:46:10 [03:46:08] starting [started]
      10:51:17 [03:51:15] starting [failed]
      10:51:17 [03:51:15] ERR_TIMEOUT: Timeout set to pod ready timeout 300000
      10:51:17 [03:51:15] CodeReady Workspaces pod bootstrap [failed]
      10:51:17 [03:51:15] ERR_TIMEOUT: Timeout set to pod ready timeout 300000
      10:51:17 [03:51:15] Post installation checklist [failed]
      10:51:17 [03:51:15] ERR_TIMEOUT: Timeout set to pod ready timeout 300000
      10:51:17 Error: Error: ERR_TIMEOUT: Timeout set to pod ready timeout 300000
      10:51:17 Installation failed, check logs in '/tmp/crwctl-logs/1598600531724'

      custom-resource-patch.yaml
      spec:
  server:
    cheImage: 'quay.io/crw/server-rhel8'
    cheImageTag: 'latest'
    devfileRegistryImage: 'quay.io/crw/devfileregistry-rhel8:latest'
    pluginRegistryImage: 'quay.io/crw/pluginregistry-rhel8:latest'
    customCheProperties:
      CHE_WORKSPACE_PLUGIN__BROKER_METADATA_IMAGE: 'quay.io/crw/pluginbroker-metadata-rhel8:latest'
      CHE_WORKSPACE_PLUGIN__BROKER_ARTIFACTS_IMAGE: 'quay.io/crw/pluginbroker-artifacts-rhel8:latest'
      CHE_SERVER_SECURE__EXPOSER_JWTPROXY_IMAGE: 'quay.io/crw/jwtproxy-rhel8:latest'
      CHE_LIMITS_USER_WORKSPACES_RUN_COUNT: '-1'
      CHE_LIMITS_WORKSPACE_IDLE_TIMEOUT: '900000'
      CHE_INFRA_KUBERNETES_WORKSPACE__UNRECOVERABLE__EVENTS: 'Failed Scheduling,Failed to pull image'
  auth:
    openShiftoAuth: true
    updateAdminPassword: false

      crwctl/2.4.0-CI-quay.0aa907d linux-x64 node-v10.19.0: https://codeready-workspaces-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/crwctl_2.4/lastSuccessfulBuild/artifact/codeready-workspaces-chectl/dist/channels/quay/codeready-workspaces-2.4.0-CI-crwctl-linux-x64.tar.gz -O crwctl-linux-x64.tar.gz

            mkuznets Mykhailo Kuznietsov
            dnochevn Dmytro Nochevnov
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: