Uploaded image for project: 'Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces) '
  1. Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces)
  2. CRW-1006

Can't execute commands inside CRW 2.2.0 workspace on OCP/OSD 4.x on AWS

XMLWordPrintable

    • Hide

      1. Install CRW 2.2.0.RC2 on OSD 4.3 by using codeready-workspaces-operator-qe addon.
      2. Log into CRW instance by using GitHub account.
      3. Start maven-eap workspace.
      4. Go to Terminal > Run task and try to execute any command.

      Show
      1. Install CRW 2.2.0.RC2 on OSD 4.3 by using codeready-workspaces-operator-qe addon . 2. Log into CRW instance by using GitHub account. 3. Start maven-eap workspace. 4. Go to Terminal > Run task and try to execute any command.

      It was impossible to execute any command inside workspace of CRW installed by addon on OSD 4.3.18 because of error:

      Request runTask failed with message: Failed to execute Che command: Connection is disposed.

      Update: the issue hasn't been reproduced after logging into CRW as a new user:

      Also affects OCP 4.4 on AWS:

      workspacepmmgxwersgi9cpjd.maven-67dc89944d-n88zb-theia-idel3p.log

      Theia container logs
      2020-06-30 18:10:13.517 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436][ms-vscode.references-view]: Started plugin. 
2020-06-30 18:10:13.525 root ERROR [hosted-plugin: 48] Error parsing configurations: error: 4, length:  0, offset:  0 
2020-06-30 18:10:13.526 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436][redhat.java]: Started plugin. 
2020-06-30 18:10:13.526 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436][vscjava.vscode-java-debug]: Started plugin. 
2020-06-30 18:10:13.527 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436] Start of 73 plugins took: 18414.4 ms 
2020-06-30 18:10:13.533 root ERROR [hosted-plugin: 48] Error parsing configurations: error: 4, length:  0, offset:  0 
2020-06-30 18:10:13.678 root INFO [nsfw-watcher: 31] Started watching: /projects/.theia/tasks.json 
2020-06-30 18:10:13.678 root INFO [nsfw-watcher: 31] Started watching: /projects/.theia/launch.json 
2020-06-30 18:10:14.032 root INFO [hosted-plugin: 48] Child process "curl" exited with code 0 
2020-06-30 18:10:14.049 root INFO [hosted-plugin: 48] Child process "unzip" exited with code 0 
2020-06-30 18:10:23.802 root INFO >>> Storing the layout... 
2020-06-30 18:10:23.803 root INFO <<< The layout has been successfully stored. 
2020-06-30 18:11:12.365 root ERROR [hosted-plugin: 48] Task plugin webSocket: Reconnecting in 1000ms due to 
2020-06-30 18:11:13.366 root ERROR [hosted-plugin: 48] Task plugin webSocket: Reconnecting... 
2020-06-30 18:11:20.511 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-npm/extension/dist/main) 
2020-06-30 18:11:20.536 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-jake/extension/dist/main) 
2020-06-30 18:11:20.540 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-gulp/extension/dist/main) 
2020-06-30 18:11:20.545 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-grunt/extension/dist/main) 
2020-06-30 18:11:46.953 root ERROR [hosted-plugin: 48] Failed to execute Che command: { Error: Connection is disposed.
    at throwIfClosedOrDisposed (/tmp/theia-unpacked/task_plugin.theia/node_modules/vscode-jsonrpc/lib/main.js:677:19)
    at Object.sendRequest (/tmp/theia-unpacked/task_plugin.theia/node_modules/vscode-jsonrpc/lib/main.js:783:13)
    at MachineExecClient.<anonymous> (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:83:57)
    at step (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:51:23)
    at Object.next (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:32:53)
    at fulfilled (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:23:58)
    at process._tickCallback (internal/process/next_tick.js:68:7) code: 2 } 
2020-06-30 18:11:47.166 root ERROR Request runTask failed with error: Failed to execute Che command: Connection is disposed. Params: Error: Failed to execute Che command: Connection is disposed.
    at CheTaskRunner.<anonymous> (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:146:31)
    at step (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:51:23)
    at Object.throw (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:32:53)
    at rejected (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:24:65)
    at process._tickCallback (internal/process/next_tick.js:68:7)
2020-06-30 18:11:47.373 root ERROR Error launching task 'build': Request runTask failed with message: Failed to execute Che command: Connection is disposed. Params: Error: Request 'run' failed
    at Proxy.<anonymous> (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:1450125)
    at t.<anonymous> (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:847814)
    at https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:846984
    at Object.next (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:847089)
    at a (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:845803)
2020-06-30 18:11:57.440 root INFO >>> Storing the layout... 
2020-06-30 18:11:57.441 root INFO <<< The layout has been successfully stored.
      jwtproxy container logs
      time="2020-06-30T18:05:10Z" level=info msg="Starting reverse proxy (Listening on ':4402')" 
time="2020-06-30T18:05:10Z" level=info msg="Starting reverse proxy (Listening on ':4401')" 
time="2020-06-30T18:05:10Z" level=info msg="Starting reverse proxy (Listening on ':4400')" 
2020/06/30 18:11:12 [001] WARN: Websocket error: <nil>
2020/06/30 18:11:12 [001] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:43970: use of closed network connection
2020/06/30 18:11:12 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:11:12 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:12:18 [002] WARN: Websocket error: <nil>
2020/06/30 18:12:18 [002] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:45378: use of closed network connection
2020/06/30 18:12:18 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:12:18 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:13:19 [003] WARN: Websocket error: <nil>
2020/06/30 18:13:19 [003] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:46642: use of closed network connection
2020/06/30 18:13:19 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:13:19 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:14:24 [004] WARN: Websocket error: <nil>
2020/06/30 18:14:24 [004] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:60706: use of closed network connection
2020/06/30 18:14:24 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:14:24 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:15:25 [005] WARN: Websocket error: <nil>
2020/06/30 18:15:25 [005] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:33514: use of closed network connection
2020/06/30 18:15:25 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:15:25 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:16:26 [006] WARN: Websocket error: <nil>
2020/06/30 18:16:26 [006] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:34560: use of closed network connection
2020/06/30 18:16:26 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:16:26 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:17:27 [007] WARN: Websocket error: <nil>
2020/06/30 18:17:27 [007] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:51908: use of closed network connection
2020/06/30 18:17:27 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:17:27 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:18:28 [008] WARN: Websocket error: <nil>
2020/06/30 18:18:28 [008] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:53188: use of closed network connection
2020/06/30 18:18:28 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:18:28 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:19:33 [009] WARN: Websocket error: <nil>
2020/06/30 18:19:33 [009] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:37804: use of closed network connection
2020/06/30 18:19:33 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:19:33 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:20:34 [010] WARN: Websocket error: <nil>
2020/06/30 18:20:34 [010] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:55850: use of closed network connection
2020/06/30 18:20:34 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:20:34 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
2020/06/30 18:21:35 [011] WARN: Websocket error: <nil>
2020/06/30 18:21:35 [011] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:57116: use of closed network connection
2020/06/30 18:21:35 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
2020/06/30 18:21:35 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)

      All-in-one config yaml: all.yaml.

      Another occurrence of error was execution of "deploy to OpenShift" and "run application" tasks after the build task had finished successfully:
      https://codeready-ndp-crw-2.apps.aws-ocp44.crw-qe.com


      Then the workspace went offline.

      The error has been also reproduced on RHPDS:

      I have also noticed that task progressor in build tab didn't stop after the build had finished:

      https://issues.redhat.com/browse/CRW-1053

        1. all.yaml
          211 kB
        2. Screenshot from 2020-06-23 11-14-37.png
          Screenshot from 2020-06-23 11-14-37.png
          289 kB
        3. Screenshot from 2020-06-23 12-57-55.png
          Screenshot from 2020-06-23 12-57-55.png
          257 kB
        4. Screenshot from 2020-06-30 21-16-30.png
          Screenshot from 2020-06-30 21-16-30.png
          240 kB
        5. Screenshot from 2020-06-30 23-01-32.png
          Screenshot from 2020-06-30 23-01-32.png
          164 kB
        6. Screenshot from 2020-06-30 23-18-12.png
          Screenshot from 2020-06-30 23-18-12.png
          163 kB
        7. Screenshot from 2020-07-01 01-43-56.png
          Screenshot from 2020-07-01 01-43-56.png
          131 kB
        8. Screenshot from 2020-07-01 01-49-35.png
          Screenshot from 2020-07-01 01-49-35.png
          87 kB
        9. Screenshot from 2020-07-03 13-40-50.png
          Screenshot from 2020-07-03 13-40-50.png
          157 kB
        10. Screenshot from 2020-07-03 13-46-40.png
          Screenshot from 2020-07-03 13-46-40.png
          278 kB
        11. Screenshot from 2020-07-06 17-56-27.png
          Screenshot from 2020-07-06 17-56-27.png
          382 kB
        12. workspacepmmgxwersgi9cpjd.maven-67dc89944d-n88zb-theia-idel3p.log
          79 kB

              rnikiten Roman Nikitenko
              dnochevn Dmytro Nochevnov
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: