Uploaded image for project: 'Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces) '
  1. Red Hat OpenShift Dev Spaces (formerly CodeReady Workspaces)
  2. CRW-1006

Can't execute commands inside CRW 2.2.0 workspace on OCP/OSD 4.x on AWS

    XMLWordPrintable

Details

    • Hide

      1. Install CRW 2.2.0.RC2 on OSD 4.3 by using codeready-workspaces-operator-qe addon.
      2. Log into CRW instance by using GitHub account.
      3. Start maven-eap workspace.
      4. Go to Terminal > Run task and try to execute any command.

      Show
      1. Install CRW 2.2.0.RC2 on OSD 4.3 by using codeready-workspaces-operator-qe addon . 2. Log into CRW instance by using GitHub account. 3. Start maven-eap workspace. 4. Go to Terminal > Run task and try to execute any command.

    Description

      It was impossible to execute any command inside workspace of CRW installed by addon on OSD 4.3.18 because of error:

      Request runTask failed with message: Failed to execute Che command: Connection is disposed.
      

      Update: the issue hasn't been reproduced after logging into CRW as a new user:

      Also affects OCP 4.4 on AWS:

      workspacepmmgxwersgi9cpjd.maven-67dc89944d-n88zb-theia-idel3p.log

      Theia container logs
      2020-06-30 18:10:13.517 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436][ms-vscode.references-view]: Started plugin. 
      2020-06-30 18:10:13.525 root ERROR [hosted-plugin: 48] Error parsing configurations: error: 4, length:  0, offset:  0 
      2020-06-30 18:10:13.526 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436][redhat.java]: Started plugin. 
      2020-06-30 18:10:13.526 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436][vscjava.vscode-java-debug]: Started plugin. 
      2020-06-30 18:10:13.527 root INFO [ee2fd2fe-54a4-4db2-9554-dcbddbd50436] Start of 73 plugins took: 18414.4 ms 
      2020-06-30 18:10:13.533 root ERROR [hosted-plugin: 48] Error parsing configurations: error: 4, length:  0, offset:  0 
      2020-06-30 18:10:13.678 root INFO [nsfw-watcher: 31] Started watching: /projects/.theia/tasks.json 
      2020-06-30 18:10:13.678 root INFO [nsfw-watcher: 31] Started watching: /projects/.theia/launch.json 
      2020-06-30 18:10:14.032 root INFO [hosted-plugin: 48] Child process "curl" exited with code 0 
      2020-06-30 18:10:14.049 root INFO [hosted-plugin: 48] Child process "unzip" exited with code 0 
      2020-06-30 18:10:23.802 root INFO >>> Storing the layout... 
      2020-06-30 18:10:23.803 root INFO <<< The layout has been successfully stored. 
      2020-06-30 18:11:12.365 root ERROR [hosted-plugin: 48] Task plugin webSocket: Reconnecting in 1000ms due to 
      2020-06-30 18:11:13.366 root ERROR [hosted-plugin: 48] Task plugin webSocket: Reconnecting... 
      2020-06-30 18:11:20.511 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-npm/extension/dist/main) 
      2020-06-30 18:11:20.536 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-jake/extension/dist/main) 
      2020-06-30 18:11:20.540 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-gulp/extension/dist/main) 
      2020-06-30 18:11:20.545 root INFO [hosted-plugin: 48] PLUGIN_HOST(48): PluginManagerExtImpl/loadPlugin(/default-theia-plugins/vscode-builtin-grunt/extension/dist/main) 
      2020-06-30 18:11:46.953 root ERROR [hosted-plugin: 48] Failed to execute Che command: { Error: Connection is disposed.
          at throwIfClosedOrDisposed (/tmp/theia-unpacked/task_plugin.theia/node_modules/vscode-jsonrpc/lib/main.js:677:19)
          at Object.sendRequest (/tmp/theia-unpacked/task_plugin.theia/node_modules/vscode-jsonrpc/lib/main.js:783:13)
          at MachineExecClient.<anonymous> (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:83:57)
          at step (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:51:23)
          at Object.next (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:32:53)
          at fulfilled (/tmp/theia-unpacked/task_plugin.theia/lib/machine/machine-exec-client.js:23:58)
          at process._tickCallback (internal/process/next_tick.js:68:7) code: 2 } 
      2020-06-30 18:11:47.166 root ERROR Request runTask failed with error: Failed to execute Che command: Connection is disposed. Params: Error: Failed to execute Che command: Connection is disposed.
          at CheTaskRunner.<anonymous> (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:146:31)
          at step (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:51:23)
          at Object.throw (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:32:53)
          at rejected (/tmp/theia-unpacked/task_plugin.theia/lib/task/che-task-runner.js:24:65)
          at process._tickCallback (internal/process/next_tick.js:68:7)
      2020-06-30 18:11:47.373 root ERROR Error launching task 'build': Request runTask failed with message: Failed to execute Che command: Connection is disposed. Params: Error: Request 'run' failed
          at Proxy.<anonymous> (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:1450125)
          at t.<anonymous> (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:847814)
          at https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:846984
          at Object.next (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:847089)
          at a (https://static.developers.redhat.com/che/crw_theia_artifacts/theia.e60a6c8c371c7a73a034.js:1:845803)
      2020-06-30 18:11:57.440 root INFO >>> Storing the layout... 
      2020-06-30 18:11:57.441 root INFO <<< The layout has been successfully stored. 
      
      jwtproxy container logs
      time="2020-06-30T18:05:10Z" level=info msg="Starting reverse proxy (Listening on ':4402')" 
      time="2020-06-30T18:05:10Z" level=info msg="Starting reverse proxy (Listening on ':4401')" 
      time="2020-06-30T18:05:10Z" level=info msg="Starting reverse proxy (Listening on ':4400')" 
      2020/06/30 18:11:12 [001] WARN: Websocket error: <nil>
      2020/06/30 18:11:12 [001] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:43970: use of closed network connection
      2020/06/30 18:11:12 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:11:12 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:12:18 [002] WARN: Websocket error: <nil>
      2020/06/30 18:12:18 [002] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:45378: use of closed network connection
      2020/06/30 18:12:18 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:12:18 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:13:19 [003] WARN: Websocket error: <nil>
      2020/06/30 18:13:19 [003] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:46642: use of closed network connection
      2020/06/30 18:13:19 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:13:19 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:14:24 [004] WARN: Websocket error: <nil>
      2020/06/30 18:14:24 [004] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:60706: use of closed network connection
      2020/06/30 18:14:24 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:14:24 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:15:25 [005] WARN: Websocket error: <nil>
      2020/06/30 18:15:25 [005] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:33514: use of closed network connection
      2020/06/30 18:15:25 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:15:25 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:16:26 [006] WARN: Websocket error: <nil>
      2020/06/30 18:16:26 [006] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:34560: use of closed network connection
      2020/06/30 18:16:26 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:16:26 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:17:27 [007] WARN: Websocket error: <nil>
      2020/06/30 18:17:27 [007] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:51908: use of closed network connection
      2020/06/30 18:17:27 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:17:27 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:18:28 [008] WARN: Websocket error: <nil>
      2020/06/30 18:18:28 [008] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:53188: use of closed network connection
      2020/06/30 18:18:28 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:18:28 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:19:33 [009] WARN: Websocket error: <nil>
      2020/06/30 18:19:33 [009] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.128.2.5:37804: use of closed network connection
      2020/06/30 18:19:33 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:19:33 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:20:34 [010] WARN: Websocket error: <nil>
      2020/06/30 18:20:34 [010] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:55850: use of closed network connection
      2020/06/30 18:20:34 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:20:34 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      2020/06/30 18:21:35 [011] WARN: Websocket error: <nil>
      2020/06/30 18:21:35 [011] WARN: Websocket error: readfrom tcp 10.129.2.225:4400->10.131.0.5:57116: use of closed network connection
      2020/06/30 18:21:35 http: response.WriteHeader on hijacked connection from github.com/eclipse/che-jwtproxy/vendor/github.com/coreos/goproxy.(*ProxyHttpServer).ServeHTTP (proxy.go:149)
      2020/06/30 18:21:35 http: response.Write on hijacked connection from io.copyBuffer (io.go:404)
      

      All-in-one config yaml: all.yaml.

      Another occurrence of error was execution of "deploy to OpenShift" and "run application" tasks after the build task had finished successfully:
      https://codeready-ndp-crw-2.apps.aws-ocp44.crw-qe.com


      Then the workspace went offline.

      The error has been also reproduced on RHPDS:

      I have also noticed that task progressor in build tab didn't stop after the build had finished:

      https://issues.redhat.com/browse/CRW-1053

      Attachments

        Issue Links

          Activity

            People

              rnikiten Roman Nikitenko
              dnochevn Dmytro Nochevnov
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: