"Waiting for pod .. was interrupted" error during devFile handling

CRW is intermittently not able to create workspace. This issue may be caused by poor CRW ability to handle unstable networks.

Error:

Failed to run the workspace: "Waiting for pod 'workspace9fbid1gnx7273d47.maven-545f8c9cf4-hw79f' was interrupted"

Steps to reproduce

• Increase pulling timeouts

  oc edit CheCluster codeready-workspaces
  

  ...
  spec:
    server:
      ...
      customCheProperties:
        CHE_INFRA_KUBERNETES_WORKSPACE__START__TIMEOUT__MIN: "300"
  ...
  

• Import devFile with the definition of image (eg. docker-registry.upshift.redhat.com/kwills/eap-xp3-openjdk11-openshift-rhel8:xp3)
• CRW shows logs with details how CRW is puling images, eg:

  Successfully assigned xpaasqe-codeready/workspacezgx9wwu74c62bhqf.che-plugin-broker to play-qu7i-x8jvs-worker-0-ps5c6
  
  Add eth0 [10.129.2.58/23]
  
  Pulling image "registry.redhat.io/codeready-workspaces/pluginbroker-metadata-rhel8@sha256:0143a80b869620af08a0d60165dc9d13357a79e7243502832326cf053c17ee38"
  
  Successfully pulled image "registry.redhat.io/codeready-workspaces/pluginbroker-metadata-rhel8@sha256:0143a80b869620af08a0d60165dc9d13357a79e7243502832326cf053c17ee38" in 1.642605721s
  
  Created container pluginbroker-metadata-rhel8-0143a80b86
  
  Started container pluginbroker-metadata-rhel8-0143a80b86
  
  Starting plugin metadata broker
  
  List of plugins and editors to install
  
  - redhat/java11/latest - Support for Maven, Gradle. Java Linting, Intellisense, formatting, refactoring, debugging, and language server.
  
  - redhat/dependency-analytics/latest - Insights about your application dependencies, Security, License compatibility and AI based guidance to choose appropriate dependencies for your application.
  
  - eclipse/che-theia/latest - Eclipse Theia
  
  All plugin metadata has been successfully processed
  
  Add eth0 [10.129.2.60/23]
  
  Pulling image "registry.redhat.io/codeready-workspaces/theia-endpoint-rhel8@sha256:60c84fca55a997a6aab4ca07b8ff7d859948c1f525adeba2ae624c84fe059a56"
  
  Successfully pulled image "registry.redhat.io/codeready-workspaces/theia-endpoint-rhel8@sha256:60c84fca55a997a6aab4ca07b8ff7d859948c1f525adeba2ae624c84fe059a56" in 1.631168732s
  
  Created container remote-runtime-injectorzsd
  
  Started container remote-runtime-injectorzsd
  
  Pulling image "registry.redhat.io/codeready-workspaces/pluginbroker-artifacts-rhel8@sha256:cda306cb7e5c42faa6ab43218d39984d4955134b3ca9654968c28b05e0796c3a"
  
  Successfully pulled image "registry.redhat.io/codeready-workspaces/pluginbroker-artifacts-rhel8@sha256:cda306cb7e5c42faa6ab43218d39984d4955134b3ca9654968c28b05e0796c3a" in 1.614544366s
  
  Created container pluginbroker-artifacts-rhel8-cda306cb7e
  
  Started container pluginbroker-artifacts-rhel8-cda306cb7e
  
  Starting plugin artifacts broker
  
  Cleaning /plugins dir
  
  Processing plugin redhat/java11/latest
  
  Installing plugin extension 1/2
  
  Downloading plugin from http://plugin-registry.openshift-workspaces.svc:8080/v3/resources/download.jboss.org/jbosstools/vscode/3rdparty/vscode-java-debug/vscode-java-debug-0.26.0.vsix
  
  Installing plugin extension 2/2
  
  Downloading plugin from http://plugin-registry.openshift-workspaces.svc:8080/v3/resources/download.jboss.org/jbosstools/static/jdt.ls/stable/java-0.69.0-2547.vsix
  
  Processing plugin redhat/dependency-analytics/latest
  
  Installing plugin extension 1/1
  
  Downloading plugin from http://plugin-registry.openshift-workspaces.svc:8080/v3/resources/github.com/fabric8-analytics/fabric8-analytics-vscode-extension/releases/download/0.1.0/fabric8-analytics-0.1.0.vsix
  
  Saving log of installed plugins
  
  All plugin artifacts have been successfully downloaded
  
  Pulling image "registry.redhat.io/codeready-workspaces/jwtproxy-rhel8@sha256:3f40bb8a2022545ac06a0b41cdb0239fdacfc34b37faffb21348a2041e96d0f2"
  
  Successfully pulled image "registry.redhat.io/codeready-workspaces/jwtproxy-rhel8@sha256:3f40bb8a2022545ac06a0b41cdb0239fdacfc34b37faffb21348a2041e96d0f2" in 1.606616821s
  
  Created container che-jwtproxywokz76t2
  
  Started container che-jwtproxywokz76t2
  
  Pulling image "docker-registry.upshift.redhat.com/kwills/eap-xp3-openjdk11-openshift-rhel8:xp3"
  

• After ~30 minutes, CRW switch view to progress tab, where some wheel is spinning
• Go back to log tab
• There are no logs
• After another ~30 minutes, this new log occurs:

  Failed to run the workspace: "Waiting for pod 'workspace9fbid1gnx7273d47.maven-545f8c9cf4-hw79f' was interrupted"