CRW 2.7.0.RC-02-26 without OS OAuth support failed to start the workspace

Error: Failed to start the workspace: "Failure executing: POST at: https://172.30.0.1/apis/project.openshift.io/v1/projectrequests. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. projectrequests.project.openshift.io is forbidden: User "system:serviceaccount:crw-crwctl-no-oauth:che" cannot create resource "projectrequests" in API group "project.openshift.io" at the cluster scope. The error may be caused by an expired token or changed password. Update Che server deployment with a new token or password."

2021-03-01 07:07:43,376[io-8080-exec-10]  [INFO ] [o.e.c.a.w.s.WorkspaceManager 694]    - Workspace 'admin/java-eap-maven-sowfv' with id 'workspace1j15jhxajlrudalq' created by user 'admin'
2021-03-01 07:07:50,856[nio-8080-exec-7]  [WARN ] [o.e.c.w.i.o.p.OpenShiftProject 220]  - Trying to get namespace 'admin-codeready', but failed because the lack of permissions.
2021-03-01 07:07:50,925[nio-8080-exec-7]  [ERROR] [o.e.c.w.i.o.p.OpenShiftProject 176]  - Unable to create new OpenShift project due to lack of permissions.HINT: When using workspace project name placeholders, os-oauth or service account with more lenient permissions (cluster-admin) must be used.
2021-03-01 07:07:50,928[nio-8080-exec-7]  [ERROR] [o.e.c.a.w.s.WorkspaceRuntimes 495]   - Failure executing: POST at: https://172.30.0.1/apis/project.openshift.io/v1/projectrequests. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. projectrequests.project.openshift.io is forbidden: User "system:serviceaccount:crw-crwctl-no-oauth:che" cannot create resource "projectrequests" in API group "project.openshift.io" at the cluster scope. The error may be caused by an expired token or changed password. Update Che server deployment with a new token or password.
org.eclipse.che.workspace.infrastructure.kubernetes.KubernetesInfrastructureException: Failure executing: POST at: https://172.30.0.1/apis/project.openshift.io/v1/projectrequests. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. projectrequests.project.openshift.io is forbidden: User "system:serviceaccount:crw-crwctl-no-oauth:che" cannot create resource "projectrequests" in API group "project.openshift.io" at the cluster scope. The error may be caused by an expired token or changed password. Update Che server deployment with a new token or password.
	at org.eclipse.che.workspace.infrastructure.openshift.project.OpenShiftProject.create(OpenShiftProject.java:180)
	at org.eclipse.che.workspace.infrastructure.openshift.project.OpenShiftProject.prepare(OpenShiftProject.java:117)
	at org.eclipse.che.workspace.infrastructure.openshift.project.OpenShiftProjectFactory.getOrCreate(OpenShiftProjectFactory.java:117)
	at org.eclipse.che.workspace.infrastructure.openshift.OpenShiftRuntimeContext.getRuntime(OpenShiftRuntimeContext.java:69)
	at org.eclipse.che.workspace.infrastructure.openshift.OpenShiftRuntimeContext.getRuntime(OpenShiftRuntimeContext.java:31)
	at org.eclipse.che.api.workspace.server.WorkspaceRuntimes.startAsync(WorkspaceRuntimes.java:467)
	at org.eclipse.che.api.workspace.server.WorkspaceManager.startAsync(WorkspaceManager.java:529)
	at org.eclipse.che.api.workspace.server.WorkspaceManager.startWorkspace(WorkspaceManager.java:383)
	at org.eclipse.che.multiuser.resource.api.workspace.LimitsCheckingWorkspaceManager.startWorkspace(LimitsCheckingWorkspaceManager.java:135)
	at org.eclipse.che.api.workspace.server.WorkspaceService.startById(WorkspaceService.java:413)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.everrest.core.impl.method.DefaultMethodInvoker.invokeMethod(DefaultMethodInvoker.java:141)
	at org.everrest.core.impl.method.DefaultMethodInvoker.invokeMethod(DefaultMethodInvoker.java:61)
	at org.everrest.core.impl.RequestDispatcher.doInvokeResource(RequestDispatcher.java:307)
	at org.everrest.core.impl.RequestDispatcher.invokeSubResourceMethod(RequestDispatcher.java:298)
	at org.everrest.core.impl.RequestDispatcher.dispatch(RequestDispatcher.java:234)
	at org.everrest.core.impl.RequestDispatcher.dispatch(RequestDispatcher.java:129)
	at org.everrest.core.impl.RequestHandlerImpl.handleRequest(RequestHandlerImpl.java:63)
	at org.everrest.core.impl.EverrestProcessor.process(EverrestProcessor.java:121)
	at org.everrest.core.servlet.EverrestServlet.service(EverrestServlet.java:62)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:733)
	at com.google.inject.servlet.ServletDefinition.doServiceImpl(ServletDefinition.java:290)
	at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:280)
	at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:184)
	at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:89)
	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:85)
	at org.eclipse.che.core.metrics.ApiResponseMetricFilter.doFilter(ApiResponseMetricFilter.java:46)
	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:82)
	at org.eclipse.che.commons.logback.filter.IdentityIdLoggerFilter.doFilter(IdentityIdLoggerFilter.java:49)
	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:82)
	at org.eclipse.che.multiuser.api.authentication.commons.filter.MultiUserEnvironmentInitializationFilter.doFilter(MultiUserEnvironmentInitializationFilter.java:142)
	at org.eclipse.che.multiuser.keycloak.server.KeycloakEnvironmentInitializationFilter.doFilter(KeycloakEnvironmentInitializationFilter.java:99)
	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:82)
	at org.eclipse.che.multiuser.machine.authentication.server.MachineLoginFilter.doFilter(MachineLoginFilter.java:76)
	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:82)
	at org.eclipse.che.commons.logback.filter.RequestIdLoggerFilter.doFilter(RequestIdLoggerFilter.java:50)
	at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:82)
	at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:121)
	at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:133)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:544)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
	at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:764)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:616)
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:831)
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1634)
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
	at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://172.30.0.1/apis/project.openshift.io/v1/projectrequests. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. projectrequests.project.openshift.io is forbidden: User "system:serviceaccount:crw-crwctl-no-oauth:che" cannot create resource "projectrequests" in API group "project.openshift.io" at the cluster scope.
	at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:568)
	at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:505)
	at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:471)
	at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:430)
	at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:251)
	at io.fabric8.openshift.client.dsl.internal.ProjectRequestsOperationImpl.create(ProjectRequestsOperationImpl.java:82)
	at io.fabric8.openshift.client.dsl.internal.ProjectRequestsOperationImpl.create(ProjectRequestsOperationImpl.java:95)
	at io.fabric8.openshift.client.dsl.internal.ProjectRequestsOperationImpl.lambda$createNew$0(ProjectRequestsOperationImpl.java:102)
	at io.fabric8.openshift.api.model.DoneableProjectRequest.done(DoneableProjectRequest.java:27)
	at org.eclipse.che.workspace.infrastructure.openshift.project.OpenShiftProject.create(OpenShiftProject.java:173)
	... 60 common frames omitted

 + /mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/crwctl/bin/crwctl server:deploy --che-operator-cr-patch-yaml=/mnt/hudson_workspace/workspace/CodereadyWorkspaces/e2e/basic/install-crw-using-crwctl/custom-resource-patch.yaml --catalog-source-name=osbs-catalog-source --catalog-source-namespace=openshift-marketplace --package-manifest-name=codeready-workspaces --olm-channel=latest --no-olm-suggested-namespace --listr-renderer=verbose -n crw-crwctl-no-oauth
 › Current Kubernetes context: 'default/api-ocp47-crw-qe-com:6443/admin'
 (node:9973) Warning: Setting the NODE_TLS_REJECT_UNAUTHORIZED environment variable to '0' makes TLS connections and HTTPS requests insecure by disabling certificate verification.
 › Installer type is set to: 'olm'
 [22:31:12] Verify Kubernetes API [started]
 [22:31:12] Verify Kubernetes API...OK [title changed]
 [22:31:12] Verify Kubernetes API...OK (it's OpenShift) [title changed]
 [22:31:12] Verify Kubernetes API...OK (it's OpenShift) [completed]
 [22:31:12]   Looking for an already existing CodeReady Workspaces instance [started]
 [22:31:12] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl-no-oauth" [started]
 [22:31:12] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl-no-oauth"...it is not [title changed]
 [22:31:12] Verify if CodeReady Workspaces is deployed into namespace "crw-crwctl-no-oauth"...it is not [completed]
 [22:31:12]   Looking for an already existing CodeReady Workspaces instance [completed]
 [22:31:12]   Openshift preflight checklist [started]
 [22:31:12] Verify if oc is installed [started]
 [22:31:12] Verify if oc is installed...done. [title changed]
 [22:31:12] Verify if oc is installed...done. [completed]
 [22:31:12] Verify if openshift is running [started]
 [22:31:12] Verify if openshift is running...done. [title changed]
 [22:31:12] Verify if openshift is running...done. [completed]
 [22:31:12] Check OpenShift version [started]
 [22:31:12] Check OpenShift version: 4.x [title changed]
 [22:31:12] Check OpenShift version: 4.x [completed]
 [22:31:12] Check Kubernetes version [started]
 [22:31:12] Check Kubernetes version: Unknown. [title changed]
 [22:31:12] Check Kubernetes version: Unknown. [completed]
 [22:31:12]   Openshift preflight checklist [completed]
 [22:31:12] Following CodeReady Workspaces logs [started]
 [22:31:12] Start following Operator logs [started]
 [22:31:12] Start following Operator logs...done [title changed]
 [22:31:12] Start following Operator logs...done [completed]
 [22:31:12] Start following CodeReady Workspaces server logs [started]
 [22:31:12] Start following CodeReady Workspaces server logs...done [title changed]
 [22:31:12] Start following CodeReady Workspaces server logs...done [completed]
 [22:31:12] Start following Postgres logs [started]
 [22:31:12] Start following Postgres logs...done [title changed]
 [22:31:12] Start following Postgres logs...done [completed]
 [22:31:12] Start following Keycloak logs [started]
 [22:31:12] Start following Keycloak logs...done [title changed]
 [22:31:12] Start following Keycloak logs...done [completed]
 [22:31:12] Start following Plugin registry logs [started]
 [22:31:12] Start following Plugin registry logs...done [title changed]
 [22:31:12] Start following Plugin registry logs...done [completed]
 [22:31:12] Start following Devfile registry logs [started]
 [22:31:12] Start following Devfile registry logs...done [title changed]
 [22:31:12] Start following Devfile registry logs...done [completed]
 [22:31:12] Start following namespace events [started]
 [22:31:12] Start following namespace events...done [title changed]
 [22:31:12] Start following namespace events...done [completed]
 [22:31:12] Following CodeReady Workspaces logs [completed]
 [22:31:12]   Running Olm installaion CodeReady Workspaces [started]
 [22:31:12] Check if OLM is pre-installed on the platform [started]
 [22:31:12] Check if OLM is pre-installed on the platform...done. [title changed]
 [22:31:12] Check if OLM is pre-installed on the platform...done. [completed]
 [22:31:12] Create Namespace (crw-crwctl-no-oauth) [started]
 [22:31:12] Create Namespace (crw-crwctl-no-oauth)...Done. [title changed]
 [22:31:12] Create Namespace (crw-crwctl-no-oauth)...Done. [completed]
 [22:31:12] Create operator group [started]
 [22:31:12] Create operator group...created new one. [title changed]
 [22:31:12] Create operator group...created new one. [completed]
 [22:31:12] Configure context information [started]
 [22:31:12] Configure context information...done. [title changed]
 [22:31:12] Configure context information...done. [completed]
 [22:31:12] Create operator subscription [started]
 [22:31:12] Create operator subscription...created new one. [title changed]
 [22:31:12] Create operator subscription...created new one. [completed]
 [22:31:12] Wait while subscription is ready [started]
 [22:31:14] Wait while subscription is ready...done. [title changed]
 [22:31:14] Wait while subscription is ready...done. [completed]
 [22:31:14] Wait while operator installed [started]
 [22:31:20] Wait while operator installed...done. [title changed]
 [22:31:20] Wait while operator installed...done. [completed]
 [22:31:20] Prepare CodeReady Workspaces cluster CR [started]
 [22:31:20] Prepare CodeReady Workspaces cluster CR...Done. [title changed]
 [22:31:20] Prepare CodeReady Workspaces cluster CR...Done. [completed]
 [22:31:20] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl-no-oauth [started]
 [22:31:20] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl-no-oauth...done. [title changed]
 [22:31:20] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace crw-crwctl-no-oauth...done. [completed]
 [22:31:20]   Running Olm installaion CodeReady Workspaces [completed]
 [22:31:20]   Post installation checklist [started]
 [22:31:20] PostgreSQL pod bootstrap [started]
 [22:31:20] Scheduling [started]
 [22:31:39] Scheduling...done [title changed]
 [22:31:39] Scheduling...done [completed]
 [22:31:39] Downloading images [started]
 [22:31:52] Downloading images...done [title changed]
 [22:31:52] Downloading images...done [completed]
 [22:31:52] Starting [started]
 [22:32:15] Starting...done [title changed]
 [22:32:15] Starting...done [completed]
 [22:32:15] PostgreSQL pod bootstrap [completed]
 [22:32:15] Keycloak pod bootstrap [started]
 [22:32:15] Scheduling [started]
 [22:32:16] Scheduling...done [title changed]
 [22:32:16] Scheduling...done [completed]
 [22:32:16] Downloading images [started]
 [22:32:18] Downloading images...done [title changed]
 [22:32:18] Downloading images...done [completed]
 [22:32:18] Starting [started]
 [22:32:54] Starting...done [title changed]
 [22:32:54] Starting...done [completed]
 [22:32:54] Keycloak pod bootstrap [completed]
 [22:32:54] Devfile registry pod bootstrap [started]
 [22:32:54] Scheduling [started]
 [22:33:42] Scheduling...done [title changed]
 [22:33:42] Scheduling...done [completed]
 [22:33:42] Downloading images [started]
 [22:33:46] Downloading images...done [title changed]
 [22:33:46] Downloading images...done [completed]
 [22:33:46] Starting [started]
 [22:33:57] Starting...done [title changed]
 [22:33:57] Starting...done [completed]
 [22:33:57] Devfile registry pod bootstrap [completed]
 [22:33:57] Plugin registry pod bootstrap [started]
 [22:33:57] Scheduling [started]
 [22:33:57] Scheduling...done [title changed]
 [22:33:57] Scheduling...done [completed]
 [22:33:57] Downloading images [started]
 [22:34:01] Downloading images...done [title changed]
 [22:34:01] Downloading images...done [completed]
 [22:34:01] Starting [started]
 [22:34:05] Starting...done [title changed]
 [22:34:05] Starting...done [completed]
 [22:34:05] Plugin registry pod bootstrap [completed]
 [22:34:05] CodeReady Workspaces pod bootstrap [started]
 [22:34:05] Scheduling [started]
 [22:34:06] Scheduling...done [title changed]
 [22:34:06] Scheduling...done [completed]
 [22:34:06] Downloading images [started]
 [22:34:09] Downloading images...done [title changed]
 [22:34:09] Downloading images...done [completed]
 [22:34:09] Starting [started]
 [22:34:47] Starting...done [title changed]
 [22:34:47] Starting...done [completed]
 [22:34:47] CodeReady Workspaces pod bootstrap [completed]
 [22:34:47] CodeReady Workspaces status check [started]
 [22:34:47] CodeReady Workspaces status check...done [title changed]
 [22:34:47] CodeReady Workspaces status check...done [completed]
 [22:34:47]   Post installation checklist [completed]
 [22:34:47] Retrieving Keycloak admin credentials [started]
 [22:34:47] Retrieving Keycloak admin credentials...done [title changed]
 [22:34:47] Retrieving Keycloak admin credentials...done [completed]
 [22:34:47] Retrieving Che self-signed CA certificate [started]
 [22:34:47] Retrieving Che self-signed CA certificate... done [title changed]
 [22:34:47] Retrieving Che self-signed CA certificate... done [completed]
 [22:34:47] Prepare post installation output [started]
 [22:34:47] Prepare post installation output...done [title changed]
 [22:34:47] Prepare post installation output...done [completed]
 [22:34:47] Show important messages [started]
 [22:34:47] CodeReady Workspaces 2.7.0 has been successfully deployed. [started]
 [22:34:47] CodeReady Workspaces 2.7.0 has been successfully deployed. [completed]
 [22:34:47] Documentation             : https://access.redhat.com/documentation/en-us/red_hat_codeready_workspaces/2.7/ [started]
 [22:34:47] Documentation             : https://access.redhat.com/documentation/en-us/red_hat_codeready_workspaces/2.7/ [completed]
 [22:34:47] Release Notes           : https://access.redhat.com/documentation/en-us/red_hat_codeready_workspaces/2.7/html/release_notes_and_known_issues/index [started]
 [22:34:47] Release Notes           : https://access.redhat.com/documentation/en-us/red_hat_codeready_workspaces/2.7/html/release_notes_and_known_issues/index [completed]
 [22:34:47] ------------------------------------------------------------------------------- [started]
 [22:34:47] ------------------------------------------------------------------------------- [completed]
 [22:34:47] Users Dashboard           : https://codeready-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com [started]
 [22:34:47] Users Dashboard           : https://codeready-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com [completed]
 [22:34:47] Admin user login          : "admin:admin". NOTE: must change after first login. [started]
 [22:34:47] Admin user login          : "admin:admin". NOTE: must change after first login. [completed]
 [22:34:47] ------------------------------------------------------------------------------- [started]
 [22:34:47] ------------------------------------------------------------------------------- [completed]
 [22:34:47] Plug-in Registry          : https://plugin-registry-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com/v3 [started]
 [22:34:47] Plug-in Registry          : https://plugin-registry-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com/v3 [completed]
 [22:34:47] Devfile Registry          : https://devfile-registry-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com [started]
 [22:34:47] Devfile Registry          : https://devfile-registry-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com [completed]
 [22:34:47] ------------------------------------------------------------------------------- [started]
 [22:34:47] ------------------------------------------------------------------------------- [completed]
 [22:34:47] Identity Provider URL     : https://keycloak-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com/auth [started]
 [22:34:47] Identity Provider URL     : https://keycloak-crw-crwctl-no-oauth.apps.ocp47.crw-qe.com/auth [completed]
 [22:34:47] Identity Provider login   : "admin:cMvr4r93jM3Y". [started]
 [22:34:47] Identity Provider login   : "admin:cMvr4r93jM3Y". [completed]
 [22:34:47] ------------------------------------------------------------------------------- [started]
 [22:34:47] ------------------------------------------------------------------------------- [completed]
 [22:34:47] �[33m[ACTION REQUIRED]�[39m Please add Che self-signed CA certificate into your browser: /tmp/cheCA.crt.
 Documentation how to add a CA certificate into a browser: https://www.eclipse.org/che/docs/che-7/end-user-guide/importing-certificates-to-browsers/ [started]
 [22:34:47] �[33m[ACTION REQUIRED]�[39m Please add Che self-signed CA certificate into your browser: /tmp/cheCA.crt.
 Documentation how to add a CA certificate into a browser: https://www.eclipse.org/che/docs/che-7/end-user-guide/importing-certificates-to-browsers/ [completed]
 [22:34:47] Show important messages [completed]
 Command server:deploy has completed successfully in 03:36.

spec:
  server:
    customCheProperties:
      CHE_LIMITS_USER_WORKSPACES_RUN_COUNT: '-1'
      CHE_LIMITS_WORKSPACE_IDLE_TIMEOUT: '900000'
      CHE_INFRA_KUBERNETES_WORKSPACE__UNRECOVERABLE__EVENTS: 'Failed Scheduling,Failed to pull image'
  auth:
    openShiftoAuth: false
    updateAdminPassword: false