WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 71 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". '/tmp/secret/kubeconfig' -> './kubeconfig' [INFO] Into a distinct namespace '-devspaces' will run a test workspace. By default will be used the 'admin' user-name You can specify an user-name of your OCP cluster as a parameter of this script, e.g.: 'execute-test-harness.sh ' namespace/openshift-devspaces created namespace/admin-devspaces created Now using project "admin-devspaces" on server "https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443". Error from server (NotFound): configmaps "ds-testsuite-kubeconfig" not found [INFO] Creating configmap 'ds-testsuite-kubeconfig' in namespace 'openshift-operators' configmap/ds-testsuite-kubeconfig created [INFO] Dev Spaces will use the latest production version [INFO] The version of Dev Spaces: devspacesoperator.v3.16.0 [INFO] Creating pod 'ds-testsuite-1726470267' in namespace 'openshift-operators' Warning: would violate PodSecurity "restricted:latest": allowPrivilegeEscalation != false (containers "test", "download" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "test", "download" must set securityContext.capabilities.drop=["ALL"]), runAsNonRoot != true (pod or containers "test", "download" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "test", "download" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") pod/ds-testsuite-1726470267 created Running Suite: Dev Spaces Operator Test Harness =============================================== Random Seed: 1726470283 Will run 13 of 13 specs time="2024-09-16 07:04:43" level=info msg="Installing Dev Spaces objects before running Test Harness..." TagName: 3.9.1-GA-dsc-assets Version Dev Spaces: 3.9.1 time="2024-09-16 07:04:43" level=info msg="Using CSV: devspacesoperator.v3.16.0" I0916 07:04:44.873547 1 request.go:668] Waited for 1.037331115s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/console.openshift.io/v1alpha1?timeout=32s time="2024-09-16 07:04:46" level=info msg="Test Harness will run outside of OSD. Start to create OLM Kubernetes Objects for Dev Spaces" time="2024-09-16 07:04:46" level=info msg="Dev Spaces Operator will be installed in namespace 'openshift-operators'" time="2024-09-16 07:04:46" level=info msg="Creating new subscription 'devspaces' in namespace 'openshift-operators'" time="2024-09-16 07:04:46" level=info msg="Waiting subscription 'devspaces' to be installed in namespace 'openshift-operators'" time="2024-09-16 07:05:11" level=info msg="Waiting for CSV to be installed in cluster" time="2024-09-16 07:05:32" level=info msg="Successfully install CSV completed in 21.009917402" time="2024-09-16 07:05:32" level=info msg="Apply 'devspaces' custom resource in namespace 'openshift-devspaces'" I0916 07:05:33.466286 1 request.go:668] Waited for 1.047622563s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/packages.operators.coreos.com/v1?timeout=32s time="2024-09-16 07:05:35" level=info msg="Successfully created 'devspaces' custom resource in namespace 'openshift-devspaces'" time="2024-09-16 07:05:35" level=info msg="Waiting for Dev Spaces to be deployed in cluster" I0916 07:05:43.504876 1 request.go:668] Waited for 1.596330336s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/node.k8s.io/v1?timeout=32s I0916 07:05:54.233473 1 request.go:668] Waited for 1.047014702s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/autoscaling.openshift.io/v1beta1?timeout=32s I0916 07:06:04.254949 1 request.go:668] Waited for 2.647476549s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/console.openshift.io/v1alpha1?timeout=32s I0916 07:06:14.294337 1 request.go:668] Waited for 1.447418296s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/org.eclipse.che/v2?timeout=32s I0916 07:06:25.127126 1 request.go:668] Waited for 1.045586004s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/quota.openshift.io/v1?timeout=32s I0916 07:06:35.153018 1 request.go:668] Waited for 2.647111047s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/imageregistry.operator.openshift.io/v1?timeout=32s I0916 07:06:45.182568 1 request.go:668] Waited for 1.448039319s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s I0916 07:06:56.014422 1 request.go:668] Waited for 1.047735312s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/build.openshift.io/v1?timeout=32s I0916 07:07:06.036445 1 request.go:668] Waited for 2.647985744s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/ipam.cluster.x-k8s.io/v1alpha1?timeout=32s I0916 07:07:16.063293 1 request.go:668] Waited for 1.447236145s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/ipam.cluster.x-k8s.io/v1alpha1?timeout=32s I0916 07:07:26.893260 1 request.go:668] Waited for 1.048052935s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/performance.openshift.io/v2?timeout=32s I0916 07:07:36.913792 1 request.go:668] Waited for 2.645530041s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/ipam.cluster.x-k8s.io/v1beta1?timeout=32s I0916 07:07:46.925270 1 request.go:668] Waited for 1.356896452s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/monitoring.coreos.com/v1alpha1?timeout=32s I0916 07:07:57.802549 1 request.go:668] Waited for 1.048328814s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/config.openshift.io/v1?timeout=32s I0916 07:08:07.822033 1 request.go:668] Waited for 2.647920318s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/operator.openshift.io/v1alpha1?timeout=32s I0916 07:08:17.853374 1 request.go:668] Waited for 1.447744985s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/monitoring.coreos.com/v1alpha1?timeout=32s I0916 07:08:28.680650 1 request.go:668] Waited for 1.047994274s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/ipam.cluster.x-k8s.io/v1alpha1?timeout=32s I0916 07:08:38.703798 1 request.go:668] Waited for 2.647271353s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/whereabouts.cni.cncf.io/v1alpha1?timeout=32s time="2024-09-16 07:08:44" level=info msg="Successfully deployed Dev Spaces in 189.185106739" •time="2024-09-16 07:08:44" level=info msg="Getting information and metrics from Dashboard pod" •time="2024-09-16 07:08:44" level=info msg="Getting information and metrics from Devfile Registry pod" •time="2024-09-16 07:08:44" level=info msg="Getting information and metrics from Plugin Registry pod" •time="2024-09-16 07:08:44" level=info msg="Getting information and metrics from Dev Spaces server pod" •time="2024-09-16 07:08:44" level=info msg="Checking if Dev Spaces API server is up" • ------------------------------ S [SKIPPING] [0.001 seconds] [Dev Spaces Test Harness] [Secrets] /github.com/redhat-developer/devspaces-interop-tests/tests/codeready.go:46 Secret `self-signed-certificate` should exist [It] /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:21 This test is skipped. /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:22 ------------------------------ time="2024-09-16 07:08:47" level=info msg="Checking if all services for Dev Spaces" • Failure [0.004 seconds] [Services] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:15 Check if devspaces services exist in cluster [It] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:21 Expected : not to be empty /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 ------------------------------ time="2024-09-16 07:08:47" level=info msg="Checking `che` config map integrity" •I0916 07:08:48.707595 1 request.go:668] Waited for 1.345999829s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-b92csxh7-5a70c.cspilp.interop.ccitredhat.com:6443/apis/console.openshift.io/v1alpha1?timeout=32s • ------------------------------ • Failure [0.001 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Obtain and patch Devfile from DevFile Registry [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:39 Unexpected error: <*url.Error | 0xc000624030>: { Op: "Get", URL: "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml", Err: <*errors.errorString | 0xc0000f98a0>{ s: "unsupported protocol scheme \"\"", }, } Get "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml": unsupported protocol scheme "" occurred /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 ------------------------------ S [SKIPPING] [0.000 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Create and start Workspace [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:56 Run a workspace start in Dev Spaces requires a new implementation.The test is temporary skipped, while investigating. /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:57 ------------------------------ time="2024-09-16 07:08:50" level=info msg="Checking if CRD for Dev Spaces exist in cluster" •time="2024-09-16 07:08:50" level=info msg="Clean up all created objects by Test Harness." JUnit report was created: /test-run-results/junit-dev-spaces.xml Summarizing 2 Failures: [Fail] [Services] [It] Check if devspaces services exist in cluster  /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 [Fail] [WORKSPACES] Create workspace from devfile registry [It] Obtain and patch Devfile from DevFile Registry  /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 Ran 11 of 13 Specs in 249.305 seconds FAIL! -- 9 Passed | 2 Failed | 0 Pending | 2 Skipped You're using deprecated Ginkgo functionality: ============================================= Ginkgo 2.0 is under active development and will introduce (a small number of) breaking changes. To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md To comment, chime in at https://github.com/onsi/ginkgo/issues/711 You are using a custom reporter. Support for custom reporters will likely be removed in V2. Most users were using them to generate junit or teamcity reports and this functionality will be merged into the core reporter. In addition, Ginkgo 2.0 will support emitting a JSON-formatted report that users can then manipulate to generate custom reports. If this change will be impactful to you please leave a comment on https://github.com/onsi/ginkgo/issues/711 Learn more at: https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md#removed-custom-reporters To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=1.16.4 --- FAIL: TestHarnessCodeReadyWorkspaces (249.31s) FAIL receiving incremental file list test-run-results/ test-run-results/addon-metadata.json test-run-results/debug_tests.json test-run-results/devspaces_devspaces-55f8ff5dbb-xqxmr.log test-run-results/devspaces_devspaces-dashboard-c89996bdf-zjlf4.log test-run-results/devspaces_plugin-registry-fb6487c97-w454d.log test-run-results/junit-dev-spaces.xml sent 142 bytes received 97,796 bytes 195,876.00 bytes/sec total size is 97,214 speedup is 0.99