WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 70 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". '/tmp/secret/kubeconfig' -> './kubeconfig' [INFO] Into a distinct namespace '-devspaces' will run a test workspace. By default will be used the 'admin' user-name You can specify an user-name of your OCP cluster as a parameter of this script, e.g.: 'execute-test-harness.sh ' namespace/openshift-devspaces created namespace/admin-devspaces created Now using project "admin-devspaces" on server "https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443". Error from server (NotFound): configmaps "ds-testsuite-kubeconfig" not found [INFO] Creating configmap 'ds-testsuite-kubeconfig' in namespace 'openshift-operators' configmap/ds-testsuite-kubeconfig created [INFO] Dev Spaces will use the latest production version [INFO] The version of Dev Spaces: devspacesoperator.v3.16.0 [INFO] Creating pod 'ds-testsuite-1726487054' in namespace 'openshift-operators' Warning: would violate PodSecurity "restricted:latest": allowPrivilegeEscalation != false (containers "test", "download" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "test", "download" must set securityContext.capabilities.drop=["ALL"]), runAsNonRoot != true (pod or containers "test", "download" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "test", "download" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") pod/ds-testsuite-1726487054 created Running Suite: Dev Spaces Operator Test Harness =============================================== Random Seed: 1726487077 Will run 13 of 13 specs time="2024-09-16 11:44:37" level=info msg="Installing Dev Spaces objects before running Test Harness..." TagName: 3.9.1-GA-dsc-assets Version Dev Spaces: 3.9.1 time="2024-09-16 11:44:37" level=info msg="Using CSV: devspacesoperator.v3.16.0" I0916 11:44:38.318026 1 request.go:668] Waited for 1.030077111s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/route.openshift.io/v1?timeout=32s time="2024-09-16 11:44:39" level=info msg="Test Harness will run outside of OSD. Start to create OLM Kubernetes Objects for Dev Spaces" time="2024-09-16 11:44:39" level=info msg="Dev Spaces Operator will be installed in namespace 'openshift-operators'" time="2024-09-16 11:44:39" level=info msg="Creating new subscription 'devspaces' in namespace 'openshift-operators'" time="2024-09-16 11:44:39" level=info msg="Waiting subscription 'devspaces' to be installed in namespace 'openshift-operators'" time="2024-09-16 11:45:44" level=info msg="Waiting for CSV to be installed in cluster" time="2024-09-16 11:46:07" level=info msg="Successfully install CSV completed in 23.024477537" time="2024-09-16 11:46:07" level=info msg="Apply 'devspaces' custom resource in namespace 'openshift-devspaces'" I0916 11:46:09.023554 1 request.go:668] Waited for 1.044169118s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/cloudcredential.openshift.io/v1?timeout=32s time="2024-09-16 11:46:10" level=info msg="Successfully created 'devspaces' custom resource in namespace 'openshift-devspaces'" time="2024-09-16 11:46:10" level=info msg="Waiting for Dev Spaces to be deployed in cluster" I0916 11:46:19.056171 1 request.go:668] Waited for 1.737592663s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha5?timeout=32s I0916 11:46:29.406666 1 request.go:668] Waited for 1.04098888s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/operators.coreos.com/v1?timeout=32s I0916 11:46:40.345722 1 request.go:668] Waited for 1.028512656s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1?timeout=32s I0916 11:46:51.225415 1 request.go:668] Waited for 1.039708634s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/autoscaling.openshift.io/v1?timeout=32s I0916 11:47:02.112950 1 request.go:668] Waited for 1.043640827s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/build.openshift.io/v1?timeout=32s I0916 11:47:13.002489 1 request.go:668] Waited for 1.043432541s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/console.openshift.io/v1alpha1?timeout=32s I0916 11:47:23.878685 1 request.go:668] Waited for 1.038488886s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/performance.openshift.io/v1?timeout=32s I0916 11:47:34.774506 1 request.go:668] Waited for 1.042779039s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/ingress.operator.openshift.io/v1?timeout=32s I0916 11:47:45.684146 1 request.go:668] Waited for 1.042863055s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha5?timeout=32s I0916 11:47:56.572662 1 request.go:668] Waited for 1.034630632s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/performance.openshift.io/v1alpha1?timeout=32s I0916 11:48:07.442641 1 request.go:668] Waited for 1.043411762s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/ipam.cluster.x-k8s.io/v1beta1?timeout=32s I0916 11:48:18.295558 1 request.go:668] Waited for 1.043439074s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1?timeout=32s I0916 11:48:29.159527 1 request.go:668] Waited for 1.043267339s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/security.internal.openshift.io/v1?timeout=32s I0916 11:48:40.014538 1 request.go:668] Waited for 1.037288637s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1?timeout=32s I0916 11:48:50.883624 1 request.go:668] Waited for 1.040685679s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/k8s.ovn.org/v1?timeout=32s I0916 11:49:01.749102 1 request.go:668] Waited for 1.044176802s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/operators.coreos.com/v1alpha1?timeout=32s I0916 11:49:12.613371 1 request.go:668] Waited for 1.042109912s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1?timeout=32s I0916 11:49:23.483818 1 request.go:668] Waited for 1.043544066s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/node.k8s.io/v1?timeout=32s I0916 11:49:34.348458 1 request.go:668] Waited for 1.043768392s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/tuned.openshift.io/v1?timeout=32s I0916 11:49:45.217149 1 request.go:668] Waited for 1.04291582s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/network.operator.openshift.io/v1?timeout=32s I0916 11:49:56.081321 1 request.go:668] Waited for 1.040000008s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1beta1?timeout=32s I0916 11:50:06.945516 1 request.go:668] Waited for 1.044181321s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/samples.operator.openshift.io/v1?timeout=32s I0916 11:50:17.833141 1 request.go:668] Waited for 1.039375463s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1?timeout=32s I0916 11:50:28.724706 1 request.go:668] Waited for 1.035642822s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1?timeout=32s I0916 11:50:39.589407 1 request.go:668] Waited for 1.043144094s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/flowcontrol.apiserver.k8s.io/v1beta3?timeout=32s I0916 11:50:50.450276 1 request.go:668] Waited for 1.044031461s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/rbac.authorization.k8s.io/v1?timeout=32s I0916 11:51:01.320807 1 request.go:668] Waited for 1.044268939s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/autoscaling.openshift.io/v1?timeout=32s I0916 11:51:12.202844 1 request.go:668] Waited for 1.036753402s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machine.openshift.io/v1?timeout=32s I0916 11:51:23.163556 1 request.go:668] Waited for 1.037164076s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/controlplane.operator.openshift.io/v1alpha1?timeout=32s I0916 11:51:34.074375 1 request.go:668] Waited for 1.024340997s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/apiregistration.k8s.io/v1?timeout=32s time="2024-09-16 11:51:41" level=info msg="Successfully deployed Dev Spaces in 330.345768655" time="2024-09-16 11:51:41" level=info msg="Checking if CRD for Dev Spaces exist in cluster" •time="2024-09-16 11:51:41" level=info msg="Checking if all services for Dev Spaces" ------------------------------ • Failure [0.009 seconds] [Services] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:15 Check if devspaces services exist in cluster [It] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:21 Expected : not to be empty /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 ------------------------------ •time="2024-09-16 11:51:41" level=info msg="Getting information and metrics from Dashboard pod" •time="2024-09-16 11:51:41" level=info msg="Getting information and metrics from Devfile Registry pod" •time="2024-09-16 11:51:41" level=info msg="Getting information and metrics from Plugin Registry pod" •time="2024-09-16 11:51:41" level=info msg="Getting information and metrics from Dev Spaces server pod" •time="2024-09-16 11:51:41" level=info msg="Checking if Dev Spaces API server is up" I0916 11:51:44.078302 1 request.go:668] Waited for 2.638724533s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-wc5rw45b-530c2.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/build.openshift.io/v1?timeout=32s • ------------------------------ S [SKIPPING] [0.000 seconds] [Dev Spaces Test Harness] [Secrets] /github.com/redhat-developer/devspaces-interop-tests/tests/codeready.go:46 Secret `self-signed-certificate` should exist [It] /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:21 This test is skipped. /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:22 ------------------------------ time="2024-09-16 11:51:44" level=info msg="Checking `che` config map integrity" •• ------------------------------ • Failure [0.001 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Obtain and patch Devfile from DevFile Registry [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:39 Unexpected error: <*url.Error | 0xc0005d8b70>: { Op: "Get", URL: "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml", Err: <*errors.errorString | 0xc000543990>{ s: "unsupported protocol scheme \"\"", }, } Get "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml": unsupported protocol scheme "" occurred /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 ------------------------------ S [SKIPPING] [0.000 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Create and start Workspace [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:56 Run a workspace start in Dev Spaces requires a new implementation.The test is temporary skipped, while investigating. /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:57 ------------------------------ time="2024-09-16 11:51:46" level=info msg="Clean up all created objects by Test Harness." JUnit report was created: /test-run-results/junit-dev-spaces.xml Summarizing 2 Failures: [Fail] [Services] [It] Check if devspaces services exist in cluster  /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 [Fail] [WORKSPACES] Create workspace from devfile registry [It] Obtain and patch Devfile from DevFile Registry  /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 Ran 11 of 13 Specs in 432.452 seconds FAIL! -- 9 Passed | 2 Failed | 0 Pending | 2 Skipped You're using deprecated Ginkgo functionality: ============================================= Ginkgo 2.0 is under active development and will introduce (a small number of) breaking changes. To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md To comment, chime in at https://github.com/onsi/ginkgo/issues/711 You are using a custom reporter. Support for custom reporters will likely be removed in V2. Most users were using them to generate junit or teamcity reports and this functionality will be merged into the core reporter. In addition, Ginkgo 2.0 will support emitting a JSON-formatted report that users can then manipulate to generate custom reports. If this change will be impactful to you please leave a comment on https://github.com/onsi/ginkgo/issues/711 Learn more at: https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md#removed-custom-reporters To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=1.16.4 --- FAIL: TestHarnessCodeReadyWorkspaces (432.46s) FAIL receiving incremental file list test-run-results/ test-run-results/addon-metadata.json test-run-results/debug_tests.json test-run-results/devspaces_devspaces-55dc4488fd-jjgpg.log test-run-results/devspaces_devspaces-787cbb4c95-c26mg.log test-run-results/devspaces_devspaces-dashboard-6464bc4498-mmzsc.log test-run-results/devspaces_plugin-registry-856dc8f7c6-w6xc8.log test-run-results/junit-dev-spaces.xml sent 161 bytes received 175,524 bytes 117,123.33 bytes/sec total size is 174,845 speedup is 1.00