WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 79 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". '/tmp/secret/kubeconfig' -> './kubeconfig' [INFO] Into a distinct namespace '-devspaces' will run a test workspace. By default will be used the 'admin' user-name You can specify an user-name of your OCP cluster as a parameter of this script, e.g.: 'execute-test-harness.sh ' namespace/openshift-devspaces created namespace/admin-devspaces created Now using project "admin-devspaces" on server "https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443". Error from server (NotFound): configmaps "ds-testsuite-kubeconfig" not found [INFO] Creating configmap 'ds-testsuite-kubeconfig' in namespace 'openshift-operators' configmap/ds-testsuite-kubeconfig created [INFO] Dev Spaces will use the latest production version [INFO] The version of Dev Spaces: devspacesoperator.v3.16.0 [INFO] Creating pod 'ds-testsuite-1726729232' in namespace 'openshift-operators' Warning: would violate PodSecurity "restricted:latest": allowPrivilegeEscalation != false (containers "test", "download" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "test", "download" must set securityContext.capabilities.drop=["ALL"]), runAsNonRoot != true (pod or containers "test", "download" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "test", "download" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") pod/ds-testsuite-1726729232 created Running Suite: Dev Spaces Operator Test Harness =============================================== Random Seed: 1726729247 Will run 13 of 13 specs time="2024-09-19 07:00:47" level=info msg="Installing Dev Spaces objects before running Test Harness..." TagName: 3.9.1-GA-dsc-assets Version Dev Spaces: 3.9.1 time="2024-09-19 07:00:48" level=info msg="Using CSV: devspacesoperator.v3.16.0" I0919 07:00:49.173719 1 request.go:668] Waited for 1.022273818s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/operators.coreos.com/v2?timeout=32s time="2024-09-19 07:00:50" level=info msg="Test Harness will run outside of OSD. Start to create OLM Kubernetes Objects for Dev Spaces" time="2024-09-19 07:00:50" level=info msg="Dev Spaces Operator will be installed in namespace 'openshift-operators'" time="2024-09-19 07:00:50" level=info msg="Creating new subscription 'devspaces' in namespace 'openshift-operators'" time="2024-09-19 07:00:50" level=info msg="Waiting subscription 'devspaces' to be installed in namespace 'openshift-operators'" time="2024-09-19 07:01:45" level=info msg="Waiting for CSV to be installed in cluster" time="2024-09-19 07:02:17" level=info msg="Successfully install CSV completed in 32.021064586" time="2024-09-19 07:02:17" level=info msg="Apply 'devspaces' custom resource in namespace 'openshift-devspaces'" I0919 07:02:18.242943 1 request.go:668] Waited for 1.038241548s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/networking.k8s.io/v1?timeout=32s time="2024-09-19 07:02:19" level=info msg="Successfully created 'devspaces' custom resource in namespace 'openshift-devspaces'" time="2024-09-19 07:02:19" level=info msg="Waiting for Dev Spaces to be deployed in cluster" I0919 07:02:28.473229 1 request.go:668] Waited for 1.04266268s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/security.openshift.io/v1?timeout=32s I0919 07:02:38.478592 1 request.go:668] Waited for 1.99321561s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/security.openshift.io/v1?timeout=32s I0919 07:02:48.854315 1 request.go:668] Waited for 1.043203394s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/k8s.ovn.org/v1?timeout=32s I0919 07:02:58.859963 1 request.go:668] Waited for 1.992664161s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha1?timeout=32s I0919 07:03:09.231268 1 request.go:668] Waited for 1.04309621s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/build.openshift.io/v1?timeout=32s I0919 07:03:19.237145 1 request.go:668] Waited for 1.993361819s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/user.openshift.io/v1?timeout=32s I0919 07:03:29.610487 1 request.go:668] Waited for 1.042016781s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/operators.coreos.com/v1alpha2?timeout=32s I0919 07:03:39.615833 1 request.go:668] Waited for 1.992696673s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/cloudcredential.openshift.io/v1?timeout=32s I0919 07:03:49.995359 1 request.go:668] Waited for 1.042819337s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/k8s.ovn.org/v1?timeout=32s I0919 07:04:00.005425 1 request.go:668] Waited for 1.992257146s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/discovery.k8s.io/v1?timeout=32s I0919 07:04:10.391704 1 request.go:668] Waited for 1.036272907s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha1?timeout=32s I0919 07:04:20.393275 1 request.go:668] Waited for 1.991172749s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/operator.openshift.io/v1?timeout=32s I0919 07:04:30.762461 1 request.go:668] Waited for 1.042673416s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/flowcontrol.apiserver.k8s.io/v1beta2?timeout=32s I0919 07:04:40.770146 1 request.go:668] Waited for 1.991770929s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/cloudcredential.openshift.io/v1?timeout=32s I0919 07:04:51.151887 1 request.go:668] Waited for 1.039936142s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/operators.coreos.com/v1?timeout=32s I0919 07:05:01.153697 1 request.go:668] Waited for 1.992400003s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/operator.openshift.io/v1?timeout=32s I0919 07:05:11.519639 1 request.go:668] Waited for 1.043380817s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/operator.openshift.io/v1?timeout=32s I0919 07:05:21.521093 1 request.go:668] Waited for 1.992741079s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/controller.devfile.io/v1alpha1?timeout=32s I0919 07:05:31.893192 1 request.go:668] Waited for 1.042609323s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/rbac.authorization.k8s.io/v1?timeout=32s I0919 07:05:41.894608 1 request.go:668] Waited for 1.991780575s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/package-operator.run/v1alpha1?timeout=32s I0919 07:05:52.260035 1 request.go:668] Waited for 1.042772246s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/operator.openshift.io/v1?timeout=32s I0919 07:06:02.261792 1 request.go:668] Waited for 1.993486543s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/org.eclipse.che/v2?timeout=32s I0919 07:06:12.631105 1 request.go:668] Waited for 1.042920478s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/cloud.network.openshift.io/v1?timeout=32s I0919 07:06:22.641966 1 request.go:668] Waited for 1.993149136s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/monitoring.coreos.com/v1?timeout=32s I0919 07:06:33.004964 1 request.go:668] Waited for 1.043002266s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha2?timeout=32s I0919 07:06:43.006262 1 request.go:668] Waited for 1.993517792s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/work.open-cluster-management.io/v1?timeout=32s I0919 07:06:53.389257 1 request.go:668] Waited for 1.043528506s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha2?timeout=32s I0919 07:07:03.395872 1 request.go:668] Waited for 1.99158233s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/cloud.network.openshift.io/v1?timeout=32s I0919 07:07:13.767444 1 request.go:668] Waited for 1.042646743s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/controller.devfile.io/v1alpha1?timeout=32s I0919 07:07:23.776321 1 request.go:668] Waited for 1.992648421s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/config.openshift.io/v1?timeout=32s I0919 07:07:34.147924 1 request.go:668] Waited for 1.042844426s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/ingress.operator.openshift.io/v1?timeout=32s I0919 07:07:44.157556 1 request.go:668] Waited for 1.992678221s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/snapshot.storage.k8s.io/v1?timeout=32s I0919 07:07:54.532431 1 request.go:668] Waited for 1.042720488s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/cloud.network.openshift.io/v1?timeout=32s time="2024-09-19 07:08:02" level=info msg="Successfully deployed Dev Spaces in 342.908558341" •time="2024-09-19 07:08:02" level=info msg="Getting information and metrics from Dashboard pod" •time="2024-09-19 07:08:02" level=info msg="Getting information and metrics from Devfile Registry pod" •time="2024-09-19 07:08:02" level=info msg="Getting information and metrics from Plugin Registry pod" •time="2024-09-19 07:08:02" level=info msg="Getting information and metrics from Dev Spaces server pod" •time="2024-09-19 07:08:02" level=info msg="Checking if Dev Spaces API server is up" I0919 07:08:04.557640 1 request.go:668] Waited for 1.892634233s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-e6g7.jbz8.s3.devshift.org:443/apis/user.openshift.io/v1?timeout=32s •time="2024-09-19 07:08:04" level=info msg="Checking if all services for Dev Spaces" ------------------------------ • Failure [0.007 seconds] [Services] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:15 Check if devspaces services exist in cluster [It] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:21 Expected : not to be empty /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 ------------------------------ time="2024-09-19 07:08:04" level=info msg="Checking if CRD for Dev Spaces exist in cluster" •time="2024-09-19 07:08:04" level=info msg="Checking `che` config map integrity" • ------------------------------ S [SKIPPING] [0.000 seconds] [Dev Spaces Test Harness] [Secrets] /github.com/redhat-developer/devspaces-interop-tests/tests/codeready.go:46 Secret `self-signed-certificate` should exist [It] /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:21 This test is skipped. /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:22 ------------------------------ • ------------------------------ • Failure [0.000 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Obtain and patch Devfile from DevFile Registry [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:39 Unexpected error: <*url.Error | 0xc0005a2450>: { Op: "Get", URL: "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml", Err: <*errors.errorString | 0xc0006f4260>{ s: "unsupported protocol scheme \"\"", }, } Get "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml": unsupported protocol scheme "" occurred /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 ------------------------------ S [SKIPPING] [0.000 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Create and start Workspace [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:56 Run a workspace start in Dev Spaces requires a new implementation.The test is temporary skipped, while investigating. /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:57 ------------------------------ time="2024-09-19 07:08:07" level=info msg="Clean up all created objects by Test Harness." JUnit report was created: /test-run-results/junit-dev-spaces.xml Summarizing 2 Failures: [Fail] [Services] [It] Check if devspaces services exist in cluster  /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 [Fail] [WORKSPACES] Create workspace from devfile registry [It] Obtain and patch Devfile from DevFile Registry  /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 Ran 11 of 13 Specs in 441.537 seconds FAIL! -- 9 Passed | 2 Failed | 0 Pending | 2 Skipped You're using deprecated Ginkgo functionality: ============================================= Ginkgo 2.0 is under active development and will introduce (a small number of) breaking changes. To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md To comment, chime in at https://github.com/onsi/ginkgo/issues/711 You are using a custom reporter. Support for custom reporters will likely be removed in V2. Most users were using them to generate junit or teamcity reports and this functionality will be merged into the core reporter. In addition, Ginkgo 2.0 will support emitting a JSON-formatted report that users can then manipulate to generate custom reports. If this change will be impactful to you please leave a comment on https://github.com/onsi/ginkgo/issues/711 Learn more at: https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md#removed-custom-reporters To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=1.16.4 --- FAIL: TestHarnessCodeReadyWorkspaces (441.54s) FAIL receiving incremental file list test-run-results/ test-run-results/addon-metadata.json test-run-results/debug_tests.json test-run-results/devspaces_devspaces-5684859d4b-kzpd6.log test-run-results/devspaces_devspaces-dashboard-868d99cfc4-jhs7r.log test-run-results/devspaces_plugin-registry-796b5dbbd8-fnzxv.log test-run-results/junit-dev-spaces.xml sent 142 bytes received 97,543 bytes 39,074.00 bytes/sec total size is 96,956 speedup is 0.99