WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 70 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". '/tmp/secret/kubeconfig' -> './kubeconfig' [INFO] Into a distinct namespace '-devspaces' will run a test workspace. By default will be used the 'admin' user-name You can specify an user-name of your OCP cluster as a parameter of this script, e.g.: 'execute-test-harness.sh ' namespace/openshift-devspaces created namespace/admin-devspaces created Now using project "admin-devspaces" on server "https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443". Error from server (NotFound): configmaps "ds-testsuite-kubeconfig" not found [INFO] Creating configmap 'ds-testsuite-kubeconfig' in namespace 'openshift-operators' configmap/ds-testsuite-kubeconfig created [INFO] Dev Spaces will use the latest production version [INFO] The version of Dev Spaces: devspacesoperator.v3.16.0 [INFO] Creating pod 'ds-testsuite-1726493109' in namespace 'openshift-operators' Warning: would violate PodSecurity "restricted:latest": allowPrivilegeEscalation != false (containers "test", "download" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "test", "download" must set securityContext.capabilities.drop=["ALL"]), runAsNonRoot != true (pod or containers "test", "download" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "test", "download" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") pod/ds-testsuite-1726493109 created Running Suite: Dev Spaces Operator Test Harness =============================================== Random Seed: 1726493132 Will run 13 of 13 specs time="2024-09-16 13:25:32" level=info msg="Installing Dev Spaces objects before running Test Harness..." TagName: 3.9.1-GA-dsc-assets Version Dev Spaces: 3.9.1 time="2024-09-16 13:25:32" level=info msg="Using CSV: devspacesoperator.v3.16.0" I0916 13:25:33.217306 1 request.go:668] Waited for 1.021518976s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/rbac.authorization.k8s.io/v1?timeout=32s time="2024-09-16 13:25:34" level=info msg="Test Harness will run outside of OSD. Start to create OLM Kubernetes Objects for Dev Spaces" time="2024-09-16 13:25:34" level=info msg="Dev Spaces Operator will be installed in namespace 'openshift-operators'" time="2024-09-16 13:25:34" level=info msg="Creating new subscription 'devspaces' in namespace 'openshift-operators'" time="2024-09-16 13:25:34" level=info msg="Waiting subscription 'devspaces' to be installed in namespace 'openshift-operators'" time="2024-09-16 13:26:44" level=info msg="Waiting for CSV to be installed in cluster" time="2024-09-16 13:27:04" level=info msg="Successfully install CSV completed in 20.049929347" time="2024-09-16 13:27:04" level=info msg="Apply 'devspaces' custom resource in namespace 'openshift-devspaces'" I0916 13:27:05.699465 1 request.go:668] Waited for 1.039634168s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/controller.devfile.io/v1alpha1?timeout=32s time="2024-09-16 13:27:07" level=info msg="Successfully created 'devspaces' custom resource in namespace 'openshift-devspaces'" time="2024-09-16 13:27:07" level=info msg="Waiting for Dev Spaces to be deployed in cluster" I0916 13:27:15.735684 1 request.go:668] Waited for 2.135018423s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/whereabouts.cni.cncf.io/v1alpha1?timeout=32s I0916 13:27:25.748208 1 request.go:668] Waited for 1.643132863s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/performance.openshift.io/v1alpha1?timeout=32s I0916 13:27:35.775619 1 request.go:668] Waited for 1.191485649s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/autoscaling.openshift.io/v1?timeout=32s I0916 13:27:46.115158 1 request.go:668] Waited for 1.042709744s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/build.openshift.io/v1?timeout=32s I0916 13:27:56.616626 1 request.go:668] Waited for 1.041423871s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/k8s.cni.cncf.io/v1?timeout=32s I0916 13:28:07.095771 1 request.go:668] Waited for 1.041693072s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/admissionregistration.k8s.io/v1?timeout=32s I0916 13:28:17.568598 1 request.go:668] Waited for 1.026775719s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/operators.coreos.com/v1alpha1?timeout=32s I0916 13:28:28.047804 1 request.go:668] Waited for 1.041994853s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/authorization.k8s.io/v1?timeout=32s I0916 13:28:38.519567 1 request.go:668] Waited for 1.047411049s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/quota.openshift.io/v1?timeout=32s I0916 13:28:48.993319 1 request.go:668] Waited for 1.042885275s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/monitoring.coreos.com/v1alpha1?timeout=32s I0916 13:28:59.454960 1 request.go:668] Waited for 1.028787862s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/console.openshift.io/v1alpha1?timeout=32s I0916 13:29:09.915332 1 request.go:668] Waited for 1.043460964s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/packages.operators.coreos.com/v1?timeout=32s I0916 13:29:20.403720 1 request.go:668] Waited for 1.043269816s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha5?timeout=32s I0916 13:29:30.869791 1 request.go:668] Waited for 1.043459751s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/operators.coreos.com/v1?timeout=32s I0916 13:29:41.399837 1 request.go:668] Waited for 1.042554232s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/quota.openshift.io/v1?timeout=32s I0916 13:29:51.426551 1 request.go:668] Waited for 1.543108125s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/security.openshift.io/v1?timeout=32s I0916 13:30:01.621032 1 request.go:668] Waited for 1.040402437s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/authorization.openshift.io/v1?timeout=32s I0916 13:30:21.635595 1 request.go:668] Waited for 1.04120383s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/security.internal.openshift.io/v1?timeout=32s I0916 13:30:32.113661 1 request.go:668] Waited for 1.04052744s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/authorization.openshift.io/v1?timeout=32s I0916 13:30:42.585342 1 request.go:668] Waited for 1.029848807s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/autoscaling.openshift.io/v1?timeout=32s I0916 13:30:53.057959 1 request.go:668] Waited for 1.041311305s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/workspace.devfile.io/v1alpha2?timeout=32s I0916 13:31:03.542610 1 request.go:668] Waited for 1.024388143s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/k8s.ovn.org/v1?timeout=32s I0916 13:31:14.008270 1 request.go:668] Waited for 1.040341937s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/cloudcredential.openshift.io/v1?timeout=32s I0916 13:31:24.466166 1 request.go:668] Waited for 1.042721929s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/apps.openshift.io/v1?timeout=32s I0916 13:31:34.931924 1 request.go:668] Waited for 1.043744009s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/operators.coreos.com/v1alpha2?timeout=32s I0916 13:31:45.393741 1 request.go:668] Waited for 1.04167045s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/console.openshift.io/v1alpha1?timeout=32s I0916 13:31:55.861202 1 request.go:668] Waited for 1.042778081s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/security.openshift.io/v1?timeout=32s I0916 13:32:06.328806 1 request.go:668] Waited for 1.042516074s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/machineconfiguration.openshift.io/v1?timeout=32s I0916 13:32:16.792853 1 request.go:668] Waited for 1.039921822s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/console.openshift.io/v1?timeout=32s I0916 13:32:27.266054 1 request.go:668] Waited for 1.043745829s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/template.openshift.io/v1?timeout=32s I0916 13:32:37.731956 1 request.go:668] Waited for 1.043587886s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:6443/apis/migration.k8s.io/v1alpha1?timeout=32s time="2024-09-16 13:32:39" level=info msg="Successfully deployed Dev Spaces in 331.988520528" •time="2024-09-16 13:32:39" level=info msg="Getting information and metrics from Dashboard pod" •time="2024-09-16 13:32:39" level=info msg="Getting information and metrics from Devfile Registry pod" •time="2024-09-16 13:32:39" level=info msg="Getting information and metrics from Plugin Registry pod" •time="2024-09-16 13:32:39" level=info msg="Getting information and metrics from Dev Spaces server pod" •time="2024-09-16 13:32:39" level=info msg="Checking if Dev Spaces API server is up" time="2024-09-16 13:32:42" level=error msg="Failed to get Dev Spaces Status {error 26 0 Get \"https://devspaces.apps.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/api/system/state\": dial tcp: lookup devspaces.apps.ci-op-ciml23i4-06bcb.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX on 172.30.0.10:53: no such host}" ------------------------------ •! Panic [2.635 seconds] [Dev Spaces Test Harness] [Pods] /github.com/redhat-developer/devspaces-interop-tests/tests/codeready.go:46 Check if Dev Spaces Server is already up [It] /github.com/redhat-developer/devspaces-interop-tests/tests/pod_tests.go:101 Test Panicked runtime error: invalid memory address or nil pointer dereference /usr/lib/golang/src/runtime/panic.go:220 Full Stack Trace github.com/redhat-developer/devspaces-interop-tests/tests.glob..func3.6() /github.com/redhat-developer/devspaces-interop-tests/tests/pod_tests.go:122 +0x3c1 command-line-arguments.TestHarnessCodeReadyWorkspaces(0x406699?) /github.com/redhat-developer/devspaces-interop-tests/cmd/operator_osd/codererady_addon_osd_test.go:128 +0x27d testing.tRunner(0xc000102d00, 0x1a9a7f0) /usr/lib/golang/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/lib/golang/src/testing/testing.go:1486 +0x35f ------------------------------ time="2024-09-16 13:32:42" level=info msg="Checking `che` config map integrity" •time="2024-09-16 13:32:42" level=info msg="Checking if CRD for Dev Spaces exist in cluster" •• ------------------------------ • Failure [0.001 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Obtain and patch Devfile from DevFile Registry [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:39 Unexpected error: <*url.Error | 0xc0003b6de0>: { Op: "Get", URL: "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml", Err: <*errors.errorString | 0xc000700210>{ s: "unsupported protocol scheme \"\"", }, } Get "/devfiles/java-maven-lombok__lombok-project-sample/devworkspace-che-code-latest.yaml": unsupported protocol scheme "" occurred /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 ------------------------------ S [SKIPPING] [0.000 seconds] [WORKSPACES] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:25 Create workspace from devfile registry /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:26 Create and start Workspace [It] /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:56 Run a workspace start in Dev Spaces requires a new implementation.The test is temporary skipped, while investigating. /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:57 ------------------------------ S [SKIPPING] [0.000 seconds] [Dev Spaces Test Harness] [Secrets] /github.com/redhat-developer/devspaces-interop-tests/tests/codeready.go:46 Secret `self-signed-certificate` should exist [It] /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:21 This test is skipped. /github.com/redhat-developer/devspaces-interop-tests/tests/secrets_tests.go:22 ------------------------------ time="2024-09-16 13:32:44" level=info msg="Checking if all services for Dev Spaces" • Failure [0.009 seconds] [Services] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:15 Check if devspaces services exist in cluster [It] /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:21 Expected : not to be empty /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 ------------------------------ time="2024-09-16 13:32:44" level=info msg="Clean up all created objects by Test Harness." JUnit report was created: /test-run-results/junit-dev-spaces.xml Summarizing 3 Failures: [Panic!] [Dev Spaces Test Harness] [Pods] [It] Check if Dev Spaces Server is already up  /usr/lib/golang/src/runtime/panic.go:220 [Fail] [WORKSPACES] Create workspace from devfile registry [It] Obtain and patch Devfile from DevFile Registry  /github.com/redhat-developer/devspaces-interop-tests/tests/workspace_tests.go:44 [Fail] [Services] [It] Check if devspaces services exist in cluster  /github.com/redhat-developer/devspaces-interop-tests/tests/services_tests.go:34 Ran 11 of 13 Specs in 435.312 seconds FAIL! -- 8 Passed | 3 Failed | 0 Pending | 2 Skipped You're using deprecated Ginkgo functionality: ============================================= Ginkgo 2.0 is under active development and will introduce (a small number of) breaking changes. To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md To comment, chime in at https://github.com/onsi/ginkgo/issues/711 You are using a custom reporter. Support for custom reporters will likely be removed in V2. Most users were using them to generate junit or teamcity reports and this functionality will be merged into the core reporter. In addition, Ginkgo 2.0 will support emitting a JSON-formatted report that users can then manipulate to generate custom reports. If this change will be impactful to you please leave a comment on https://github.com/onsi/ginkgo/issues/711 Learn more at: https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md#removed-custom-reporters To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=1.16.4 --- FAIL: TestHarnessCodeReadyWorkspaces (435.32s) FAIL receiving incremental file list test-run-results/ test-run-results/addon-metadata.json test-run-results/debug_tests.json test-run-results/devspaces_devspaces-59df4c7c75-x2t9f.log test-run-results/devspaces_devspaces-dashboard-546f85cdbd-b4qb6.log test-run-results/devspaces_plugin-registry-69546df79c-8cc4n.log test-run-results/junit-dev-spaces.xml sent 142 bytes received 99,910 bytes 200,104.00 bytes/sec total size is 99,322 speedup is 0.99