WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 79 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". '/tmp/secret/kubeconfig' -> './kubeconfig' [INFO] Into a distinct namespace '-devspaces' will run a test workspace. By default will be used the 'admin' user-name You can specify an user-name of your OCP cluster as a parameter of this script, e.g.: 'execute-test-harness.sh ' namespace/openshift-devspaces created namespace/admin-devspaces created Now using project "admin-devspaces" on server "https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443". Error from server (NotFound): configmaps "ds-testsuite-kubeconfig" not found [INFO] Creating configmap 'ds-testsuite-kubeconfig' in namespace 'openshift-operators' configmap/ds-testsuite-kubeconfig created [INFO] Dev Spaces will use the latest production version [INFO] The version of Dev Spaces: devspacesoperator.v3.15.0 [INFO] Creating pod 'ds-testsuite-1724556209' in namespace 'openshift-operators' Warning: would violate PodSecurity "restricted:latest": allowPrivilegeEscalation != false (containers "test", "download" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "test", "download" must set securityContext.capabilities.drop=["ALL"]), runAsNonRoot != true (pod or containers "test", "download" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "test", "download" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") pod/ds-testsuite-1724556209 created Running Suite: Dev Spaces Operator Test Harness =============================================== Random Seed: 1724556225 Will run 13 of 13 specs time="2024-08-25 03:23:45" level=info msg="Installing Dev Spaces objects before running Test Harness..." TagName: 3.9.1-GA-dsc-assets Version Dev Spaces: 3.9.1 time="2024-08-25 03:23:45" level=info msg="Using CSV: devspacesoperator.v3.15.0" I0825 03:23:46.843629 1 request.go:668] Waited for 1.046823829s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/package-operator.run/v1alpha1?timeout=32s time="2024-08-25 03:23:47" level=info msg="Test Harness will run outside of OSD. Start to create OLM Kubernetes Objects for Dev Spaces" time="2024-08-25 03:23:47" level=info msg="Dev Spaces Operator will be installed in namespace 'openshift-operators'" time="2024-08-25 03:23:47" level=info msg="Creating new subscription 'devspaces' in namespace 'openshift-operators'" time="2024-08-25 03:23:47" level=info msg="Waiting subscription 'devspaces' to be installed in namespace 'openshift-operators'" time="2024-08-25 03:27:28" level=info msg="Waiting for CSV to be installed in cluster" time="2024-08-25 03:27:55" level=info msg="Successfully install CSV completed in 27.018766907" time="2024-08-25 03:27:55" level=info msg="Apply 'devspaces' custom resource in namespace 'openshift-devspaces'" I0825 03:27:56.116090 1 request.go:668] Waited for 1.038904302s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cluster.open-cluster-management.io/v1alpha1?timeout=32s time="2024-08-25 03:27:57" level=info msg="Successfully created 'devspaces' custom resource in namespace 'openshift-devspaces'" time="2024-08-25 03:27:57" level=info msg="Waiting for Dev Spaces to be deployed in cluster" I0825 03:28:06.823822 1 request.go:668] Waited for 1.038023784s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/scheduling.k8s.io/v1?timeout=32s I0825 03:28:16.862315 1 request.go:668] Waited for 1.444271822s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/package-operator.run/v1alpha1?timeout=32s I0825 03:28:26.900399 1 request.go:668] Waited for 1.844701388s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cloudcredential.openshift.io/v1?timeout=32s I0825 03:28:36.941913 1 request.go:668] Waited for 2.24377687s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/controlplane.operator.openshift.io/v1alpha1?timeout=32s I0825 03:28:47.789549 1 request.go:668] Waited for 1.044677549s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/security.internal.openshift.io/v1?timeout=32s I0825 03:28:57.832716 1 request.go:668] Waited for 1.444541308s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/config.openshift.io/v1?timeout=32s I0825 03:29:07.877102 1 request.go:668] Waited for 1.83694482s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/flowcontrol.apiserver.k8s.io/v1beta3?timeout=32s I0825 03:29:17.916501 1 request.go:668] Waited for 2.244630218s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/helm.openshift.io/v1beta1?timeout=32s I0825 03:29:28.769942 1 request.go:668] Waited for 1.045332702s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/monitoring.openshift.io/v1?timeout=32s I0825 03:29:38.808831 1 request.go:668] Waited for 1.445530758s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/autoscaling/v1?timeout=32s I0825 03:29:48.848237 1 request.go:668] Waited for 1.845179275s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/build.openshift.io/v1?timeout=32s I0825 03:29:58.886746 1 request.go:668] Waited for 2.243185485s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/helm.openshift.io/v1beta1?timeout=32s I0825 03:30:09.740339 1 request.go:668] Waited for 1.044536299s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha2?timeout=32s I0825 03:30:19.781389 1 request.go:668] Waited for 1.445188256s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/monitoring.coreos.com/v1alpha1?timeout=32s I0825 03:30:29.823618 1 request.go:668] Waited for 1.843888461s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/network.operator.openshift.io/v1?timeout=32s I0825 03:30:39.864184 1 request.go:668] Waited for 2.244972612s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/migration.k8s.io/v1alpha1?timeout=32s I0825 03:30:50.719293 1 request.go:668] Waited for 1.045182923s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/rbac.authorization.k8s.io/v1?timeout=32s I0825 03:31:00.757712 1 request.go:668] Waited for 1.445048694s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cloudcredential.openshift.io/v1?timeout=32s I0825 03:31:10.799072 1 request.go:668] Waited for 1.843917322s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/addons.managed.openshift.io/v1alpha1?timeout=32s I0825 03:31:20.840255 1 request.go:668] Waited for 2.244525882s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/user.openshift.io/v1?timeout=32s I0825 03:31:31.688298 1 request.go:668] Waited for 1.045033795s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/admissionregistration.k8s.io/v1?timeout=32s I0825 03:31:41.727142 1 request.go:668] Waited for 1.443749068s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/snapshot.storage.k8s.io/v1?timeout=32s I0825 03:31:51.774451 1 request.go:668] Waited for 1.844037969s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/imageregistry.operator.openshift.io/v1?timeout=32s I0825 03:32:01.811001 1 request.go:668] Waited for 2.243650819s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/certificates.k8s.io/v1?timeout=32s I0825 03:32:12.662739 1 request.go:668] Waited for 1.045361232s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cluster.open-cluster-management.io/v1alpha1?timeout=32s I0825 03:32:22.701746 1 request.go:668] Waited for 1.445183128s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/monitoring.coreos.com/v1?timeout=32s I0825 03:32:32.751872 1 request.go:668] Waited for 1.845406847s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/packages.operators.coreos.com/v1?timeout=32s I0825 03:32:42.792357 1 request.go:668] Waited for 2.243654462s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/samples.operator.openshift.io/v1?timeout=32s I0825 03:32:53.639141 1 request.go:668] Waited for 1.045054788s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/template.openshift.io/v1?timeout=32s I0825 03:33:03.675921 1 request.go:668] Waited for 1.444922643s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/template.openshift.io/v1?timeout=32s I0825 03:33:13.719513 1 request.go:668] Waited for 1.843267764s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha1?timeout=32s I0825 03:33:23.763794 1 request.go:668] Waited for 2.245772926s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/monitoring.coreos.com/v1beta1?timeout=32s I0825 03:33:34.612735 1 request.go:668] Waited for 1.04435763s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/security.internal.openshift.io/v1?timeout=32s I0825 03:33:44.657302 1 request.go:668] Waited for 1.444743094s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/node.k8s.io/v1?timeout=32s I0825 03:33:54.695440 1 request.go:668] Waited for 1.844902272s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/whereabouts.cni.cncf.io/v1alpha1?timeout=32s I0825 03:34:04.736556 1 request.go:668] Waited for 2.245238728s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/operators.coreos.com/v1alpha2?timeout=32s I0825 03:34:15.596337 1 request.go:668] Waited for 1.044544968s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/discovery.k8s.io/v1?timeout=32s I0825 03:34:25.636352 1 request.go:668] Waited for 1.445365885s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/oauth.openshift.io/v1?timeout=32s I0825 03:34:35.671066 1 request.go:668] Waited for 1.844591418s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/storage.k8s.io/v1?timeout=32s I0825 03:34:45.712834 1 request.go:668] Waited for 2.245116421s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/flowcontrol.apiserver.k8s.io/v1beta3?timeout=32s I0825 03:34:56.558845 1 request.go:668] Waited for 1.045730533s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/apps.openshift.io/v1?timeout=32s I0825 03:35:06.595423 1 request.go:668] Waited for 1.445270465s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cluster.open-cluster-management.io/v1alpha1?timeout=32s I0825 03:35:16.637411 1 request.go:668] Waited for 1.84490537s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cloudcredential.openshift.io/v1?timeout=32s I0825 03:35:26.678680 1 request.go:668] Waited for 2.244698399s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/flowcontrol.apiserver.k8s.io/v1beta3?timeout=32s I0825 03:35:37.530430 1 request.go:668] Waited for 1.045518801s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/org.eclipse.che/v2?timeout=32s I0825 03:35:47.567414 1 request.go:668] Waited for 1.44475042s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/helm.openshift.io/v1beta1?timeout=32s I0825 03:35:57.606496 1 request.go:668] Waited for 1.845226788s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/apiserver.openshift.io/v1?timeout=32s I0825 03:36:07.645439 1 request.go:668] Waited for 2.2445044s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha2?timeout=32s I0825 03:36:18.492034 1 request.go:668] Waited for 1.045596119s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/console.openshift.io/v1alpha1?timeout=32s I0825 03:36:28.531179 1 request.go:668] Waited for 1.444673244s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/console.openshift.io/v1alpha1?timeout=32s I0825 03:36:38.576552 1 request.go:668] Waited for 1.845314561s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/workspace.devfile.io/v1alpha2?timeout=32s I0825 03:36:48.614622 1 request.go:668] Waited for 2.244638045s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/apiextensions.k8s.io/v1?timeout=32s I0825 03:36:59.462079 1 request.go:668] Waited for 1.045208189s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cloud.network.openshift.io/v1?timeout=32s I0825 03:37:09.502938 1 request.go:668] Waited for 1.444732331s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/config.openshift.io/v1?timeout=32s I0825 03:37:19.538443 1 request.go:668] Waited for 1.84447261s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/node.k8s.io/v1?timeout=32s I0825 03:37:29.577333 1 request.go:668] Waited for 2.243837637s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/operators.coreos.com/v1alpha1?timeout=32s I0825 03:37:40.431738 1 request.go:668] Waited for 1.044770795s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/work.open-cluster-management.io/v1?timeout=32s I0825 03:37:50.473111 1 request.go:668] Waited for 1.445001249s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/controlplane.operator.openshift.io/v1alpha1?timeout=32s time="2024-08-25 03:37:58" level=panic msg="Failed to deploy Dev Spaces{ 27 0 }" Panic [853.060 seconds] [BeforeSuite] BeforeSuite  /github.com/redhat-developer/devspaces-interop-tests/cmd/operator_osd/codererady_addon_osd_test.go:45 Test Panicked &{0xc0001c68c0 map[] 2024-08-25 03:37:58.659792368 +0000 UTC m=+853.078231615 panic Failed to deploy Dev Spaces{ 27 0 } } /github.com/redhat-developer/devspaces-interop-tests/vendor/github.com/sirupsen/logrus/entry.go:255 Full Stack Trace github.com/sirupsen/logrus.Entry.log({0xc0001c68c0, 0xc000024d80, {0x0, 0x0, 0x0}, 0x0, 0x0, {0x0, 0x0}, 0x0, ...}, ...) /github.com/redhat-developer/devspaces-interop-tests/vendor/github.com/sirupsen/logrus/entry.go:255 +0x2b3 github.com/sirupsen/logrus.(*Entry).Log(0xc00051e000, 0x0, {0xc0009e8ac0?, 0xc0009e8c18?, 0xc00097f080?}) /github.com/redhat-developer/devspaces-interop-tests/vendor/github.com/sirupsen/logrus/entry.go:283 +0xa8 github.com/sirupsen/logrus.(*Logger).Log(0xc0001c68c0, 0x0, {0xc0009e8ac0, 0x2, 0x2}) /github.com/redhat-developer/devspaces-interop-tests/vendor/github.com/sirupsen/logrus/logger.go:198 +0x65 github.com/sirupsen/logrus.(*Logger).Panic(...) /github.com/redhat-developer/devspaces-interop-tests/vendor/github.com/sirupsen/logrus/logger.go:247 command-line-arguments.glob..func1() /github.com/redhat-developer/devspaces-interop-tests/cmd/operator_osd/codererady_addon_osd_test.go:96 +0x8d1 reflect.Value.call({0x16a91a0?, 0x1a9a7f8?, 0x30?}, {0x19c098c, 0x4}, {0xc000555360, 0x0, 0xc000555358?}) /usr/lib/golang/src/reflect/value.go:556 +0x845 reflect.Value.Call({0x16a91a0?, 0x1a9a7f8?, 0x2f?}, {0xc000555360, 0x0, 0x0}) /usr/lib/golang/src/reflect/value.go:339 +0xbf command-line-arguments.TestHarnessCodeReadyWorkspaces(0x406699?) /github.com/redhat-developer/devspaces-interop-tests/cmd/operator_osd/codererady_addon_osd_test.go:128 +0x27d testing.tRunner(0xc0004076c0, 0x1a9a7f0) /usr/lib/golang/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/lib/golang/src/testing/testing.go:1486 +0x35f ------------------------------ time="2024-08-25 03:37:58" level=info msg="Clean up all created objects by Test Harness." I0825 03:38:00.512327 1 request.go:668] Waited for 1.84540556s due to client-side throttling, not priority and fairness, request: GET:https://api.ci-rosa-h-5h6i.cwvj.s3.devshift.org:443/apis/cluster.open-cluster-management.io/v1alpha1?timeout=32s JUnit report was created: /test-run-results/junit-dev-spaces.xml Ran 13 of 0 Specs in 855.476 seconds FAIL! -- 0 Passed | 13 Failed | 0 Pending | 0 Skipped You're using deprecated Ginkgo functionality: ============================================= Ginkgo 2.0 is under active development and will introduce (a small number of) breaking changes. To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md To comment, chime in at https://github.com/onsi/ginkgo/issues/711 You are using a custom reporter. Support for custom reporters will likely be removed in V2. Most users were using them to generate junit or teamcity reports and this functionality will be merged into the core reporter. In addition, Ginkgo 2.0 will support emitting a JSON-formatted report that users can then manipulate to generate custom reports. If this change will be impactful to you please leave a comment on https://github.com/onsi/ginkgo/issues/711 Learn more at: https://github.com/onsi/ginkgo/blob/v2/docs/MIGRATING_TO_V2.md#removed-custom-reporters To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=1.16.4 --- FAIL: TestHarnessCodeReadyWorkspaces (855.48s) FAIL receiving incremental file list test-run-results/ test-run-results/addon-metadata.json test-run-results/debug_tests.json test-run-results/junit-dev-spaces.xml sent 85 bytes received 1,057 bytes 761.33 bytes/sec total size is 763 speedup is 0.67