+ kubectl kuttl test ./tests/sequential --config ./tests/sequential/kuttl-test.yaml --test 1-018_validate_disable_default_instance 2024/07/24 08:47:39 kutt-test config testdirs is overridden with args: [ ./tests/sequential ] === RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. I0724 08:47:41.581780 88295 request.go:682] Waited for 1.049200042s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/route.openshift.io/v1?timeout=32s harness.go:275: Successful connection to cluster at: https://api.test-aws-412.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 600 seconds for each step harness.go:372: testsuite: ./tests/sequential has 36 tests === RUN kuttl/harness === RUN kuttl/harness/1-018_validate_disable_default_instance === PAUSE kuttl/harness/1-018_validate_disable_default_instance === CONT kuttl/harness/1-018_validate_disable_default_instance logger.go:42: 08:47:48 | 1-018_validate_disable_default_instance | Ignoring errors.yaml as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 08:47:48 | 1-018_validate_disable_default_instance | Creating namespace: kuttl-test-neat-ape logger.go:42: 08:47:48 | 1-018_validate_disable_default_instance/1- | starting test step 1- I0724 08:47:51.622065 88295 request.go:682] Waited for 2.349650125s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/pipelines.openshift.io/v1alpha1?timeout=32s logger.go:42: 08:47:51 | 1-018_validate_disable_default_instance/1- | test step completed 1- logger.go:42: 08:47:51 | 1-018_validate_disable_default_instance/2-patch-subscription | starting test step 2-patch-subscription logger.go:42: 08:47:51 | 1-018_validate_disable_default_instance/2-patch-subscription | running command: [sh -c oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "DISABLE_DEFAULT_ARGOCD_INSTANCE", "value": "true"}]}}}' ] logger.go:42: 08:47:52 | 1-018_validate_disable_default_instance/2-patch-subscription | subscription.operators.coreos.com/openshift-gitops-operator patched logger.go:42: 08:47:52 | 1-018_validate_disable_default_instance/2-patch-subscription | running command: [sh -c sleep 60] I0724 08:48:54.283354 88295 request.go:682] Waited for 1.0421055s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/operator.openshift.io/v1?timeout=32s logger.go:42: 08:48:55 | 1-018_validate_disable_default_instance/2-patch-subscription | test step completed 2-patch-subscription logger.go:42: 08:48:55 | 1-018_validate_disable_default_instance/3-check | starting test step 3-check logger.go:42: 08:58:59 | 1-018_validate_disable_default_instance/3-check | test step failed 3-check case.go:364: failed in step 3-check case.go:366: resource argoproj.io/v1alpha1, Kind=ArgoCD openshift-gitops matched error assertion case.go:366: resource apps/v1, Kind=Deployment openshift-gitops-server matched error assertion logger.go:42: 08:58:59 | 1-018_validate_disable_default_instance | skipping kubernetes event logging logger.go:42: 08:58:59 | 1-018_validate_disable_default_instance | Deleting namespace: kuttl-test-neat-ape === NAME kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (686.49s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/1-018_validate_disable_default_instance (677.45s) FAIL + true ' ' + kubectl kuttl test ./tests/sequential --config ./tests/sequential/kuttl-test.yaml --test 1-003_validate_cluster_config 2024/07/24 08:59:06 kutt-test config testdirs is overridden with args: [ ./tests/sequential ] === RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. I0724 08:59:08.244849 92544 request.go:682] Waited for 1.045916125s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/policy/v1?timeout=32s harness.go:275: Successful connection to cluster at: https://api.test-aws-412.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 600 seconds for each step harness.go:372: testsuite: ./tests/sequential has 36 tests === RUN kuttl/harness === RUN kuttl/harness/1-003_validate_cluster_config === PAUSE kuttl/harness/1-003_validate_cluster_config === CONT kuttl/harness/1-003_validate_cluster_config logger.go:42: 08:59:15 | 1-003_validate_cluster_config | Creating namespace: kuttl-test-crisp-pug logger.go:42: 08:59:15 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | starting test step 0-cluster-scoped-argocd I0724 08:59:18.269663 92544 request.go:682] Waited for 2.300987541s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/image.openshift.io/v1?timeout=32s logger.go:42: 08:59:18 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | Namespace:/argocd-e2e-cluster-config updated logger.go:42: 08:59:19 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | ArgoCD:argocd-e2e-cluster-config/example-argocd updated logger.go:42: 08:59:19 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | test step completed 0-cluster-scoped-argocd logger.go:42: 08:59:19 | 1-003_validate_cluster_config/1-cluster-scoped | starting test step 1-cluster-scoped logger.go:42: 08:59:19 | 1-003_validate_cluster_config/1-cluster-scoped | running command: [sh -c oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "ARGOCD_CLUSTER_CONFIG_NAMESPACES", "value": "openshift-gitops, argocd-e2e-cluster-config"}]}}}' ] logger.go:42: 08:59:20 | 1-003_validate_cluster_config/1-cluster-scoped | subscription.operators.coreos.com/openshift-gitops-operator patched logger.go:42: 08:59:20 | 1-003_validate_cluster_config/1-cluster-scoped | running command: [sh -c sleep 30] I0724 08:59:51.921286 92544 request.go:682] Waited for 1.049782875s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s logger.go:42: 09:09:54 | 1-003_validate_cluster_config/1-cluster-scoped | test step failed 1-cluster-scoped case.go:364: failed in step 1-cluster-scoped case.go:366: clusterrolebindings.rbac.authorization.k8s.io "example-argocd-argocd-e2e-cluster-config-argocd-application-controller" not found case.go:366: clusterrolebindings.rbac.authorization.k8s.io "example-argocd-argocd-e2e-cluster-config-argocd-server" not found case.go:366: clusterroles.rbac.authorization.k8s.io "example-argocd-argocd-e2e-cluster-config-argocd-application-controller" not found case.go:366: clusterroles.rbac.authorization.k8s.io "example-argocd-argocd-e2e-cluster-config-argocd-server" not found logger.go:42: 09:09:54 | 1-003_validate_cluster_config | skipping kubernetes event logging logger.go:42: 09:09:54 | 1-003_validate_cluster_config | Deleting namespace: kuttl-test-crisp-pug === NAME kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (656.51s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/1-003_validate_cluster_config (647.43s) FAIL + true ' ' + kubectl kuttl test ./tests/sequential --config ./tests/sequential/kuttl-test.yaml --test 1-034_validate_custom_roles 2024/07/24 09:10:03 kutt-test config testdirs is overridden with args: [ ./tests/sequential ] === RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. I0724 09:10:04.956573 96628 request.go:682] Waited for 1.04902125s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/autoscaling.openshift.io/v1beta1?timeout=32s harness.go:275: Successful connection to cluster at: https://api.test-aws-412.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 600 seconds for each step harness.go:372: testsuite: ./tests/sequential has 36 tests === RUN kuttl/harness === RUN kuttl/harness/1-034_validate_custom_roles === PAUSE kuttl/harness/1-034_validate_custom_roles === CONT kuttl/harness/1-034_validate_custom_roles logger.go:42: 09:10:12 | 1-034_validate_custom_roles | Creating namespace: kuttl-test-special-rat logger.go:42: 09:10:12 | 1-034_validate_custom_roles/1-install | starting test step 1-install I0724 09:10:14.964955 96628 request.go:682] Waited for 2.29468s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/authorization.openshift.io/v1?timeout=32s logger.go:42: 09:10:15 | 1-034_validate_custom_roles/1-install | Namespace:/test-1-034-custom created logger.go:42: 09:10:15 | 1-034_validate_custom_roles/1-install | ArgoCD:test-1-034-custom/argocd created logger.go:42: 09:10:16 | 1-034_validate_custom_roles/1-install | Namespace:/custom-role-namespace created logger.go:42: 09:10:16 | 1-034_validate_custom_roles/1-install | ClusterRole:/custom-argocd-role created logger.go:42: 09:10:30 | 1-034_validate_custom_roles/1-install | test step completed 1-install logger.go:42: 09:10:30 | 1-034_validate_custom_roles/2-patch-subscription | starting test step 2-patch-subscription logger.go:42: 09:10:30 | 1-034_validate_custom_roles/2-patch-subscription | running command: [sh -c oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "CONTROLLER_CLUSTER_ROLE", "value": "custom-argocd-role"},{"name": "SERVER_CLUSTER_ROLE", "value": "custom-argocd-role"}]}}}' ] logger.go:42: 09:10:31 | 1-034_validate_custom_roles/2-patch-subscription | subscription.operators.coreos.com/openshift-gitops-operator patched logger.go:42: 09:10:31 | 1-034_validate_custom_roles/2-patch-subscription | running command: [sh -c sleep 30] I0724 09:11:03.177052 96628 request.go:682] Waited for 1.049847666s due to client-side throttling, not priority and fairness, request: GET:https://api.test-aws-412.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1?timeout=32s logger.go:42: 09:11:04 | 1-034_validate_custom_roles/2-patch-subscription | test step completed 2-patch-subscription logger.go:42: 09:11:04 | 1-034_validate_custom_roles/3- | starting test step 3- logger.go:42: 09:21:09 | 1-034_validate_custom_roles/3- | test step failed 3- case.go:364: failed in step 3- case.go:366: resource rbac.authorization.k8s.io/v1, Kind=Role argocd-argocd-server matched error assertion case.go:366: resource rbac.authorization.k8s.io/v1, Kind=Role argocd-argocd-application-controller matched error assertion case.go:366: resource rbac.authorization.k8s.io/v1, Kind=Role argocd-argocd-server matched error assertion case.go:366: resource rbac.authorization.k8s.io/v1, Kind=Role argocd-argocd-application-controller matched error assertion logger.go:42: 09:21:09 | 1-034_validate_custom_roles | skipping kubernetes event logging logger.go:42: 09:21:09 | 1-034_validate_custom_roles | Deleting namespace: kuttl-test-special-rat === NAME kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (673.48s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/1-034_validate_custom_roles (664.38s) FAIL