./run-multiple-single-tests.sh
**************** Parallel test [1-067_validate_redis_secure_comm_no_autotls_ha] ****************
2024/11/14 11:27:50 kutt-test config testdirs is overridden with args: [ ./tests/parallel ]
=== RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. harness.go:275: Successful connection to cluster at: https://api.psi-416-100.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 720 seconds for each step harness.go:372: testsuite: ./tests/parallel has 84 tests === RUN kuttl/harness === RUN kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha === PAUSE kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:27:52 | 1-067_validate_redis_secure_comm_no_autotls_ha | Creating namespace: kuttl-test-deciding-dory logger.go:42: 11:27:52 | 1-067_validate_redis_secure_comm_no_autotls_ha/1-install | starting test step 1-install logger.go:42: 11:27:53 | 1-067_validate_redis_secure_comm_no_autotls_ha/1-install | ArgoCD:kuttl-test-deciding-dory/argocd created logger.go:42: 11:30:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/1-install | test step completed 1-install logger.go:42: 11:30:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | starting test step 2-generate_cert logger.go:42: 11:30:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | running command: [sh -c set -e echo -e "
[SAN]
subjectAltName=DNS:argocd-redis.$NAMESPACE.svc.cluster.local
[req]
distinguished_name=req" > ${PWD}/openssl_test.cnf openssl req -new -x509 -sha256 \ -subj "/C=XX/ST=XX/O=Testing/CN=redis" \ -reqexts SAN -extensions SAN \ -config ${PWD}/openssl_test.cnf \ -keyout ${PWD}/redis-ha.key \ -out ${PWD}/redis-ha.crt \ -newkey rsa:4096 \ -nodes \ -sha256 \ -days 10 ] logger.go:42: 11:30:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | req: Multiple digest or unknown options: -sha256 and -sha256 logger.go:42: 11:30:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | req: Use -help for summary. case.go:364: failed in step 2-generate_cert case.go:366: exit status 1 logger.go:42: 11:30:29 | 1-067_validate_redis_secure_comm_no_autotls_ha | skipping kubernetes event logging logger.go:42: 11:30:29 | 1-067_validate_redis_secure_comm_no_autotls_ha | Deleting namespace: kuttl-test-deciding-dory === NAME kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (195.32s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha (193.29s) FAIL
--- FAIL [1-067_validate_redis_secure_comm_no_autotls_ha]
**************** Parallel test [1-090_validate_permissions] ****************
2024/11/14 11:31:05 kutt-test config testdirs is overridden with args: [ ./tests/parallel ]
=== RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. harness.go:275: Successful connection to cluster at: https://api.psi-416-100.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 720 seconds for each step harness.go:372: testsuite: ./tests/parallel has 84 tests === RUN kuttl/harness === RUN kuttl/harness/1-090_validate_permissions === PAUSE kuttl/harness/1-090_validate_permissions === CONT kuttl/harness/1-090_validate_permissions logger.go:42: 11:31:07 | 1-090_validate_permissions | Creating namespace: kuttl-test-fair-satyr logger.go:42: 11:31:07 | 1-090_validate_permissions/1- | starting test step 1- logger.go:42: 11:43:08 | 1-090_validate_permissions/1- | test step failed 1- case.go:364: failed in step 1- case.go:366: clusterserviceversions.operators.coreos.com "openshift-gitops-operator.v1.14.1" not found logger.go:42: 11:43:08 | 1-090_validate_permissions | skipping kubernetes event logging logger.go:42: 11:43:08 | 1-090_validate_permissions | Deleting namespace: kuttl-test-fair-satyr === NAME kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (730.16s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/1-090_validate_permissions (727.93s) FAIL
--- FAIL [1-090_validate_permissions]
**************** Sequential test [1-100_validate_rollouts_resources_creation] ****************
2024/11/14 11:43:15 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
=== RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. harness.go:275: Successful connection to cluster at: https://api.psi-416-100.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 600 seconds for each step harness.go:372: testsuite: ./tests/sequential has 37 tests === RUN kuttl/harness === RUN kuttl/harness/1-100_validate_rollouts_resources_creation === PAUSE kuttl/harness/1-100_validate_rollouts_resources_creation === CONT kuttl/harness/1-100_validate_rollouts_resources_creation logger.go:42: 11:43:17 | 1-100_validate_rollouts_resources_creation | Creating namespace: kuttl-test-crucial-serval logger.go:42: 11:43:17 | 1-100_validate_rollouts_resources_creation/1-install-rolloutmanager | starting test step 1-install-rolloutmanager logger.go:42: 11:43:18 | 1-100_validate_rollouts_resources_creation/1-install-rolloutmanager | RolloutManager:openshift-gitops/example-rollout-manager created logger.go:42: 11:43:34 | 1-100_validate_rollouts_resources_creation/1-install-rolloutmanager | test step completed 1-install-rolloutmanager logger.go:42: 11:43:34 | 1-100_validate_rollouts_resources_creation/2- | starting test step 2- logger.go:42: 11:43:35 | 1-100_validate_rollouts_resources_creation/2- | test step completed 2- logger.go:42: 11:43:35 | 1-100_validate_rollouts_resources_creation/3-delete | starting test step 3-delete logger.go:42: 11:53:36 | 1-100_validate_rollouts_resources_creation/3-delete | test step failed 3-delete case.go:364: failed in step 3-delete case.go:366: resource rbac.authorization.k8s.io/v1, Kind=ClusterRole argo-rollouts matched error assertion case.go:366: resource rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding argo-rollouts matched error assertion logger.go:42: 11:53:36 | 1-100_validate_rollouts_resources_creation | skipping kubernetes event logging logger.go:42: 11:53:37 | 1-100_validate_rollouts_resources_creation | Deleting namespace: kuttl-test-crucial-serval === NAME kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (627.86s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/1-100_validate_rollouts_resources_creation (625.99s) FAIL
--- FAIL [1-100_validate_rollouts_resources_creation]
**************** Sequential test [1-084_validate_prune_templates] ****************
2024/11/14 11:53:43 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
2024/11/14 11:53:45 object detected with no GVK Kind for path /Users/trdoyle/3naworkspace_gitops/operator-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/01-assert.yaml
2024/11/14 11:53:45 object detected with no GVK Kind for path /Users/trdoyle/3naworkspace_gitops/operator-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/01-create-ns-managed-by.yaml
2024/11/14 11:53:45 object detected with no GVK Kind for path /Users/trdoyle/3naworkspace_gitops/operator-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/02-prune-duplicateGVK-resource.yaml
2024/11/14 11:53:45 object detected with no GVK Kind for path /Users/trdoyle/3naworkspace_gitops/operator-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/03-errors.yaml
2024/11/14 11:53:45 object detected with no GVK Kind for path /Users/trdoyle/3naworkspace_gitops/operator-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/04-delete.yaml
--- PASS [1-084_validate_prune_templates]
**************** Sequential test [1-078_validate_default_argocd_consoleLink] ****************
2024/11/14 11:53:53 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
--- PASS [1-078_validate_default_argocd_consoleLink]
**************** Sequential test [1-056_validate_managed-by] ****************
2024/11/14 11:55:08 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
--- PASS [1-056_validate_managed-by]
**************** Sequential test [1-018_validate_disable_default_instance] ****************
2024/11/14 11:57:06 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
--- PASS [1-018_validate_disable_default_instance]
**************** Sequential test [1-003_validate_cluster_config] ****************
2024/11/14 11:58:53 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
--- PASS [1-003_validate_cluster_config]
**************** Sequential test [1-034_validate_custom_roles] ****************
2024/11/14 11:59:56 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
--- PASS [1-034_validate_custom_roles]
**************** Sequential test [1-031_validate_toolchain] ****************
2024/11/14 12:01:36 kutt-test config testdirs is overridden with args: [ ./tests/sequential ]
=== RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. harness.go:275: Successful connection to cluster at: https://api.psi-416-100.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 600 seconds for each step harness.go:372: testsuite: ./tests/sequential has 37 tests === RUN kuttl/harness === RUN kuttl/harness/1-031_validate_toolchain === PAUSE kuttl/harness/1-031_validate_toolchain === CONT kuttl/harness/1-031_validate_toolchain logger.go:42: 12:01:38 | 1-031_validate_toolchain | Creating namespace: kuttl-test-immune-ant logger.go:42: 12:01:38 | 1-031_validate_toolchain/1-check | starting test step 1-check logger.go:42: 12:01:38 | 1-031_validate_toolchain/1-check | running command: [sh -c set -e set -o pipefail # These variables need to be maintained according to the component matrix: https://spaces.redhat.com/display/GITOPS/GitOps+Component+Matrix expected_kustomizeVersion='v5.4.2' expected_helmVersion='v3.15.2' expected_argocdVersion='v2.12.6' expected_dexVersion='v2.39.1-167-gde7eb6d0' expected_redisVersion='6.2.7' gitops_server_pod=$(oc get -n openshift-gitops pods \ -o custom-columns=NAME:.metadata.name --no-headers | \ grep openshift-gitops-server | \ head -1 ) dex_pod=$(oc get -n openshift-gitops pods \ -o custom-columns=NAME:.metadata.name --no-headers | \ grep openshift-gitops-dex-server | \ head -1 ) redis_pod=$(oc get -n openshift-gitops pods \ -o custom-columns=NAME:.metadata.name --no-headers | \ grep openshift-gitops-redis | \ head -1 ) route=$(oc get route -n openshift-gitops \ -o custom-columns=NAME:.spec.host --no-headers | \ grep openshift-gitops-server | \ head -1 ) kustomizeVersion=$(oc -n openshift-gitops exec $gitops_server_pod \ -- kustomize version ) helmVersion=$(oc -n openshift-gitops exec $gitops_server_pod \ -- helm version | \ sed -e 's/version.BuildInfo//' -e 's/\"//g' | \ awk -F':' '{ print $2 }' | \ awk -F',' '{ print $1 }' ) argocdVersion=$(oc -n openshift-gitops exec $gitops_server_pod \ -- argocd version --short --server $route --insecure | \ grep 'argocd-server' | \ awk -F' ' '{ print $2 }' | \ sed 's/\+.*//' ) dexVersion=$(oc -n openshift-gitops exec $dex_pod -- dex version 2>&1 | \ grep '^Dex Version' | \ awk -F': ' '{ print $2 }' ) redisVersion=$(oc -n openshift-gitops exec $redis_pod -- \ redis-server -v | awk -F '=' '{ print $2 }' | cut -d' ' -f 1 ) if test "${kustomizeVersion}" != "${expected_kustomizeVersion}"; then echo "Kustomize version mismatch. Should be ${expected_kustomizeVersion}, is ${kustomizeVersion}" exit 1 fi if test "${helmVersion}" != "${expected_helmVersion}"; then echo "Helm version mismatch. Should be ${expected_helmVersion}, is ${helmVersion}" exit 1 fi if test "${argocdVersion}" != "${expected_argocdVersion}"; then echo "ArgoCD version mismatch. Should be ${expected_argocdVersion}, is ${argocdVersion}" exit 1 fi if test "${dexVersion}" != "${expected_dexVersion}"; then echo "Dex version mismatch. Should be ${expected_dexVersion}, is ${dexVersion}" exit 1 fi if test "${redisVersion}" != "${expected_redisVersion}"; then echo "Redis version mismatch. Should be ${expected_redisVersion}, is ${redisVersion}" exit 1 fi ] logger.go:42: 12:01:47 | 1-031_validate_toolchain/1-check | time="2024-11-14T12:01:47Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." logger.go:42: 12:01:51 | 1-031_validate_toolchain/1-check | Kustomize version mismatch. Should be v5.4.2, is v5.2.1 case.go:364: failed in step 1-check case.go:366: exit status 1 logger.go:42: 12:01:52 | 1-031_validate_toolchain | skipping kubernetes event logging logger.go:42: 12:01:52 | 1-031_validate_toolchain | Deleting namespace: kuttl-test-immune-ant === NAME kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (22.77s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/1-031_validate_toolchain (20.82s) FAIL
--- FAIL [1-031_validate_toolchain]
PARALLEL rerun failures
1-067_validate_redis_secure_comm_no_autotls_ha
1-090_validate_permissions
SEQUENTIAL rerun failures
1-100_validate_rollouts_resources_creation
1-031_validate_toolchain