undefined step-generate Cluster name generated: nas-psi-414-02-022478 Is nightly?: false Image repository: devtools_gitops Result path: CI/z-stream-test-pipeline-nas/250224-110821 Result path URL: http://uploader.devtools-gitops--pipeline.svc.cluster.local:8080/CI/z-stream-test-pipeline-nas/250224-110821/ undefined step-create-cluster-dir Directory with cluster info exists, logging in WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 70 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Welcome! See 'oc help' to get started. undefined step-clone + '[' false = true ']' + '[' false = true ']' + '[' false = true ']' + CHECKOUT_DIR=/workspace/output/ + '[' false = true ']' + test -z '' + test -z '' + test -z '' + git config --global --add safe.directory /workspace/output + /ko-app/git-init -url=https://gitlab.cee.redhat.com/nas/downstream-CI -revision=remove-plumbing-repo-reference -refspec= -path=/workspace/output/ -sslVerify=false -submodules=true -depth=1 -sparseCheckoutDirectories= {"level":"error","ts":1740395319.822886,"caller":"git/git.go:53","msg":"Error running git [remote get-url origin]: exit status 2\nerror: No such remote 'origin'\n","stacktrace":"github.com/tektoncd-catalog/git-clone/git-init/git.run\n\t/go/src/github.com/tektoncd-catalog/git-clone/image/git-init/git/git.go:53\ngithub.com/tektoncd-catalog/git-clone/git-init/git.Fetch\n\t/go/src/github.com/tektoncd-catalog/git-clone/image/git-init/git/git.go:109\nmain.main\n\t/go/src/github.com/tektoncd-catalog/git-clone/image/git-init/main.go:52\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:271"} {"level":"info","ts":1740395320.8494115,"caller":"git/git.go:186","msg":"Successfully cloned https://gitlab.cee.redhat.com/nas/downstream-CI @ d806c3a8467ac6d85bba90e43ca25b96f8353dcd (grafted, HEAD, origin/remove-plumbing-repo-reference) in path /workspace/output/"} {"level":"info","ts":1740395320.946487,"caller":"git/git.go:225","msg":"Successfully initialized and updated submodules in path /workspace/output/"} + cd /workspace/output/ ++ git rev-parse HEAD + RESULT_SHA=d806c3a8467ac6d85bba90e43ca25b96f8353dcd + EXIT_CODE=0 + '[' 0 '!=' 0 ']' ++ git log -1 --pretty=%ct + RESULT_COMMITTER_DATE=1739946370 + printf %s 1739946370 + printf %s d806c3a8467ac6d85bba90e43ca25b96f8353dcd + printf %s https://gitlab.cee.redhat.com/nas/downstream-CI undefined step-create-catalog-source Logging in as kubeadmin user WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 70 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Welcome! See 'oc help' to get started. NAME DISPLAY TYPE PUBLISHER AGE iib-919669 iib-919669-devtools_gitops grpc GitOps Team 5d4h pod/iib-919669-9krh9 condition met Operator will be installed from default catalog source iib-919669 passed undefined step-branch-version gitops version latest is Present undefined step-clone + '[' false = true ']' + '[' false = true ']' + '[' false = true ']' + CHECKOUT_DIR=/workspace/output/ + '[' false = true ']' + test -z '' + test -z '' + test -z '' + git config --global --add safe.directory /workspace/output + /ko-app/git-init -url=https://gitlab.cee.redhat.com/gitops/operator-e2e.git -revision=master -refspec= -path=/workspace/output/ -sslVerify=false -submodules=true -depth=1 -sparseCheckoutDirectories= {"level":"error","ts":1740395345.6166718,"caller":"git/git.go:53","msg":"Error running git [remote get-url origin]: exit status 2\nerror: No such remote 'origin'\n","stacktrace":"github.com/tektoncd-catalog/git-clone/git-init/git.run\n\t/go/src/github.com/tektoncd-catalog/git-clone/image/git-init/git/git.go:53\ngithub.com/tektoncd-catalog/git-clone/git-init/git.Fetch\n\t/go/src/github.com/tektoncd-catalog/git-clone/image/git-init/git/git.go:109\nmain.main\n\t/go/src/github.com/tektoncd-catalog/git-clone/image/git-init/main.go:52\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:271"} {"level":"info","ts":1740395346.658772,"caller":"git/git.go:186","msg":"Successfully cloned https://gitlab.cee.redhat.com/gitops/operator-e2e.git @ 90e2ba4bbae467e242eb65e2293ebc32659f9df0 (grafted, HEAD, origin/master) in path /workspace/output/"} {"level":"info","ts":1740395346.7622437,"caller":"git/git.go:225","msg":"Successfully initialized and updated submodules in path /workspace/output/"} + cd /workspace/output/ ++ git rev-parse HEAD + RESULT_SHA=90e2ba4bbae467e242eb65e2293ebc32659f9df0 + EXIT_CODE=0 + '[' 0 '!=' 0 ']' ++ git log -1 --pretty=%ct + RESULT_COMMITTER_DATE=1740032146 + printf %s 1740032146 + printf %s 90e2ba4bbae467e242eb65e2293ebc32659f9df0 + printf %s https://gitlab.cee.redhat.com/gitops/operator-e2e.git undefined step-test-argo-rollouts + RESULT=/install-dir/nas-psi-414-02-result.txt + trap update_result EXIT Logging in as kubeadmin user + echo -e 'Logging in as kubeadmin user' ++ cat /install-dir/nas-psi-414-02/auth/kubeadmin-password ++ cat /install-dir/nas-psi-414-02/auth/api-url + oc login -u kubeadmin -p 65KFg-3NTSK-KksWr-gCKbq https://api.nas-psi-414-02.ocp-gitops-qe.com:6443 --insecure-skip-tls-verify=true WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 70 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Welcome! See 'oc help' to get started. ++ echo false ++ tr '[:upper:]' '[:lower:]' + [[ false == \f\a\l\s\e ]] + echo '$RUN_ARGO_ROLLOUTS_TESTS is set to false, skipping the execution' $RUN_ARGO_ROLLOUTS_TESTS is set to false, skipping the execution + echo 0 + tee /tekton/results/result 0 + exit 0 + update_result + [[ '' != 0 ]] + echo test-argo-rollouts + tee /install-dir/nas-psi-414-02-result.txt test-argo-rollouts + exit 0 undefined step-run-kuttl-e2e-tests Logging in as kubeadmin user WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 70 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Welcome! See 'oc help' to get started. make: Entering directory '/kuttl-e2e/gitops-operator' Running GitOps Operator E2E tests... . ./test.sh all =========================== ==== RUNNING ALL TESTS ==== =========================== Running parallel test suite 2025/02/24 11:09:16 kutt-test config testdirs is overridden with args: [ /kuttl-e2e/gitops-operator/tests/parallel ] === RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. I0224 11:09:18.047884 121 request.go:682] Waited for 1.040144906s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s harness.go:275: Successful connection to cluster at: https://api.nas-psi-414-02.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 720 seconds for each step harness.go:372: testsuite: /kuttl-e2e/gitops-operator/tests/parallel has 89 tests === RUN kuttl/harness === RUN kuttl/harness/1-001_alpha_to_beta_dex_conversion === PAUSE kuttl/harness/1-001_alpha_to_beta_dex_conversion === RUN kuttl/harness/1-002_alpha_to_beta_keycloak_conversion === PAUSE kuttl/harness/1-002_alpha_to_beta_keycloak_conversion === RUN kuttl/harness/1-003_alpha_to_beta_sso_conflict_conversion === PAUSE kuttl/harness/1-003_alpha_to_beta_sso_conflict_conversion === RUN kuttl/harness/1-003_validate_console_link === PAUSE kuttl/harness/1-003_validate_console_link === RUN kuttl/harness/1-004_beta_to_alpha_conversion === PAUSE kuttl/harness/1-004_beta_to_alpha_conversion === RUN kuttl/harness/1-005_validate_route_tls === PAUSE kuttl/harness/1-005_validate_route_tls === RUN kuttl/harness/1-007_validate_namespace_scoped_install === PAUSE kuttl/harness/1-007_validate_namespace_scoped_install === RUN kuttl/harness/1-007_validate_volume_mounts === PAUSE kuttl/harness/1-007_validate_volume_mounts === RUN kuttl/harness/1-008_validate-custom-argocd-namespace === PAUSE kuttl/harness/1-008_validate-custom-argocd-namespace === RUN kuttl/harness/1-009_validate-manage-other-namespace === PAUSE kuttl/harness/1-009_validate-manage-other-namespace === RUN kuttl/harness/1-012_validate-managed-by-chain === PAUSE kuttl/harness/1-012_validate-managed-by-chain === RUN kuttl/harness/1-019_validate_volume_mounts === PAUSE kuttl/harness/1-019_validate_volume_mounts === RUN kuttl/harness/1-021_validate_rolebindings === PAUSE kuttl/harness/1-021_validate_rolebindings === RUN kuttl/harness/1-023_validate_repo_server_tls === PAUSE kuttl/harness/1-023_validate_repo_server_tls === RUN kuttl/harness/1-025-validate-managed-by-change === PAUSE kuttl/harness/1-025-validate-managed-by-change === RUN kuttl/harness/1-029_validate_tls_secret_no_scale === PAUSE kuttl/harness/1-029_validate_tls_secret_no_scale === RUN kuttl/harness/1-030_validate_reencrypt === PAUSE kuttl/harness/1-030_validate_reencrypt === RUN kuttl/harness/1-032_validate_dynamic_scaling === PAUSE kuttl/harness/1-032_validate_dynamic_scaling === RUN kuttl/harness/1-032_validate_resource_inclusions === PAUSE kuttl/harness/1-032_validate_resource_inclusions === RUN kuttl/harness/1-033_validate_applicationset_tls_scm_volume_mount === PAUSE kuttl/harness/1-033_validate_applicationset_tls_scm_volume_mount === RUN kuttl/harness/1-033_validate_resource_exclusions === PAUSE kuttl/harness/1-033_validate_resource_exclusions === RUN kuttl/harness/1-034_validate_webhook_notifications === PAUSE kuttl/harness/1-034_validate_webhook_notifications === RUN kuttl/harness/1-036_validate_keycloak_resource_reqs === PAUSE kuttl/harness/1-036_validate_keycloak_resource_reqs === RUN kuttl/harness/1-037_validate_argocd_setting_replicas === PAUSE kuttl/harness/1-037_validate_argocd_setting_replicas === RUN kuttl/harness/1-038_validate_productized_images === PAUSE kuttl/harness/1-038_validate_productized_images === RUN kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm === PAUSE kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm === RUN kuttl/harness/1-042_restricted_pss_compliant === PAUSE kuttl/harness/1-042_restricted_pss_compliant === RUN kuttl/harness/1-043_validate_custom_labels_annotations === PAUSE kuttl/harness/1-043_validate_custom_labels_annotations === RUN kuttl/harness/1-043_validate_log_level_format === PAUSE kuttl/harness/1-043_validate_log_level_format === RUN kuttl/harness/1-044_validate_resource_limit_changes === PAUSE kuttl/harness/1-044_validate_resource_limit_changes === RUN kuttl/harness/1-045_validate_applicationset_image_override === PAUSE kuttl/harness/1-045_validate_applicationset_image_override === RUN kuttl/harness/1-045_validate_repo_exec_timeout === PAUSE kuttl/harness/1-045_validate_repo_exec_timeout === RUN kuttl/harness/1-047_validate_custom_env === PAUSE kuttl/harness/1-047_validate_custom_env === RUN kuttl/harness/1-048_validate_controller_sharding === PAUSE kuttl/harness/1-048_validate_controller_sharding === RUN kuttl/harness/1-049_validate_parallelism_limit === PAUSE kuttl/harness/1-049_validate_parallelism_limit === RUN kuttl/harness/1-050_validate_sso === PAUSE kuttl/harness/1-050_validate_sso === RUN kuttl/harness/1-051-validate_csv_permissions === PAUSE kuttl/harness/1-051-validate_csv_permissions === RUN kuttl/harness/1-052_validate_rolebinding_number === PAUSE kuttl/harness/1-052_validate_rolebinding_number === RUN kuttl/harness/1-053_validate_cluster_admin_rbac === PAUSE kuttl/harness/1-053_validate_cluster_admin_rbac === RUN kuttl/harness/1-054_validate_deploymentconfig === PAUSE kuttl/harness/1-054_validate_deploymentconfig === RUN kuttl/harness/1-055_drop_resource_customizations === PAUSE kuttl/harness/1-055_drop_resource_customizations === RUN kuttl/harness/1-055_validate_notification_controller === PAUSE kuttl/harness/1-055_validate_notification_controller === RUN kuttl/harness/1-057_validate_notifications === PAUSE kuttl/harness/1-057_validate_notifications === RUN kuttl/harness/1-058_validate_prometheus_rule === PAUSE kuttl/harness/1-058_validate_prometheus_rule === RUN kuttl/harness/1-061_validate_resource_tracking_method === PAUSE kuttl/harness/1-061_validate_resource_tracking_method === RUN kuttl/harness/1-062_validate_extra_config === PAUSE kuttl/harness/1-062_validate_extra_config === RUN kuttl/harness/1-063_validate_dex_liveness_probe === PAUSE kuttl/harness/1-063_validate_dex_liveness_probe === RUN kuttl/harness/1-063_validate_statefulset_restart === PAUSE kuttl/harness/1-063_validate_statefulset_restart === RUN kuttl/harness/1-064_validate_security_contexts === PAUSE kuttl/harness/1-064_validate_security_contexts === RUN kuttl/harness/1-065_validate_redis_ha_anti_affinity === PAUSE kuttl/harness/1-065_validate_redis_ha_anti_affinity === RUN kuttl/harness/1-066_validate_redis_secure_comm_no_autotls_no_ha === PAUSE kuttl/harness/1-066_validate_redis_secure_comm_no_autotls_no_ha === RUN kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha === PAUSE kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha === RUN kuttl/harness/1-068_validate_redis_secure_comm_autotls_no_ha === PAUSE kuttl/harness/1-068_validate_redis_secure_comm_autotls_no_ha === RUN kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha === PAUSE kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha === RUN kuttl/harness/1-070_validate_config_management_plugin === PAUSE kuttl/harness/1-070_validate_config_management_plugin === RUN kuttl/harness/1-071_validate_SCC_HA === PAUSE kuttl/harness/1-071_validate_SCC_HA === RUN kuttl/harness/1-072_validate_liveness_probe_removed === PAUSE kuttl/harness/1-072_validate_liveness_probe_removed === RUN kuttl/harness/1-073_validate_rhsso === PAUSE kuttl/harness/1-073_validate_rhsso === RUN kuttl/harness/1-074_validate_terminating_namespace_block === PAUSE kuttl/harness/1-074_validate_terminating_namespace_block === RUN kuttl/harness/1-075_validate_dex_anyuid === PAUSE kuttl/harness/1-075_validate_dex_anyuid === RUN kuttl/harness/1-077_validate_disable_dex_removed === PAUSE kuttl/harness/1-077_validate_disable_dex_removed === RUN kuttl/harness/1-079_validate_vars_for_notificaitons === PAUSE kuttl/harness/1-079_validate_vars_for_notificaitons === RUN kuttl/harness/1-080_validate_regex_support_argocd_rbac === PAUSE kuttl/harness/1-080_validate_regex_support_argocd_rbac === RUN kuttl/harness/1-081_validate_applicationset_deployment === PAUSE kuttl/harness/1-081_validate_applicationset_deployment === RUN kuttl/harness/1-082_validate_node_placement === PAUSE kuttl/harness/1-082_validate_node_placement === RUN kuttl/harness/1-083_validate_kustomize_namereference === PAUSE kuttl/harness/1-083_validate_kustomize_namereference === RUN kuttl/harness/1-083_validate_resource_customization_subkeys === PAUSE kuttl/harness/1-083_validate_resource_customization_subkeys === RUN kuttl/harness/1-084_validate_status_host_ingress === PAUSE kuttl/harness/1-084_validate_status_host_ingress === RUN kuttl/harness/1-086_validate_applicationset_extra_command_args === PAUSE kuttl/harness/1-086_validate_applicationset_extra_command_args === RUN kuttl/harness/1-087_validate_repo_server_settings === PAUSE kuttl/harness/1-087_validate_repo_server_settings === RUN kuttl/harness/1-088_validate_applicationset_add_env_vars === PAUSE kuttl/harness/1-088_validate_applicationset_add_env_vars === RUN kuttl/harness/1-089_validate_extra_repo_commands_args === PAUSE kuttl/harness/1-089_validate_extra_repo_commands_args === RUN kuttl/harness/1-090_validate_permissions === PAUSE kuttl/harness/1-090_validate_permissions === RUN kuttl/harness/1-091_argocd_app_validate-applicationset-status === PAUSE kuttl/harness/1-091_argocd_app_validate-applicationset-status === RUN kuttl/harness/1-092_validate_workload_status_monitoring_alert === PAUSE kuttl/harness/1-092_validate_workload_status_monitoring_alert === RUN kuttl/harness/1-095_validate_dex_clientsecret === PAUSE kuttl/harness/1-095_validate_dex_clientsecret === RUN kuttl/harness/1-096-validate_home_env_argocd_controller === PAUSE kuttl/harness/1-096-validate_home_env_argocd_controller === RUN kuttl/harness/1-098_validate_dex_clientsecret_deprecated === PAUSE kuttl/harness/1-098_validate_dex_clientsecret_deprecated === RUN kuttl/harness/1-099_validate_server_autoscale === PAUSE kuttl/harness/1-099_validate_server_autoscale === RUN kuttl/harness/1-102_validate_handle_terminating_namespaces === PAUSE kuttl/harness/1-102_validate_handle_terminating_namespaces === RUN kuttl/harness/1-103_argocd_alpha_to_beta_conversion === PAUSE kuttl/harness/1-103_argocd_alpha_to_beta_conversion === RUN kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount === PAUSE kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount === RUN kuttl/harness/1-107_host_attribute_sso_provider === PAUSE kuttl/harness/1-107_host_attribute_sso_provider === RUN kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance === PAUSE kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance === RUN kuttl/harness/1-111_validate_appcontroller_initcontainers === PAUSE kuttl/harness/1-111_validate_appcontroller_initcontainers === RUN kuttl/harness/1-112_validate_server_initcontainers === PAUSE kuttl/harness/1-112_validate_server_initcontainers === RUN kuttl/harness/1-113_validate_appcontroller_sidecar === PAUSE kuttl/harness/1-113_validate_appcontroller_sidecar === RUN kuttl/harness/1-114_validate_server_sidecar === PAUSE kuttl/harness/1-114_validate_server_sidecar === RUN kuttl/harness/1-115_validate_controller_extra_command_args === PAUSE kuttl/harness/1-115_validate_controller_extra_command_args === CONT kuttl/harness/1-001_alpha_to_beta_dex_conversion === CONT kuttl/harness/1-062_validate_extra_config === CONT kuttl/harness/1-037_validate_argocd_setting_replicas === CONT kuttl/harness/1-049_validate_parallelism_limit === CONT kuttl/harness/1-055_drop_resource_customizations logger.go:42: 11:09:24 | 1-055_drop_resource_customizations | Creating namespace: kuttl-test-aware-lobster === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:09:24 | 1-062_validate_extra_config | Creating namespace: kuttl-test-live-dassie === CONT kuttl/harness/1-001_alpha_to_beta_dex_conversion logger.go:42: 11:09:24 | 1-001_alpha_to_beta_dex_conversion | Creating namespace: kuttl-test-cheerful-krill === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:09:24 | 1-037_validate_argocd_setting_replicas | Creating namespace: kuttl-test-unbiased-husky === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:09:24 | 1-049_validate_parallelism_limit | Creating namespace: kuttl-test-meet-ox === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:09:24 | 1-037_validate_argocd_setting_replicas/1-install | starting test step 1-install === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:09:24 | 1-049_validate_parallelism_limit/1-install | starting test step 1-install === CONT kuttl/harness/1-055_drop_resource_customizations logger.go:42: 11:09:24 | 1-055_drop_resource_customizations/1-alpha-argocd | starting test step 1-alpha-argocd === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:09:24 | 1-062_validate_extra_config/1-argocd-with-extraconfig | starting test step 1-argocd-with-extraconfig === CONT kuttl/harness/1-001_alpha_to_beta_dex_conversion logger.go:42: 11:09:24 | 1-001_alpha_to_beta_dex_conversion/1-argocd-dex | starting test step 1-argocd-dex === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:09:27 | 1-037_validate_argocd_setting_replicas/1-install | ArgoCD:kuttl-test-unbiased-husky/argocd created I0224 11:09:28.093597 121 request.go:682] Waited for 1.028897796s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:09:32 | 1-049_validate_parallelism_limit/1-install | ArgoCD:kuttl-test-meet-ox/argocd created === CONT kuttl/harness/1-055_drop_resource_customizations logger.go:42: 11:09:32 | 1-055_drop_resource_customizations/1-alpha-argocd | ArgoCD:kuttl-test-aware-lobster/argocd created === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:09:37 | 1-062_validate_extra_config/1-argocd-with-extraconfig | ArgoCD:kuttl-test-live-dassie/example-argocd created === CONT kuttl/harness/1-001_alpha_to_beta_dex_conversion logger.go:42: 11:09:37 | 1-001_alpha_to_beta_dex_conversion/1-argocd-dex | ArgoCD:kuttl-test-cheerful-krill/argocd created === CONT kuttl/harness/1-055_drop_resource_customizations logger.go:42: 11:09:44 | 1-055_drop_resource_customizations/1-alpha-argocd | test step completed 1-alpha-argocd logger.go:42: 11:09:44 | 1-055_drop_resource_customizations/2- | starting test step 2- I0224 11:09:45.274477 121 request.go:682] Waited for 1.028316162s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/image.openshift.io/v1?timeout=32s logger.go:42: 11:09:46 | 1-055_drop_resource_customizations/2- | test step completed 2- logger.go:42: 11:09:46 | 1-055_drop_resource_customizations | skipping kubernetes event logging logger.go:42: 11:09:46 | 1-055_drop_resource_customizations | Deleting namespace: kuttl-test-aware-lobster === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:09:52 | 1-115_validate_controller_extra_command_args | Creating namespace: kuttl-test-probable-hornet logger.go:42: 11:09:52 | 1-115_validate_controller_extra_command_args/1-basic-argocd-install | starting test step 1-basic-argocd-install I0224 11:09:55.308584 121 request.go:682] Waited for 2.429563762s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/monitoring.coreos.com/v1?timeout=32s logger.go:42: 11:09:55 | 1-115_validate_controller_extra_command_args/1-basic-argocd-install | Namespace:/test-1-38-controller-extra-command created logger.go:42: 11:09:55 | 1-115_validate_controller_extra_command_args/1-basic-argocd-install | ArgoCD:test-1-38-controller-extra-command/example-argocd created === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:09:58 | 1-037_validate_argocd_setting_replicas/1-install | test step completed 1-install logger.go:42: 11:09:58 | 1-037_validate_argocd_setting_replicas/2-scale_out_server | starting test step 2-scale_out_server logger.go:42: 11:09:58 | 1-037_validate_argocd_setting_replicas/2-scale_out_server | running command: [sh -c oc patch argocd argocd \ -n $NAMESPACE \ --type='json' \ -p='[{"op": "replace", "path": "/spec/server/replicas", "value": 3 }]' exit 0 ] logger.go:42: 11:09:59 | 1-037_validate_argocd_setting_replicas/2-scale_out_server | argocd.argoproj.io/argocd patched logger.go:42: 11:10:01 | 1-037_validate_argocd_setting_replicas/2-scale_out_server | test step completed 2-scale_out_server logger.go:42: 11:10:01 | 1-037_validate_argocd_setting_replicas/3-scale_out_repo | starting test step 3-scale_out_repo logger.go:42: 11:10:01 | 1-037_validate_argocd_setting_replicas/3-scale_out_repo | running command: [sh -c oc patch argocd argocd \ -n $NAMESPACE \ --type='json' \ -p='[{"op": "replace", "path": "/spec/repo/replicas", "value": 3 }]' exit 0 ] logger.go:42: 11:10:02 | 1-037_validate_argocd_setting_replicas/3-scale_out_repo | argocd.argoproj.io/argocd patched logger.go:42: 11:10:04 | 1-037_validate_argocd_setting_replicas/3-scale_out_repo | test step completed 3-scale_out_repo logger.go:42: 11:10:04 | 1-037_validate_argocd_setting_replicas/4- | starting test step 4- I0224 11:10:05.787886 121 request.go:682] Waited for 1.028059017s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/pipelines.openshift.io/v1alpha1?timeout=32s === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:07 | 1-049_validate_parallelism_limit/1-install | test step completed 1-install logger.go:42: 11:10:07 | 1-049_validate_parallelism_limit/2-check-deployment | starting test step 2-check-deployment logger.go:42: 11:10:07 | 1-049_validate_parallelism_limit/2-check-deployment | running command: [sh -c set -e set -o pipefail expected=10 wlCommand=$(oc get -n $NAMESPACE statefulset/argocd-application-controller -o jsonpath='{.spec.template.spec.containers[0].command}'| jq -r '.[]' ) if ! echo "$wlCommand" | grep -qPz -- "--kubectl-parallelism-limit\\n${expected}(\$|\\n)"; then echo "Incorrect or missing --kubectl-parallelism-limit detected." echo "$wlCommand" exit 1 fi ] === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:10:07 | 1-115_validate_controller_extra_command_args/1-basic-argocd-install | test step completed 1-basic-argocd-install logger.go:42: 11:10:07 | 1-115_validate_controller_extra_command_args/2-add-extraCommandArgs | starting test step 2-add-extraCommandArgs logger.go:42: 11:10:09 | 1-115_validate_controller_extra_command_args/2-add-extraCommandArgs | ArgoCD:test-1-38-controller-extra-command/example-argocd updated === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:12 | 1-049_validate_parallelism_limit/2-check-deployment | test step completed 2-check-deployment logger.go:42: 11:10:12 | 1-049_validate_parallelism_limit/3-change-limit | starting test step 3-change-limit === CONT kuttl/harness/1-001_alpha_to_beta_dex_conversion logger.go:42: 11:10:12 | 1-001_alpha_to_beta_dex_conversion/1-argocd-dex | test step completed 1-argocd-dex logger.go:42: 11:10:12 | 1-001_alpha_to_beta_dex_conversion/2-delete | starting test step 2-delete === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:10:14 | 1-115_validate_controller_extra_command_args/2-add-extraCommandArgs | test step completed 2-add-extraCommandArgs logger.go:42: 11:10:14 | 1-115_validate_controller_extra_command_args/3-remove-extraCommandArgs | starting test step 3-remove-extraCommandArgs logger.go:42: 11:10:14 | 1-115_validate_controller_extra_command_args/3-remove-extraCommandArgs | running command: [sh -c oc patch -n test-1-38-controller-extra-command argocds/example-argocd --type=json --patch '[{"op": "remove", "path": "/spec/controller/extraCommandArgs"}]' ] === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:14 | 1-062_validate_extra_config/1-argocd-with-extraconfig | test step completed 1-argocd-with-extraconfig logger.go:42: 11:10:14 | 1-062_validate_extra_config/2-argocd-with-firstclass-and-extraconfig copy | starting test step 2-argocd-with-firstclass-and-extraconfig copy === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:14 | 1-049_validate_parallelism_limit/3-change-limit | ArgoCD:kuttl-test-meet-ox/argocd updated logger.go:42: 11:10:14 | 1-049_validate_parallelism_limit/3-change-limit | test step completed 3-change-limit logger.go:42: 11:10:14 | 1-049_validate_parallelism_limit/4-check-deployment | starting test step 4-check-deployment === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:10:15 | 1-115_validate_controller_extra_command_args/3-remove-extraCommandArgs | argocd.argoproj.io/example-argocd patched I0224 11:10:15.947280 121 request.go:682] Waited for 1.015554473s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/imageregistry.operator.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:17 | 1-049_validate_parallelism_limit/4-check-deployment | running command: [sh -c sleep 5] === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:17 | 1-062_validate_extra_config/2-argocd-with-firstclass-and-extraconfig copy | ArgoCD:kuttl-test-live-dassie/example-argocd updated === CONT kuttl/harness/1-001_alpha_to_beta_dex_conversion logger.go:42: 11:10:19 | 1-001_alpha_to_beta_dex_conversion/2-delete | test step completed 2-delete logger.go:42: 11:10:19 | 1-001_alpha_to_beta_dex_conversion | skipping kubernetes event logging logger.go:42: 11:10:19 | 1-001_alpha_to_beta_dex_conversion | Deleting namespace: kuttl-test-cheerful-krill === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:22 | 1-049_validate_parallelism_limit/4-check-deployment | running command: [sh -c set -e set -o pipefail expected=20 wlCommand=$(oc get -n $NAMESPACE statefulset/argocd-application-controller -o jsonpath='{.spec.template.spec.containers[0].command}'| jq -r '.[]' ) if ! echo "$wlCommand" | grep -qPz -- "--kubectl-parallelism-limit\\n${expected}(\$|\\n)"; then echo "Incorrect or missing --kubectl-parallelism-limit detected." echo "$wlCommand" exit 1 fi ] === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:10:22 | 1-115_validate_controller_extra_command_args/3-remove-extraCommandArgs | test step completed 3-remove-extraCommandArgs logger.go:42: 11:10:22 | 1-115_validate_controller_extra_command_args/4-override-cli-argument | starting test step 4-override-cli-argument === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:22 | 1-062_validate_extra_config/2-argocd-with-firstclass-and-extraconfig copy | test step completed 2-argocd-with-firstclass-and-extraconfig copy logger.go:42: 11:10:22 | 1-062_validate_extra_config/3-update-configmap | starting test step 3-update-configmap === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:10:24 | 1-115_validate_controller_extra_command_args/4-override-cli-argument | ArgoCD:test-1-38-controller-extra-command/example-argocd updated I0224 11:10:26.009135 121 request.go:682] Waited for 1.02422334s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s === CONT kuttl/harness/1-114_validate_server_sidecar === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:29 | 1-049_validate_parallelism_limit/4-check-deployment | test step completed 4-check-deployment logger.go:42: 11:10:29 | 1-049_validate_parallelism_limit/5-change-back-to-default | starting test step 5-change-back-to-default === CONT kuttl/harness/1-114_validate_server_sidecar logger.go:42: 11:10:29 | 1-114_validate_server_sidecar | Creating namespace: kuttl-test-assured-lion logger.go:42: 11:10:30 | 1-114_validate_server_sidecar/1-install | starting test step 1-install === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:30 | 1-062_validate_extra_config/3-update-configmap | ConfigMap:kuttl-test-live-dassie/argocd-cm updated === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:10:32 | 1-115_validate_controller_extra_command_args/4-override-cli-argument | test step completed 4-override-cli-argument logger.go:42: 11:10:32 | 1-115_validate_controller_extra_command_args/99-delete | starting test step 99-delete === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:32 | 1-049_validate_parallelism_limit/5-change-back-to-default | ArgoCD:kuttl-test-meet-ox/argocd updated logger.go:42: 11:10:32 | 1-049_validate_parallelism_limit/5-change-back-to-default | test step completed 5-change-back-to-default logger.go:42: 11:10:32 | 1-049_validate_parallelism_limit/6-check-deployment | starting test step 6-check-deployment logger.go:42: 11:10:35 | 1-049_validate_parallelism_limit/6-check-deployment | running command: [sh -c set -e oc patch -n $NAMESPACE argocds/argocd --type=json --patch '[{"op": "remove", "path": "/spec/controller/parallelismLimit"}]' ] === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:10:35 | 1-037_validate_argocd_setting_replicas/4- | test step completed 4- logger.go:42: 11:10:35 | 1-037_validate_argocd_setting_replicas/5-scale_in_server | starting test step 5-scale_in_server logger.go:42: 11:10:35 | 1-037_validate_argocd_setting_replicas/5-scale_in_server | running command: [sh -c oc patch argocd argocd \ -n $NAMESPACE \ --type='json' \ -p='[{"op": "replace", "path": "/spec/server/replicas", "value": 1 }]' exit 0 ] === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:35 | 1-062_validate_extra_config/3-update-configmap | test step completed 3-update-configmap logger.go:42: 11:10:35 | 1-062_validate_extra_config/4-create-dex-without-extraconfig | starting test step 4-create-dex-without-extraconfig === CONT kuttl/harness/1-114_validate_server_sidecar logger.go:42: 11:10:35 | 1-114_validate_server_sidecar/1-install | ArgoCD:kuttl-test-assured-lion/argocd created === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:35 | 1-049_validate_parallelism_limit/6-check-deployment | argocd.argoproj.io/argocd patched logger.go:42: 11:10:35 | 1-049_validate_parallelism_limit/6-check-deployment | running command: [sh -c sleep 5] === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:10:35 | 1-037_validate_argocd_setting_replicas/5-scale_in_server | argocd.argoproj.io/argocd patched I0224 11:10:36.181613 121 request.go:682] Waited for 1.038111429s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apps.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:37 | 1-062_validate_extra_config/4-create-dex-without-extraconfig | ArgoCD:kuttl-test-live-dassie/example-argocd updated === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:10:40 | 1-037_validate_argocd_setting_replicas/5-scale_in_server | test step completed 5-scale_in_server logger.go:42: 11:10:40 | 1-037_validate_argocd_setting_replicas/6-scale_in_repo | starting test step 6-scale_in_repo logger.go:42: 11:10:40 | 1-037_validate_argocd_setting_replicas/6-scale_in_repo | running command: [sh -c oc patch argocd argocd \ -n $NAMESPACE \ --type='json' \ -p='[{"op": "replace", "path": "/spec/repo/replicas", "value": 1 }]' exit 0 ] === CONT kuttl/harness/1-114_validate_server_sidecar logger.go:42: 11:10:40 | 1-114_validate_server_sidecar/1-install | test step completed 1-install logger.go:42: 11:10:40 | 1-114_validate_server_sidecar | skipping kubernetes event logging === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:40 | 1-062_validate_extra_config/4-create-dex-without-extraconfig | test step completed 4-create-dex-without-extraconfig logger.go:42: 11:10:40 | 1-062_validate_extra_config/5-override-dex-using-extraconfig | starting test step 5-override-dex-using-extraconfig === CONT kuttl/harness/1-114_validate_server_sidecar logger.go:42: 11:10:40 | 1-114_validate_server_sidecar | Deleting namespace: kuttl-test-assured-lion === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:10:40 | 1-037_validate_argocd_setting_replicas/6-scale_in_repo | argocd.argoproj.io/argocd patched === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:40 | 1-049_validate_parallelism_limit/6-check-deployment | running command: [sh -c set -e set -o pipefail expected=10 wlCommand=$(oc get -n $NAMESPACE statefulset/argocd-application-controller -o jsonpath='{.spec.template.spec.containers[0].command}'| jq -r '.[]' ) if ! echo "$wlCommand" | grep -qPz -- "--kubectl-parallelism-limit\\n${expected}(\$|\\n)"; then echo "Incorrect or missing --kubectl-parallelism-limit detected." echo "$wlCommand" exit 1 fi ] === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:42 | 1-062_validate_extra_config/5-override-dex-using-extraconfig | ArgoCD:kuttl-test-live-dassie/example-argocd updated === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:10:45 | 1-037_validate_argocd_setting_replicas/6-scale_in_repo | test step completed 6-scale_in_repo logger.go:42: 11:10:45 | 1-037_validate_argocd_setting_replicas/7- | starting test step 7- I0224 11:10:46.208421 121 request.go:682] Waited for 1.027921914s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/discovery.k8s.io/v1?timeout=32s === CONT kuttl/harness/1-113_validate_appcontroller_sidecar logger.go:42: 11:10:50 | 1-113_validate_appcontroller_sidecar | Creating namespace: kuttl-test-above-mudfish logger.go:42: 11:10:50 | 1-113_validate_appcontroller_sidecar/1-install | starting test step 1-install === CONT kuttl/harness/1-049_validate_parallelism_limit logger.go:42: 11:10:52 | 1-049_validate_parallelism_limit/6-check-deployment | test step completed 6-check-deployment logger.go:42: 11:10:52 | 1-049_validate_parallelism_limit | skipping kubernetes event logging logger.go:42: 11:10:52 | 1-049_validate_parallelism_limit | Deleting namespace: kuttl-test-meet-ox === CONT kuttl/harness/1-062_validate_extra_config logger.go:42: 11:10:52 | 1-062_validate_extra_config/5-override-dex-using-extraconfig | test step completed 5-override-dex-using-extraconfig logger.go:42: 11:10:52 | 1-062_validate_extra_config | skipping kubernetes event logging logger.go:42: 11:10:52 | 1-062_validate_extra_config | Deleting namespace: kuttl-test-live-dassie === CONT kuttl/harness/1-115_validate_controller_extra_command_args logger.go:42: 11:10:55 | 1-115_validate_controller_extra_command_args/99-delete | test step completed 99-delete logger.go:42: 11:10:55 | 1-115_validate_controller_extra_command_args | skipping kubernetes event logging logger.go:42: 11:10:55 | 1-115_validate_controller_extra_command_args | Deleting namespace: kuttl-test-probable-hornet === CONT kuttl/harness/1-113_validate_appcontroller_sidecar logger.go:42: 11:10:55 | 1-113_validate_appcontroller_sidecar/1-install | ArgoCD:kuttl-test-above-mudfish/argocd created === CONT kuttl/harness/1-037_validate_argocd_setting_replicas logger.go:42: 11:10:55 | 1-037_validate_argocd_setting_replicas/7- | test step completed 7- logger.go:42: 11:10:55 | 1-037_validate_argocd_setting_replicas | skipping kubernetes event logging logger.go:42: 11:10:55 | 1-037_validate_argocd_setting_replicas | Deleting namespace: kuttl-test-unbiased-husky === CONT kuttl/harness/1-113_validate_appcontroller_sidecar logger.go:42: 11:10:56 | 1-113_validate_appcontroller_sidecar/1-install | test step completed 1-install logger.go:42: 11:10:56 | 1-113_validate_appcontroller_sidecar | skipping kubernetes event logging logger.go:42: 11:10:56 | 1-113_validate_appcontroller_sidecar | Deleting namespace: kuttl-test-above-mudfish === CONT kuttl/harness/1-112_validate_server_initcontainers logger.go:42: 11:10:58 | 1-112_validate_server_initcontainers | Creating namespace: kuttl-test-legal-ox logger.go:42: 11:10:58 | 1-112_validate_server_initcontainers/1-install | starting test step 1-install === CONT kuttl/harness/1-111_validate_appcontroller_initcontainers I0224 11:10:59.800600 121 request.go:682] Waited for 1.028134945s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/monitoring.coreos.com/v1?timeout=32s === CONT kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance 2025/02/24 11:11:01 object detected with no GVK Kind for path /kuttl-e2e/gitops-operator/tests/parallel/1-108_alternate_cluster_roles_cluster_scoped_instance/04-create-app.yaml === CONT kuttl/harness/1-111_validate_appcontroller_initcontainers logger.go:42: 11:11:01 | 1-111_validate_appcontroller_initcontainers | Creating namespace: kuttl-test-careful-katydid === CONT kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance logger.go:42: 11:11:01 | 1-108_alternate_cluster_roles_cluster_scoped_instance | Creating namespace: kuttl-test-popular-tick === CONT kuttl/harness/1-111_validate_appcontroller_initcontainers logger.go:42: 11:11:01 | 1-111_validate_appcontroller_initcontainers/1-install | starting test step 1-install === CONT kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance logger.go:42: 11:11:01 | 1-108_alternate_cluster_roles_cluster_scoped_instance/1-create-ns | starting test step 1-create-ns === CONT kuttl/harness/1-112_validate_server_initcontainers logger.go:42: 11:11:01 | 1-112_validate_server_initcontainers/1-install | ArgoCD:kuttl-test-legal-ox/argocd created === CONT kuttl/harness/1-107_host_attribute_sso_provider === CONT kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount === CONT kuttl/harness/1-111_validate_appcontroller_initcontainers logger.go:42: 11:11:03 | 1-111_validate_appcontroller_initcontainers/1-install | ArgoCD:kuttl-test-careful-katydid/argocd created === CONT kuttl/harness/1-107_host_attribute_sso_provider logger.go:42: 11:11:06 | 1-107_host_attribute_sso_provider | Creating namespace: kuttl-test-humble-mite === CONT kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:11:06 | 1-104_validate_applicationset_tls_scm_volume_mount | Creating namespace: kuttl-test-secure-chigger === CONT kuttl/harness/1-107_host_attribute_sso_provider logger.go:42: 11:11:06 | 1-107_host_attribute_sso_provider/1-install | starting test step 1-install === CONT kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:11:06 | 1-104_validate_applicationset_tls_scm_volume_mount/1-install | starting test step 1-install === CONT kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance logger.go:42: 11:11:06 | 1-108_alternate_cluster_roles_cluster_scoped_instance/1-create-ns | Namespace:/alternate-role created === CONT kuttl/harness/1-107_host_attribute_sso_provider logger.go:42: 11:11:08 | 1-107_host_attribute_sso_provider/1-install | ArgoCD:kuttl-test-humble-mite/example-argocd-keycloak created I0224 11:11:09.890854 121 request.go:682] Waited for 1.028650627s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v2?timeout=32s === CONT kuttl/harness/1-112_validate_server_initcontainers logger.go:42: 11:11:11 | 1-112_validate_server_initcontainers/1-install | test step completed 1-install logger.go:42: 11:11:11 | 1-112_validate_server_initcontainers | skipping kubernetes event logging === CONT kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance logger.go:42: 11:11:11 | 1-108_alternate_cluster_roles_cluster_scoped_instance/1-create-ns | test step completed 1-create-ns logger.go:42: 11:11:11 | 1-108_alternate_cluster_roles_cluster_scoped_instance/2-edit-subscription | starting test step 2-edit-subscription logger.go:42: 11:11:11 | 1-108_alternate_cluster_roles_cluster_scoped_instance/2-edit-subscription | running command: [sh -c oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "ARGOCD_CLUSTER_CONFIG_NAMESPACES", "value": "openshift-gitops, alternate-role"}]}}}' ] === CONT kuttl/harness/1-111_validate_appcontroller_initcontainers logger.go:42: 11:11:11 | 1-111_validate_appcontroller_initcontainers/1-install | test step completed 1-install logger.go:42: 11:11:11 | 1-111_validate_appcontroller_initcontainers | skipping kubernetes event logging === CONT kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:11:11 | 1-104_validate_applicationset_tls_scm_volume_mount/1-install | Namespace:/test-1-104-appsets-scm-tls-mount created === CONT kuttl/harness/1-111_validate_appcontroller_initcontainers logger.go:42: 11:11:11 | 1-111_validate_appcontroller_initcontainers | Deleting namespace: kuttl-test-careful-katydid === CONT kuttl/harness/1-112_validate_server_initcontainers logger.go:42: 11:11:11 | 1-112_validate_server_initcontainers | Deleting namespace: kuttl-test-legal-ox === CONT kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:11:11 | 1-104_validate_applicationset_tls_scm_volume_mount/1-install | ConfigMap:test-1-104-appsets-scm-tls-mount/test-1-104-appsets-scm-tls-cm created logger.go:42: 11:11:11 | 1-104_validate_applicationset_tls_scm_volume_mount/1-install | ArgoCD:test-1-104-appsets-scm-tls-mount/argocd created === CONT kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance logger.go:42: 11:11:11 | 1-108_alternate_cluster_roles_cluster_scoped_instance/2-edit-subscription | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found case.go:364: failed in step 2-edit-subscription case.go:366: exit status 1 logger.go:42: 11:11:14 | 1-108_alternate_cluster_roles_cluster_scoped_instance | skipping kubernetes event logging logger.go:42: 11:11:14 | 1-108_alternate_cluster_roles_cluster_scoped_instance | Deleting namespace: kuttl-test-popular-tick === CONT kuttl/harness/1-103_argocd_alpha_to_beta_conversion === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces === CONT kuttl/harness/1-103_argocd_alpha_to_beta_conversion logger.go:42: 11:11:17 | 1-103_argocd_alpha_to_beta_conversion | Creating namespace: kuttl-test-up-gibbon === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:11:17 | 1-102_validate_handle_terminating_namespaces | Creating namespace: kuttl-test-wealthy-malamute === CONT kuttl/harness/1-103_argocd_alpha_to_beta_conversion logger.go:42: 11:11:17 | 1-103_argocd_alpha_to_beta_conversion/1-alpha_argocd | starting test step 1-alpha_argocd === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:11:17 | 1-102_validate_handle_terminating_namespaces/1-install | starting test step 1-install I0224 11:11:19.918399 121 request.go:682] Waited for 2.429650506s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s === CONT kuttl/harness/1-103_argocd_alpha_to_beta_conversion logger.go:42: 11:11:20 | 1-103_argocd_alpha_to_beta_conversion/1-alpha_argocd | ArgoCD:kuttl-test-up-gibbon/argocd created === CONT kuttl/harness/1-099_validate_server_autoscale logger.go:42: 11:11:22 | 1-099_validate_server_autoscale | Creating namespace: kuttl-test-cheerful-beetle logger.go:42: 11:11:22 | 1-099_validate_server_autoscale/1-install | starting test step 1-install === CONT kuttl/harness/1-107_host_attribute_sso_provider logger.go:42: 11:11:22 | 1-107_host_attribute_sso_provider/1-install | test step completed 1-install logger.go:42: 11:11:22 | 1-107_host_attribute_sso_provider | skipping kubernetes event logging === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:11:22 | 1-102_validate_handle_terminating_namespaces/1-install | Namespace:/gitops-service-argocd created === CONT kuttl/harness/1-107_host_attribute_sso_provider logger.go:42: 11:11:22 | 1-107_host_attribute_sso_provider | Deleting namespace: kuttl-test-humble-mite === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:11:25 | 1-102_validate_handle_terminating_namespaces/1-install | test step completed 1-install logger.go:42: 11:11:25 | 1-102_validate_handle_terminating_namespaces/2-install | starting test step 2-install === CONT kuttl/harness/1-099_validate_server_autoscale logger.go:42: 11:11:25 | 1-099_validate_server_autoscale/1-install | ArgoCD:kuttl-test-cheerful-beetle/example-argocd created === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:11:27 | 1-102_validate_handle_terminating_namespaces/2-install | ArgoCD:gitops-service-argocd/gitops-service-argocd created logger.go:42: 11:11:27 | 1-102_validate_handle_terminating_namespaces/2-install | Namespace:/jane created logger.go:42: 11:11:27 | 1-102_validate_handle_terminating_namespaces/2-install | ConfigMap:jane/my-config-map-2 created === CONT kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:11:43 | 1-104_validate_applicationset_tls_scm_volume_mount/1-install | test step completed 1-install logger.go:42: 11:11:43 | 1-104_validate_applicationset_tls_scm_volume_mount/99-delete | starting test step 99-delete === CONT kuttl/harness/1-103_argocd_alpha_to_beta_conversion logger.go:42: 11:11:51 | 1-103_argocd_alpha_to_beta_conversion/1-alpha_argocd | test step completed 1-alpha_argocd logger.go:42: 11:11:51 | 1-103_argocd_alpha_to_beta_conversion/2-delete | starting test step 2-delete I0224 11:11:53.166649 121 request.go:682] Waited for 1.029151236s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/project.openshift.io/v1?timeout=32s logger.go:42: 11:11:54 | 1-103_argocd_alpha_to_beta_conversion/2-delete | test step completed 2-delete logger.go:42: 11:11:54 | 1-103_argocd_alpha_to_beta_conversion | skipping kubernetes event logging logger.go:42: 11:11:54 | 1-103_argocd_alpha_to_beta_conversion | Deleting namespace: kuttl-test-up-gibbon === CONT kuttl/harness/1-099_validate_server_autoscale logger.go:42: 11:11:57 | 1-099_validate_server_autoscale/1-install | test step completed 1-install logger.go:42: 11:11:57 | 1-099_validate_server_autoscale/2-enable-server-autoscale | starting test step 2-enable-server-autoscale logger.go:42: 11:12:00 | 1-099_validate_server_autoscale/2-enable-server-autoscale | ArgoCD:kuttl-test-cheerful-beetle/example-argocd updated logger.go:42: 11:12:00 | 1-099_validate_server_autoscale/2-enable-server-autoscale | test step completed 2-enable-server-autoscale logger.go:42: 11:12:00 | 1-099_validate_server_autoscale/3-check-server-replicas | starting test step 3-check-server-replicas logger.go:42: 11:12:00 | 1-099_validate_server_autoscale/3-check-server-replicas | running command: [sh -c sleep 45] === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:12:00 | 1-102_validate_handle_terminating_namespaces/2-install | test step completed 2-install logger.go:42: 11:12:00 | 1-102_validate_handle_terminating_namespaces/3-delete-ns | starting test step 3-delete-ns logger.go:42: 11:12:00 | 1-102_validate_handle_terminating_namespaces/3-delete-ns | running command: [kubectl delete ns jane] logger.go:42: 11:12:00 | 1-102_validate_handle_terminating_namespaces/3-delete-ns | namespace "jane" deleted === CONT kuttl/harness/1-098_validate_dex_clientsecret_deprecated logger.go:42: 11:12:00 | 1-098_validate_dex_clientsecret_deprecated | Creating namespace: kuttl-test-healthy-alien logger.go:42: 11:12:00 | 1-098_validate_dex_clientsecret_deprecated/1-install | starting test step 1-install I0224 11:12:03.173423 121 request.go:682] Waited for 2.32895374s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v2?timeout=32s logger.go:42: 11:12:03 | 1-098_validate_dex_clientsecret_deprecated/1-install | ArgoCD:kuttl-test-healthy-alien/example-argocd created logger.go:42: 11:12:15 | 1-098_validate_dex_clientsecret_deprecated/1-install | test step completed 1-install logger.go:42: 11:12:15 | 1-098_validate_dex_clientsecret_deprecated/2-verify-clientsecret | starting test step 2-verify-clientsecret logger.go:42: 11:12:15 | 1-098_validate_dex_clientsecret_deprecated/2-verify-clientsecret | running command: [sh -c # This test validates the Dex Client Secret copied by the operator from dex serviceaccount token secret in to argocd-secret. # To verify the behavior we should first get the token secret name of the dex service account. secret=$(oc get -n $NAMESPACE sa example-argocd-argocd-dex-server -o json | jq -r '.secrets' | grep token | sed 's/ "name": "//g' | sed 's/"//g') # Extract the clientSecret expectedClientSecret=$(oc get secret $secret -n $NAMESPACE -o json | jq -r '.data.token') # actualClientSecret is the value of the secret in argocd-secret where argocd-operator should copy the secret from actualClientSecret=$(oc get secret argocd-secret -o json -n $NAMESPACE | jq -r '.data."oidc.dex.clientSecret"') # Verify if [[ ${expectedClientSecret} != ${actualClientSecret} ]]; then echo "Error: Dex Client Secret for OIDC is not valid" exit 1 fi ] I0224 11:12:18.250313 121 request.go:682] Waited for 1.026021809s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/argoproj.io/v1beta1?timeout=32s logger.go:42: 11:12:19 | 1-098_validate_dex_clientsecret_deprecated/2-verify-clientsecret | test step completed 2-verify-clientsecret logger.go:42: 11:12:19 | 1-098_validate_dex_clientsecret_deprecated | skipping kubernetes event logging logger.go:42: 11:12:19 | 1-098_validate_dex_clientsecret_deprecated | Deleting namespace: kuttl-test-healthy-alien === CONT kuttl/harness/1-096-validate_home_env_argocd_controller logger.go:42: 11:12:25 | 1-096-validate_home_env_argocd_controller | Creating namespace: kuttl-test-clever-tahr logger.go:42: 11:12:25 | 1-096-validate_home_env_argocd_controller/1- | starting test step 1- I0224 11:12:28.293296 121 request.go:682] Waited for 2.479549697s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s logger.go:42: 11:12:28 | 1-096-validate_home_env_argocd_controller/1- | test step completed 1- logger.go:42: 11:12:28 | 1-096-validate_home_env_argocd_controller | skipping kubernetes event logging logger.go:42: 11:12:28 | 1-096-validate_home_env_argocd_controller | Deleting namespace: kuttl-test-clever-tahr === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:12:32 | 1-102_validate_handle_terminating_namespaces/3-delete-ns | test step completed 3-delete-ns logger.go:42: 11:12:32 | 1-102_validate_handle_terminating_namespaces/4-create-ns | starting test step 4-create-ns === CONT kuttl/harness/1-095_validate_dex_clientsecret logger.go:42: 11:12:35 | 1-095_validate_dex_clientsecret | Creating namespace: kuttl-test-primary-pegasus logger.go:42: 11:12:35 | 1-095_validate_dex_clientsecret/1-install | starting test step 1-install === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:12:35 | 1-102_validate_handle_terminating_namespaces/4-create-ns | Namespace:/john created logger.go:42: 11:12:37 | 1-102_validate_handle_terminating_namespaces/4-create-ns | test step completed 4-create-ns logger.go:42: 11:12:37 | 1-102_validate_handle_terminating_namespaces/5-create-app | starting test step 5-create-app === CONT kuttl/harness/1-095_validate_dex_clientsecret logger.go:42: 11:12:37 | 1-095_validate_dex_clientsecret/1-install | ArgoCD:kuttl-test-primary-pegasus/example-argocd created I0224 11:12:38.952021 121 request.go:682] Waited for 1.025561682s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/route.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:12:40 | 1-102_validate_handle_terminating_namespaces/5-create-app | Application:gitops-service-argocd/my-app created === CONT kuttl/harness/1-092_validate_workload_status_monitoring_alert logger.go:42: 11:12:43 | 1-092_validate_workload_status_monitoring_alert | Creating namespace: kuttl-test-flexible-eel logger.go:42: 11:12:43 | 1-092_validate_workload_status_monitoring_alert/1-install | starting test step 1-install === CONT kuttl/harness/1-099_validate_server_autoscale logger.go:42: 11:12:45 | 1-099_validate_server_autoscale/3-check-server-replicas | running command: [sh -c set -e serverReplicas=$(kubectl get -n $NAMESPACE deployment/example-argocd-server -o jsonpath='{.spec.replicas}') if [ "$serverReplicas" -ge 4 ] && [ "$serverReplicas" -le 7 ]; then echo "server replica count matches expectation" exit 0 fi exit 1 done ] logger.go:42: 11:12:45 | 1-099_validate_server_autoscale/3-check-server-replicas | server replica count matches expectation === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:12:46 | 1-102_validate_handle_terminating_namespaces/5-create-app | test step completed 5-create-app logger.go:42: 11:12:46 | 1-102_validate_handle_terminating_namespaces/99-delete | starting test step 99-delete === CONT kuttl/harness/1-092_validate_workload_status_monitoring_alert logger.go:42: 11:12:46 | 1-092_validate_workload_status_monitoring_alert/1-install | ArgoCD:kuttl-test-flexible-eel/argocd created === CONT kuttl/harness/1-099_validate_server_autoscale logger.go:42: 11:12:48 | 1-099_validate_server_autoscale/3-check-server-replicas | test step completed 3-check-server-replicas logger.go:42: 11:12:48 | 1-099_validate_server_autoscale/4-update-hpa | starting test step 4-update-hpa I0224 11:12:50.004660 121 request.go:682] Waited for 1.0281938s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha2?timeout=32s logger.go:42: 11:12:51 | 1-099_validate_server_autoscale/4-update-hpa | ArgoCD:kuttl-test-cheerful-beetle/example-argocd updated logger.go:42: 11:12:52 | 1-099_validate_server_autoscale/4-update-hpa | test step completed 4-update-hpa logger.go:42: 11:12:52 | 1-099_validate_server_autoscale | skipping kubernetes event logging logger.go:42: 11:12:52 | 1-099_validate_server_autoscale | Deleting namespace: kuttl-test-cheerful-beetle === CONT kuttl/harness/1-091_argocd_app_validate-applicationset-status logger.go:42: 11:12:58 | 1-091_argocd_app_validate-applicationset-status | Creating namespace: kuttl-test-devoted-tortoise logger.go:42: 11:12:58 | 1-091_argocd_app_validate-applicationset-status/1-install | starting test step 1-install I0224 11:13:00.015275 121 request.go:682] Waited for 1.127220629s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machine.openshift.io/v1beta1?timeout=32s logger.go:42: 11:13:01 | 1-091_argocd_app_validate-applicationset-status/1-install | ArgoCD:kuttl-test-devoted-tortoise/example-argocd created logger.go:42: 11:13:02 | 1-091_argocd_app_validate-applicationset-status/1-install | test step completed 1-install logger.go:42: 11:13:02 | 1-091_argocd_app_validate-applicationset-status/2-enable-appset | starting test step 2-enable-appset === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:13:03 | 1-102_validate_handle_terminating_namespaces/99-delete | running command: [sh -c oc patch cm/my-config-map-2 -n jane --type json --patch='[ { "op": "remove", "path": "/metadata/finalizers" }]'] ] logger.go:42: 11:13:04 | 1-102_validate_handle_terminating_namespaces/99-delete | configmap/my-config-map-2 patched === CONT kuttl/harness/1-091_argocd_app_validate-applicationset-status logger.go:42: 11:13:05 | 1-091_argocd_app_validate-applicationset-status/2-enable-appset | ArgoCD:kuttl-test-devoted-tortoise/example-argocd updated === CONT kuttl/harness/1-102_validate_handle_terminating_namespaces logger.go:42: 11:13:07 | 1-102_validate_handle_terminating_namespaces/99-delete | test step completed 99-delete logger.go:42: 11:13:07 | 1-102_validate_handle_terminating_namespaces | skipping kubernetes event logging logger.go:42: 11:13:07 | 1-102_validate_handle_terminating_namespaces | Deleting namespace: kuttl-test-wealthy-malamute === CONT kuttl/harness/1-091_argocd_app_validate-applicationset-status logger.go:42: 11:13:08 | 1-091_argocd_app_validate-applicationset-status/2-enable-appset | test step completed 2-enable-appset logger.go:42: 11:13:08 | 1-091_argocd_app_validate-applicationset-status/3-change-appset-image | starting test step 3-change-appset-image I0224 11:13:10.022395 121 request.go:682] Waited for 1.479276786s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-095_validate_dex_clientsecret logger.go:42: 11:13:11 | 1-095_validate_dex_clientsecret/1-install | test step completed 1-install logger.go:42: 11:13:11 | 1-095_validate_dex_clientsecret/2-check-clientSecret-cm | starting test step 2-check-clientSecret-cm logger.go:42: 11:13:11 | 1-095_validate_dex_clientsecret/2-check-clientSecret-cm | running command: [sh -c clientSecret=$(oc get configmap argocd-cm -n $NAMESPACE -o jsonpath='{.data.dex\.config}' | grep clientSecret | awk -F' ' '{print $2}') if test "$clientSecret" != "\$oidc.dex.clientSecret"; then echo "Client secret exposed!" exit 1 fi exit 0 ] === CONT kuttl/harness/1-091_argocd_app_validate-applicationset-status logger.go:42: 11:13:11 | 1-091_argocd_app_validate-applicationset-status/3-change-appset-image | ArgoCD:kuttl-test-devoted-tortoise/example-argocd updated logger.go:42: 11:13:11 | 1-091_argocd_app_validate-applicationset-status/3-change-appset-image | test step completed 3-change-appset-image logger.go:42: 11:13:11 | 1-091_argocd_app_validate-applicationset-status/4-delete-exisiting-deployment | starting test step 4-delete-exisiting-deployment logger.go:42: 11:13:11 | 1-091_argocd_app_validate-applicationset-status/4-delete-exisiting-deployment | running command: [kubectl delete deployment example-argocd-applicationset-controller -n kuttl-test-devoted-tortoise] logger.go:42: 11:13:11 | 1-091_argocd_app_validate-applicationset-status/4-delete-exisiting-deployment | deployment.apps "example-argocd-applicationset-controller" deleted === CONT kuttl/harness/1-090_validate_permissions === CONT kuttl/harness/1-095_validate_dex_clientsecret logger.go:42: 11:13:14 | 1-095_validate_dex_clientsecret/2-check-clientSecret-cm | test step completed 2-check-clientSecret-cm logger.go:42: 11:13:14 | 1-095_validate_dex_clientsecret/3-verify-clientsecret-secret | starting test step 3-verify-clientsecret-secret logger.go:42: 11:13:14 | 1-095_validate_dex_clientsecret/3-verify-clientsecret-secret | running command: [sh -c # This test validates the Dex Client Secret copied by the operator from dex serviceaccount token secret in to argocd-secret. # To verify the behavior we should first get the token secret name of the dex service account. secret=$(oc get -n $NAMESPACE sa example-argocd-argocd-dex-server -o json | jq -r '.secrets[] | select(.name | contains("token")) | .name') # Extract the clientSecret expectedClientSecret=$(oc get secret $secret -n $NAMESPACE -o json | jq -r '.data.token') # actualClientSecret is the value of the secret in argocd-secret where argocd-operator should copy the secret from actualClientSecret=$(oc get secret argocd-secret -o json -n $NAMESPACE | jq -r '.data."oidc.dex.clientSecret"') # Verify if [[ $expectedClientSecret != $actualClientSecret ]]; then echo "Error: Dex Client Secret for OIDC is not valid" exit 1 fi ] === CONT kuttl/harness/1-090_validate_permissions logger.go:42: 11:13:16 | 1-090_validate_permissions | Creating namespace: kuttl-test-darling-jay logger.go:42: 11:13:16 | 1-090_validate_permissions/1- | starting test step 1- === CONT kuttl/harness/1-091_argocd_app_validate-applicationset-status logger.go:42: 11:13:16 | 1-091_argocd_app_validate-applicationset-status/4-delete-exisiting-deployment | test step completed 4-delete-exisiting-deployment logger.go:42: 11:13:16 | 1-091_argocd_app_validate-applicationset-status | skipping kubernetes event logging logger.go:42: 11:13:16 | 1-091_argocd_app_validate-applicationset-status | Deleting namespace: kuttl-test-devoted-tortoise === CONT kuttl/harness/1-095_validate_dex_clientsecret logger.go:42: 11:13:19 | 1-095_validate_dex_clientsecret/3-verify-clientsecret-secret | test step completed 3-verify-clientsecret-secret logger.go:42: 11:13:19 | 1-095_validate_dex_clientsecret | skipping kubernetes event logging logger.go:42: 11:13:19 | 1-095_validate_dex_clientsecret | Deleting namespace: kuttl-test-primary-pegasus I0224 11:13:20.451044 121 request.go:682] Waited for 1.028986153s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-090_validate_permissions logger.go:42: 11:13:21 | 1-090_validate_permissions/1- | test step completed 1- logger.go:42: 11:13:21 | 1-090_validate_permissions/2- | starting test step 2- === CONT kuttl/harness/1-092_validate_workload_status_monitoring_alert logger.go:42: 11:13:21 | 1-092_validate_workload_status_monitoring_alert/1-install | test step completed 1-install logger.go:42: 11:13:21 | 1-092_validate_workload_status_monitoring_alert/2-verify-alert | starting test step 2-verify-alert === CONT kuttl/harness/1-089_validate_extra_repo_commands_args logger.go:42: 11:13:24 | 1-089_validate_extra_repo_commands_args | Creating namespace: kuttl-test-active-sunbird === CONT kuttl/harness/1-092_validate_workload_status_monitoring_alert logger.go:42: 11:13:24 | 1-092_validate_workload_status_monitoring_alert/2-verify-alert | running command: [sh -c sleep 7m] === CONT kuttl/harness/1-089_validate_extra_repo_commands_args logger.go:42: 11:13:24 | 1-089_validate_extra_repo_commands_args/1-basic-argocd-install | starting test step 1-basic-argocd-install === CONT kuttl/harness/1-090_validate_permissions logger.go:42: 11:13:24 | 1-090_validate_permissions/2- | test step completed 2- logger.go:42: 11:13:24 | 1-090_validate_permissions | skipping kubernetes event logging logger.go:42: 11:13:24 | 1-090_validate_permissions | Deleting namespace: kuttl-test-darling-jay === CONT kuttl/harness/1-088_validate_applicationset_add_env_vars logger.go:42: 11:13:26 | 1-088_validate_applicationset_add_env_vars | Creating namespace: kuttl-test-top-fawn logger.go:42: 11:13:27 | 1-088_validate_applicationset_add_env_vars/1-basic-argocd-install | starting test step 1-basic-argocd-install === CONT kuttl/harness/1-089_validate_extra_repo_commands_args logger.go:42: 11:13:27 | 1-089_validate_extra_repo_commands_args/1-basic-argocd-install | Namespace:/test-1-89-repo-extra-command created logger.go:42: 11:13:27 | 1-089_validate_extra_repo_commands_args/1-basic-argocd-install | ArgoCD:test-1-89-repo-extra-command/example-argocd created === CONT kuttl/harness/1-088_validate_applicationset_add_env_vars logger.go:42: 11:13:29 | 1-088_validate_applicationset_add_env_vars/1-basic-argocd-install | ArgoCD:kuttl-test-top-fawn/example-argocd created === CONT kuttl/harness/1-087_validate_repo_server_settings logger.go:42: 11:13:30 | 1-087_validate_repo_server_settings | Creating namespace: kuttl-test-closing-koala logger.go:42: 11:13:30 | 1-087_validate_repo_server_settings/1-install | starting test step 1-install I0224 11:13:31.500725 121 request.go:682] Waited for 1.027928732s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v1?timeout=32s logger.go:42: 11:13:33 | 1-087_validate_repo_server_settings/1-install | ArgoCD:kuttl-test-closing-koala/example-argocd created I0224 11:13:47.824841 121 request.go:682] Waited for 1.028954409s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/admissionregistration.k8s.io/v1?timeout=32s === CONT kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:13:49 | 1-104_validate_applicationset_tls_scm_volume_mount/99-delete | test step completed 99-delete logger.go:42: 11:13:49 | 1-104_validate_applicationset_tls_scm_volume_mount | skipping kubernetes event logging logger.go:42: 11:13:49 | 1-104_validate_applicationset_tls_scm_volume_mount | Deleting namespace: kuttl-test-secure-chigger === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:13:55 | 1-061_validate_resource_tracking_method | Creating namespace: kuttl-test-vast-shark logger.go:42: 11:13:55 | 1-061_validate_resource_tracking_method/1-install | starting test step 1-install logger.go:42: 11:13:57 | 1-061_validate_resource_tracking_method/1-install | ArgoCD:kuttl-test-vast-shark/argocd created === CONT kuttl/harness/1-089_validate_extra_repo_commands_args logger.go:42: 11:13:59 | 1-089_validate_extra_repo_commands_args/1-basic-argocd-install | test step completed 1-basic-argocd-install logger.go:42: 11:13:59 | 1-089_validate_extra_repo_commands_args/2-add-extraRepoCommandArgs | starting test step 2-add-extraRepoCommandArgs I0224 11:14:00.854639 121 request.go:682] Waited for 1.029212987s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machine.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-088_validate_applicationset_add_env_vars logger.go:42: 11:14:02 | 1-088_validate_applicationset_add_env_vars/1-basic-argocd-install | test step completed 1-basic-argocd-install logger.go:42: 11:14:02 | 1-088_validate_applicationset_add_env_vars/2-add-env-vars | starting test step 2-add-env-vars === CONT kuttl/harness/1-089_validate_extra_repo_commands_args logger.go:42: 11:14:02 | 1-089_validate_extra_repo_commands_args/2-add-extraRepoCommandArgs | ArgoCD:test-1-89-repo-extra-command/example-argocd updated logger.go:42: 11:14:04 | 1-089_validate_extra_repo_commands_args/2-add-extraRepoCommandArgs | test step completed 2-add-extraRepoCommandArgs logger.go:42: 11:14:04 | 1-089_validate_extra_repo_commands_args/99-delete | starting test step 99-delete === CONT kuttl/harness/1-087_validate_repo_server_settings logger.go:42: 11:14:04 | 1-087_validate_repo_server_settings/1-install | test step completed 1-install logger.go:42: 11:14:04 | 1-087_validate_repo_server_settings/2-modify-argocd | starting test step 2-modify-argocd === CONT kuttl/harness/1-088_validate_applicationset_add_env_vars logger.go:42: 11:14:04 | 1-088_validate_applicationset_add_env_vars/2-add-env-vars | ArgoCD:kuttl-test-top-fawn/example-argocd updated logger.go:42: 11:14:07 | 1-088_validate_applicationset_add_env_vars/2-add-env-vars | test step completed 2-add-env-vars logger.go:42: 11:14:07 | 1-088_validate_applicationset_add_env_vars | skipping kubernetes event logging logger.go:42: 11:14:07 | 1-088_validate_applicationset_add_env_vars | Deleting namespace: kuttl-test-top-fawn === CONT kuttl/harness/1-087_validate_repo_server_settings logger.go:42: 11:14:07 | 1-087_validate_repo_server_settings/2-modify-argocd | ArgoCD:kuttl-test-closing-koala/example-argocd updated logger.go:42: 11:14:08 | 1-087_validate_repo_server_settings/2-modify-argocd | test step completed 2-modify-argocd logger.go:42: 11:14:08 | 1-087_validate_repo_server_settings/4-modify-serviceaccount | starting test step 4-modify-serviceaccount I0224 11:14:10.895210 121 request.go:682] Waited for 2.378306845s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1?timeout=32s === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:14:11 | 1-061_validate_resource_tracking_method/1-install | test step completed 1-install logger.go:42: 11:14:11 | 1-061_validate_resource_tracking_method/2-patch_cm_annotation | starting test step 2-patch_cm_annotation logger.go:42: 11:14:11 | 1-061_validate_resource_tracking_method/2-patch_cm_annotation | running command: [sh -c set -e oc patch argocds.argoproj.io argocd --type=merge -p '{"spec":{"resourceTrackingMethod":"annotation"}}' -n $NAMESPACE ] === CONT kuttl/harness/1-087_validate_repo_server_settings logger.go:42: 11:14:11 | 1-087_validate_repo_server_settings/4-modify-serviceaccount | ServiceAccount:kuttl-test-closing-koala/modified-default created logger.go:42: 11:14:11 | 1-087_validate_repo_server_settings/4-modify-serviceaccount | ArgoCD:kuttl-test-closing-koala/example-argocd updated === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:14:11 | 1-061_validate_resource_tracking_method/2-patch_cm_annotation | argocd.argoproj.io/argocd patched === CONT kuttl/harness/1-086_validate_applicationset_extra_command_args logger.go:42: 11:14:14 | 1-086_validate_applicationset_extra_command_args | Creating namespace: kuttl-test-picked-escargot logger.go:42: 11:14:14 | 1-086_validate_applicationset_extra_command_args/1-basic-argocd-install | starting test step 1-basic-argocd-install === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:14:14 | 1-061_validate_resource_tracking_method/2-patch_cm_annotation | test step completed 2-patch_cm_annotation logger.go:42: 11:14:14 | 1-061_validate_resource_tracking_method/3-patch_cm_annotation_label | starting test step 3-patch_cm_annotation_label === CONT kuttl/harness/1-087_validate_repo_server_settings logger.go:42: 11:14:14 | 1-087_validate_repo_server_settings/4-modify-serviceaccount | test step completed 4-modify-serviceaccount logger.go:42: 11:14:14 | 1-087_validate_repo_server_settings/5-reset-repo-settings | starting test step 5-reset-repo-settings === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:14:16 | 1-061_validate_resource_tracking_method/3-patch_cm_annotation_label | running command: [sh -c set -e oc patch argocds.argoproj.io argocd --type=merge -p '{"spec":{"resourceTrackingMethod":"annotation+label"}}' -n $NAMESPACE ] === CONT kuttl/harness/1-086_validate_applicationset_extra_command_args logger.go:42: 11:14:16 | 1-086_validate_applicationset_extra_command_args/1-basic-argocd-install | Namespace:/test-1-86-appsets-extra-command created logger.go:42: 11:14:16 | 1-086_validate_applicationset_extra_command_args/1-basic-argocd-install | ArgoCD:test-1-86-appsets-extra-command/example-argocd created === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:14:17 | 1-061_validate_resource_tracking_method/3-patch_cm_annotation_label | argocd.argoproj.io/argocd patched === CONT kuttl/harness/1-087_validate_repo_server_settings logger.go:42: 11:14:19 | 1-087_validate_repo_server_settings/5-reset-repo-settings | ArgoCD:kuttl-test-closing-koala/example-argocd updated I0224 11:14:20.899262 121 request.go:682] Waited for 1.528629492s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/ingress.operator.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-089_validate_extra_repo_commands_args logger.go:42: 11:14:21 | 1-089_validate_extra_repo_commands_args/99-delete | test step completed 99-delete logger.go:42: 11:14:21 | 1-089_validate_extra_repo_commands_args | skipping kubernetes event logging logger.go:42: 11:14:21 | 1-089_validate_extra_repo_commands_args | Deleting namespace: kuttl-test-active-sunbird === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:14:24 | 1-061_validate_resource_tracking_method/3-patch_cm_annotation_label | test step completed 3-patch_cm_annotation_label logger.go:42: 11:14:24 | 1-061_validate_resource_tracking_method/4-patch_cm_invalid_method | starting test step 4-patch_cm_invalid_method logger.go:42: 11:14:24 | 1-061_validate_resource_tracking_method/4-patch_cm_invalid_method | running command: [sh -c set -e oc patch argocds.argoproj.io argocd --type=merge -p '{"spec":{"resourceTrackingMethod":"invalid_method"}}' -n $NAMESPACE ] === CONT kuttl/harness/1-087_validate_repo_server_settings logger.go:42: 11:14:24 | 1-087_validate_repo_server_settings/5-reset-repo-settings | test step completed 5-reset-repo-settings logger.go:42: 11:14:24 | 1-087_validate_repo_server_settings | skipping kubernetes event logging logger.go:42: 11:14:24 | 1-087_validate_repo_server_settings | Deleting namespace: kuttl-test-closing-koala === CONT kuttl/harness/1-061_validate_resource_tracking_method logger.go:42: 11:14:25 | 1-061_validate_resource_tracking_method/4-patch_cm_invalid_method | argocd.argoproj.io/argocd patched logger.go:42: 11:14:27 | 1-061_validate_resource_tracking_method/4-patch_cm_invalid_method | test step completed 4-patch_cm_invalid_method logger.go:42: 11:14:27 | 1-061_validate_resource_tracking_method | skipping kubernetes event logging logger.go:42: 11:14:27 | 1-061_validate_resource_tracking_method | Deleting namespace: kuttl-test-vast-shark === CONT kuttl/harness/1-055_validate_notification_controller logger.go:42: 11:14:27 | 1-055_validate_notification_controller | Creating namespace: kuttl-test-smiling-bat logger.go:42: 11:14:27 | 1-055_validate_notification_controller/1-install | starting test step 1-install logger.go:42: 11:14:30 | 1-055_validate_notification_controller/1-install | ArgoCD:kuttl-test-smiling-bat/example-argocd created === CONT kuttl/harness/1-084_validate_status_host_ingress logger.go:42: 11:14:30 | 1-084_validate_status_host_ingress | Creating namespace: kuttl-test-ready-marten logger.go:42: 11:14:30 | 1-084_validate_status_host_ingress/1-argocd-ingress | starting test step 1-argocd-ingress I0224 11:14:31.649336 121 request.go:682] Waited for 1.02892088s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/certificates.k8s.io/v1?timeout=32s logger.go:42: 11:14:33 | 1-084_validate_status_host_ingress/1-argocd-ingress | ArgoCD:kuttl-test-ready-marten/example-argocd created === CONT kuttl/harness/1-044_validate_resource_limit_changes logger.go:42: 11:14:33 | 1-044_validate_resource_limit_changes | Creating namespace: kuttl-test-excited-cheetah logger.go:42: 11:14:33 | 1-044_validate_resource_limit_changes/1-install | starting test step 1-install logger.go:42: 11:14:36 | 1-044_validate_resource_limit_changes/1-install | ArgoCD:kuttl-test-excited-cheetah/argocd created === CONT kuttl/harness/1-084_validate_status_host_ingress logger.go:42: 11:14:45 | 1-084_validate_status_host_ingress/1-argocd-ingress | test step completed 1-argocd-ingress logger.go:42: 11:14:45 | 1-084_validate_status_host_ingress/2- | starting test step 2- I0224 11:14:46.583217 121 request.go:682] Waited for 1.028135349s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v2?timeout=32s logger.go:42: 11:14:48 | 1-084_validate_status_host_ingress/2- | test step completed 2- logger.go:42: 11:14:48 | 1-084_validate_status_host_ingress | skipping kubernetes event logging logger.go:42: 11:14:48 | 1-084_validate_status_host_ingress | Deleting namespace: kuttl-test-ready-marten === CONT kuttl/harness/1-086_validate_applicationset_extra_command_args logger.go:42: 11:14:49 | 1-086_validate_applicationset_extra_command_args/1-basic-argocd-install | test step completed 1-basic-argocd-install logger.go:42: 11:14:49 | 1-086_validate_applicationset_extra_command_args/2-add-extraCommandArgs | starting test step 2-add-extraCommandArgs logger.go:42: 11:14:51 | 1-086_validate_applicationset_extra_command_args/2-add-extraCommandArgs | ArgoCD:test-1-86-appsets-extra-command/example-argocd updated logger.go:42: 11:14:52 | 1-086_validate_applicationset_extra_command_args/2-add-extraCommandArgs | test step completed 2-add-extraCommandArgs logger.go:42: 11:14:52 | 1-086_validate_applicationset_extra_command_args/99-delete | starting test step 99-delete === CONT kuttl/harness/1-083_validate_resource_customization_subkeys logger.go:42: 11:14:54 | 1-083_validate_resource_customization_subkeys | Creating namespace: kuttl-test-intimate-opossum logger.go:42: 11:14:54 | 1-083_validate_resource_customization_subkeys/1-argocd-with-resource-customization-subkeys | starting test step 1-argocd-with-resource-customization-subkeys I0224 11:14:56.601249 121 request.go:682] Waited for 2.329272104s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apps.openshift.io/v1?timeout=32s logger.go:42: 11:14:56 | 1-083_validate_resource_customization_subkeys/1-argocd-with-resource-customization-subkeys | ArgoCD:kuttl-test-intimate-opossum/example-argocd created === CONT kuttl/harness/1-055_validate_notification_controller logger.go:42: 11:15:02 | 1-055_validate_notification_controller/1-install | test step completed 1-install logger.go:42: 11:15:02 | 1-055_validate_notification_controller/2-enable_notification | starting test step 2-enable_notification logger.go:42: 11:15:05 | 1-055_validate_notification_controller/2-enable_notification | ArgoCD:kuttl-test-smiling-bat/example-argocd updated I0224 11:15:06.607475 121 request.go:682] Waited for 1.077928353s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s === CONT kuttl/harness/1-086_validate_applicationset_extra_command_args logger.go:42: 11:15:08 | 1-086_validate_applicationset_extra_command_args/99-delete | test step completed 99-delete logger.go:42: 11:15:08 | 1-086_validate_applicationset_extra_command_args | skipping kubernetes event logging === CONT kuttl/harness/1-044_validate_resource_limit_changes logger.go:42: 11:15:08 | 1-044_validate_resource_limit_changes/1-install | test step completed 1-install logger.go:42: 11:15:08 | 1-044_validate_resource_limit_changes/2-change-limits | starting test step 2-change-limits === CONT kuttl/harness/1-086_validate_applicationset_extra_command_args logger.go:42: 11:15:08 | 1-086_validate_applicationset_extra_command_args | Deleting namespace: kuttl-test-picked-escargot === CONT kuttl/harness/1-044_validate_resource_limit_changes logger.go:42: 11:15:10 | 1-044_validate_resource_limit_changes/2-change-limits | ArgoCD:kuttl-test-excited-cheetah/argocd updated logger.go:42: 11:15:10 | 1-044_validate_resource_limit_changes/2-change-limits | test step completed 2-change-limits logger.go:42: 11:15:10 | 1-044_validate_resource_limit_changes/4-check-workloads | starting test step 4-check-workloads logger.go:42: 11:15:10 | 1-044_validate_resource_limit_changes/4-check-workloads | running command: [sh -c sleep 10] === CONT kuttl/harness/1-055_validate_notification_controller logger.go:42: 11:15:11 | 1-055_validate_notification_controller/2-enable_notification | test step completed 2-enable_notification logger.go:42: 11:15:11 | 1-055_validate_notification_controller/3-add-sleep | starting test step 3-add-sleep logger.go:42: 11:15:11 | 1-055_validate_notification_controller/3-add-sleep | running command: [sh -c sleep 20] === CONT kuttl/harness/1-083_validate_kustomize_namereference logger.go:42: 11:15:13 | 1-083_validate_kustomize_namereference | Creating namespace: kuttl-test-lucky-crane logger.go:42: 11:15:13 | 1-083_validate_kustomize_namereference/1-install | starting test step 1-install logger.go:42: 11:15:16 | 1-083_validate_kustomize_namereference/1-install | Namespace:/namespace-gitops-2038 created logger.go:42: 11:15:16 | 1-083_validate_kustomize_namereference/1-install | ArgoCD:namespace-gitops-2038/argocd created === CONT kuttl/harness/1-044_validate_resource_limit_changes logger.go:42: 11:15:20 | 1-044_validate_resource_limit_changes/4-check-workloads | running command: [sh -c set -e set -o pipefail for wl in deployments/argocd-server deployments/argocd-repo-server statefulsets/argocd-application-controller; do res=$(oc get -n $NAMESPACE $wl -o jsonpath='{.spec.template.spec.containers[0].resources.limits.cpu}') if test "$res" != "2"; then echo "Reconciliation of resources for $wl failed: Should be 2, is '$res'" exit 1 fi done ] I0224 11:15:22.859285 121 request.go:682] Waited for 1.028427761s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/oauth.openshift.io/v1?timeout=32s logger.go:42: 11:15:24 | 1-044_validate_resource_limit_changes/4-check-workloads | test step completed 4-check-workloads logger.go:42: 11:15:24 | 1-044_validate_resource_limit_changes | skipping kubernetes event logging logger.go:42: 11:15:24 | 1-044_validate_resource_limit_changes | Deleting namespace: kuttl-test-excited-cheetah === CONT kuttl/harness/1-083_validate_resource_customization_subkeys logger.go:42: 11:15:29 | 1-083_validate_resource_customization_subkeys/1-argocd-with-resource-customization-subkeys | test step completed 1-argocd-with-resource-customization-subkeys logger.go:42: 11:15:29 | 1-083_validate_resource_customization_subkeys | skipping kubernetes event logging logger.go:42: 11:15:29 | 1-083_validate_resource_customization_subkeys | Deleting namespace: kuttl-test-intimate-opossum === CONT kuttl/harness/1-082_validate_node_placement logger.go:42: 11:15:30 | 1-082_validate_node_placement | Creating namespace: kuttl-test-glad-shepherd logger.go:42: 11:15:30 | 1-082_validate_node_placement/1-default-node-selector | starting test step 1-default-node-selector I0224 11:15:32.870258 121 request.go:682] Waited for 2.228799028s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha2?timeout=32s logger.go:42: 11:15:33 | 1-082_validate_node_placement/1-default-node-selector | ArgoCD:kuttl-test-glad-shepherd/example-argocd created === CONT kuttl/harness/1-081_validate_applicationset_deployment logger.go:42: 11:15:35 | 1-081_validate_applicationset_deployment | Creating namespace: kuttl-test-renewed-lark logger.go:42: 11:15:35 | 1-081_validate_applicationset_deployment/1- | starting test step 1- === CONT kuttl/harness/1-055_validate_notification_controller logger.go:42: 11:15:35 | 1-055_validate_notification_controller/3-add-sleep | ArgoCD:kuttl-test-smiling-bat/example-argocd updated === CONT kuttl/harness/1-081_validate_applicationset_deployment logger.go:42: 11:15:38 | 1-081_validate_applicationset_deployment/1- | test step completed 1- logger.go:42: 11:15:38 | 1-081_validate_applicationset_deployment | skipping kubernetes event logging logger.go:42: 11:15:38 | 1-081_validate_applicationset_deployment | Deleting namespace: kuttl-test-renewed-lark === CONT kuttl/harness/1-082_validate_node_placement logger.go:42: 11:15:38 | 1-082_validate_node_placement/1-default-node-selector | test step completed 1-default-node-selector logger.go:42: 11:15:38 | 1-082_validate_node_placement/2-custom-node-placement | starting test step 2-custom-node-placement logger.go:42: 11:15:40 | 1-082_validate_node_placement/2-custom-node-placement | ArgoCD:kuttl-test-glad-shepherd/example-argocd updated === CONT kuttl/harness/1-055_validate_notification_controller logger.go:42: 11:15:40 | 1-055_validate_notification_controller/3-add-sleep | test step completed 3-add-sleep logger.go:42: 11:15:40 | 1-055_validate_notification_controller | skipping kubernetes event logging logger.go:42: 11:15:40 | 1-055_validate_notification_controller | Deleting namespace: kuttl-test-smiling-bat === CONT kuttl/harness/1-082_validate_node_placement logger.go:42: 11:15:41 | 1-082_validate_node_placement/2-custom-node-placement | test step completed 2-custom-node-placement logger.go:42: 11:15:41 | 1-082_validate_node_placement/3-node-placement-with-toleration | starting test step 3-node-placement-with-toleration I0224 11:15:43.013919 121 request.go:682] Waited for 1.027283235s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/rbac.authorization.k8s.io/v1?timeout=32s === CONT kuttl/harness/1-080_validate_regex_support_argocd_rbac logger.go:42: 11:15:44 | 1-080_validate_regex_support_argocd_rbac | Creating namespace: kuttl-test-singular-termite logger.go:42: 11:15:44 | 1-080_validate_regex_support_argocd_rbac/1-install | starting test step 1-install === CONT kuttl/harness/1-082_validate_node_placement logger.go:42: 11:15:44 | 1-082_validate_node_placement/3-node-placement-with-toleration | ArgoCD:kuttl-test-glad-shepherd/example-argocd updated === CONT kuttl/harness/1-079_validate_vars_for_notificaitons logger.go:42: 11:15:47 | 1-079_validate_vars_for_notificaitons | Creating namespace: kuttl-test-profound-walleye logger.go:42: 11:15:47 | 1-079_validate_vars_for_notificaitons/1-install | starting test step 1-install === CONT kuttl/harness/1-080_validate_regex_support_argocd_rbac logger.go:42: 11:15:47 | 1-080_validate_regex_support_argocd_rbac/1-install | ArgoCD:kuttl-test-singular-termite/example-argocd created === CONT kuttl/harness/1-083_validate_kustomize_namereference logger.go:42: 11:15:49 | 1-083_validate_kustomize_namereference/1-install | test step completed 1-install logger.go:42: 11:15:49 | 1-083_validate_kustomize_namereference/2-install-kustomize-app | starting test step 2-install-kustomize-app === CONT kuttl/harness/1-079_validate_vars_for_notificaitons logger.go:42: 11:15:49 | 1-079_validate_vars_for_notificaitons/1-install | ArgoCD:kuttl-test-profound-walleye/example-argocd created === CONT kuttl/harness/1-083_validate_kustomize_namereference logger.go:42: 11:15:52 | 1-083_validate_kustomize_namereference/2-install-kustomize-app | Application:namespace-gitops-2038/app-kustomize created === CONT kuttl/harness/1-082_validate_node_placement logger.go:42: 11:15:52 | 1-082_validate_node_placement/3-node-placement-with-toleration | test step completed 3-node-placement-with-toleration logger.go:42: 11:15:52 | 1-082_validate_node_placement | skipping kubernetes event logging logger.go:42: 11:15:52 | 1-082_validate_node_placement | Deleting namespace: kuttl-test-glad-shepherd === CONT kuttl/harness/1-083_validate_kustomize_namereference logger.go:42: 11:15:56 | 1-083_validate_kustomize_namereference/2-install-kustomize-app | test step completed 2-install-kustomize-app logger.go:42: 11:15:56 | 1-083_validate_kustomize_namereference/99-delete | starting test step 99-delete === CONT kuttl/harness/1-077_validate_disable_dex_removed logger.go:42: 11:15:58 | 1-077_validate_disable_dex_removed | Creating namespace: kuttl-test-tight-humpback logger.go:42: 11:15:58 | 1-077_validate_disable_dex_removed/1-check_disable_dex_removed | starting test step 1-check_disable_dex_removed logger.go:42: 11:15:58 | 1-077_validate_disable_dex_removed/1-check_disable_dex_removed | running command: [sh -c set -e operator_name_version=$(oc get subscription/openshift-gitops-operator -n openshift-operators -o jsonpath='{.status.installedCSV}') if [ "$(oc get csv/"${operator_name_version}" -n openshift-operators -o jsonpath='{.spec.install.spec.deployments[].spec.template.spec.containers[].env}' | grep DISABLE_DEX)" != '' ]; then echo "DISABLE_DEX env var is still present in the operator CSV." exit 1 fi ] logger.go:42: 11:15:58 | 1-077_validate_disable_dex_removed/1-check_disable_dex_removed | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found I0224 11:15:59.787026 121 request.go:682] Waited for 1.028727552s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machine.openshift.io/v1beta1?timeout=32s case.go:364: failed in step 1-check_disable_dex_removed case.go:366: exit status 1 logger.go:42: 11:16:01 | 1-077_validate_disable_dex_removed | skipping kubernetes event logging logger.go:42: 11:16:01 | 1-077_validate_disable_dex_removed | Deleting namespace: kuttl-test-tight-humpback === CONT kuttl/harness/1-075_validate_dex_anyuid logger.go:42: 11:16:07 | 1-075_validate_dex_anyuid | Creating namespace: kuttl-test-divine-grizzly logger.go:42: 11:16:07 | 1-075_validate_dex_anyuid/1-install | starting test step 1-install I0224 11:16:09.836734 121 request.go:682] Waited for 2.37928338s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/config.openshift.io/v1?timeout=32s logger.go:42: 11:16:10 | 1-075_validate_dex_anyuid/1-install | ArgoCD:kuttl-test-divine-grizzly/argocd created === CONT kuttl/harness/1-083_validate_kustomize_namereference logger.go:42: 11:16:12 | 1-083_validate_kustomize_namereference/99-delete | test step completed 99-delete logger.go:42: 11:16:12 | 1-083_validate_kustomize_namereference | skipping kubernetes event logging logger.go:42: 11:16:12 | 1-083_validate_kustomize_namereference | Deleting namespace: kuttl-test-lucky-crane === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:18 | 1-074_validate_terminating_namespace_block | Creating namespace: kuttl-test-wealthy-hawk logger.go:42: 11:16:18 | 1-074_validate_terminating_namespace_block/1-install | starting test step 1-install I0224 11:16:19.875668 121 request.go:682] Waited for 1.278046964s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/samples.operator.openshift.io/v1?timeout=32s logger.go:42: 11:16:21 | 1-074_validate_terminating_namespace_block/1-install | Namespace:/gitops-2242-ns-main created logger.go:42: 11:16:21 | 1-074_validate_terminating_namespace_block/1-install | ArgoCD:gitops-2242-ns-main/gitops-2242-argocd created === CONT kuttl/harness/1-080_validate_regex_support_argocd_rbac logger.go:42: 11:16:21 | 1-080_validate_regex_support_argocd_rbac/1-install | test step completed 1-install logger.go:42: 11:16:21 | 1-080_validate_regex_support_argocd_rbac/2-modify-argocd | starting test step 2-modify-argocd === CONT kuttl/harness/1-079_validate_vars_for_notificaitons logger.go:42: 11:16:21 | 1-079_validate_vars_for_notificaitons/1-install | test step completed 1-install logger.go:42: 11:16:21 | 1-079_validate_vars_for_notificaitons/2-modify-argocd | starting test step 2-modify-argocd === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:21 | 1-074_validate_terminating_namespace_block/1-install | RoleBinding:gitops-2242-ns-main/grant-argocd created === CONT kuttl/harness/1-080_validate_regex_support_argocd_rbac logger.go:42: 11:16:23 | 1-080_validate_regex_support_argocd_rbac/2-modify-argocd | ArgoCD:kuttl-test-singular-termite/example-argocd updated logger.go:42: 11:16:26 | 1-080_validate_regex_support_argocd_rbac/2-modify-argocd | test step completed 2-modify-argocd logger.go:42: 11:16:26 | 1-080_validate_regex_support_argocd_rbac/3-try-modify | starting test step 3-try-modify === CONT kuttl/harness/1-079_validate_vars_for_notificaitons logger.go:42: 11:16:26 | 1-079_validate_vars_for_notificaitons/2-modify-argocd | ArgoCD:kuttl-test-profound-walleye/example-argocd updated === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:28 | 1-074_validate_terminating_namespace_block/1-install | test step completed 1-install logger.go:42: 11:16:28 | 1-074_validate_terminating_namespace_block/2-managed-ns-cm | starting test step 2-managed-ns-cm === CONT kuttl/harness/1-080_validate_regex_support_argocd_rbac logger.go:42: 11:16:28 | 1-080_validate_regex_support_argocd_rbac/3-try-modify | ConfigMap:kuttl-test-singular-termite/argocd-rbac-cm updated I0224 11:16:29.893770 121 request.go:682] Waited for 1.129736457s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/oauth.openshift.io/v1?timeout=32s logger.go:42: 11:16:31 | 1-080_validate_regex_support_argocd_rbac/3-try-modify | test step completed 3-try-modify logger.go:42: 11:16:31 | 1-080_validate_regex_support_argocd_rbac/4-modify-argocd | starting test step 4-modify-argocd === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:31 | 1-074_validate_terminating_namespace_block/2-managed-ns-cm | Namespace:/gitops-2242-ns-first created logger.go:42: 11:16:31 | 1-074_validate_terminating_namespace_block/2-managed-ns-cm | ConfigMap:gitops-2242-ns-first/my-config-map-2 created === CONT kuttl/harness/1-079_validate_vars_for_notificaitons logger.go:42: 11:16:33 | 1-079_validate_vars_for_notificaitons/2-modify-argocd | test step completed 2-modify-argocd logger.go:42: 11:16:33 | 1-079_validate_vars_for_notificaitons | skipping kubernetes event logging === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:33 | 1-074_validate_terminating_namespace_block/2-managed-ns-cm | test step completed 2-managed-ns-cm logger.go:42: 11:16:33 | 1-074_validate_terminating_namespace_block/3-delete-ns | starting test step 3-delete-ns logger.go:42: 11:16:33 | 1-074_validate_terminating_namespace_block/3-delete-ns | running command: [sh -c set -e oc delete ns gitops-2242-ns-first --wait=false exit 0 ] === CONT kuttl/harness/1-079_validate_vars_for_notificaitons logger.go:42: 11:16:33 | 1-079_validate_vars_for_notificaitons | Deleting namespace: kuttl-test-profound-walleye === CONT kuttl/harness/1-080_validate_regex_support_argocd_rbac logger.go:42: 11:16:33 | 1-080_validate_regex_support_argocd_rbac/4-modify-argocd | ArgoCD:kuttl-test-singular-termite/example-argocd updated === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:34 | 1-074_validate_terminating_namespace_block/3-delete-ns | namespace "gitops-2242-ns-first" deleted logger.go:42: 11:16:36 | 1-074_validate_terminating_namespace_block/3-delete-ns | test step completed 3-delete-ns logger.go:42: 11:16:36 | 1-074_validate_terminating_namespace_block/4-create-ns | starting test step 4-create-ns === CONT kuttl/harness/1-080_validate_regex_support_argocd_rbac logger.go:42: 11:16:39 | 1-080_validate_regex_support_argocd_rbac/4-modify-argocd | test step completed 4-modify-argocd logger.go:42: 11:16:39 | 1-080_validate_regex_support_argocd_rbac | skipping kubernetes event logging logger.go:42: 11:16:39 | 1-080_validate_regex_support_argocd_rbac | Deleting namespace: kuttl-test-singular-termite === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:39 | 1-074_validate_terminating_namespace_block/4-create-ns | Namespace:/gitops-2242-ns-second created === CONT kuttl/harness/1-073_validate_rhsso logger.go:42: 11:16:40 | 1-073_validate_rhsso | Creating namespace: kuttl-test-ample-ram logger.go:42: 11:16:40 | 1-073_validate_rhsso/1-argocd-rhsso | starting test step 1-argocd-rhsso I0224 11:16:41.185501 121 request.go:682] Waited for 1.020864938s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/scheduling.k8s.io/v1?timeout=32s === CONT kuttl/harness/1-075_validate_dex_anyuid logger.go:42: 11:16:42 | 1-075_validate_dex_anyuid/1-install | test step completed 1-install logger.go:42: 11:16:42 | 1-075_validate_dex_anyuid/2-change_dex_scc_to_anyuid | starting test step 2-change_dex_scc_to_anyuid logger.go:42: 11:16:42 | 1-075_validate_dex_anyuid/2-change_dex_scc_to_anyuid | running command: [sh -c set -e oc adm policy add-scc-to-user anyuid -z argocd-argocd-dex-server -n $NAMESPACE ] === CONT kuttl/harness/1-073_validate_rhsso logger.go:42: 11:16:42 | 1-073_validate_rhsso/1-argocd-rhsso | ArgoCD:kuttl-test-ample-ram/example-argocd-keycloak created === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:42 | 1-074_validate_terminating_namespace_block/4-create-ns | test step completed 4-create-ns logger.go:42: 11:16:42 | 1-074_validate_terminating_namespace_block/99-cleanup | starting test step 99-cleanup logger.go:42: 11:16:42 | 1-074_validate_terminating_namespace_block/99-cleanup | running command: [sh -c set -e # Removing finalizer from cm oc patch cm/my-config-map-2 -n gitops-2242-ns-first --type json --patch='[ { "op": "remove", "path": "/metadata/finalizers" } ]' # Deleting namespaces oc delete ns gitops-2242-ns-first --wait=false oc delete ns gitops-2242-ns-second --wait=false oc delete ns gitops-2242-ns-main --wait=false exit 0 ] === CONT kuttl/harness/1-075_validate_dex_anyuid logger.go:42: 11:16:43 | 1-075_validate_dex_anyuid/2-change_dex_scc_to_anyuid | clusterrole.rbac.authorization.k8s.io/system:openshift:scc:anyuid added: "argocd-argocd-dex-server" === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:43 | 1-074_validate_terminating_namespace_block/99-cleanup | configmap/my-config-map-2 patched logger.go:42: 11:16:43 | 1-074_validate_terminating_namespace_block/99-cleanup | namespace "gitops-2242-ns-first" deleted logger.go:42: 11:16:44 | 1-074_validate_terminating_namespace_block/99-cleanup | namespace "gitops-2242-ns-second" deleted logger.go:42: 11:16:44 | 1-074_validate_terminating_namespace_block/99-cleanup | namespace "gitops-2242-ns-main" deleted === CONT kuttl/harness/1-072_validate_liveness_probe_removed === CONT kuttl/harness/1-075_validate_dex_anyuid logger.go:42: 11:16:45 | 1-075_validate_dex_anyuid/2-change_dex_scc_to_anyuid | test step completed 2-change_dex_scc_to_anyuid logger.go:42: 11:16:45 | 1-075_validate_dex_anyuid/3-restart_dex_pod | starting test step 3-restart_dex_pod logger.go:42: 11:16:45 | 1-075_validate_dex_anyuid/3-restart_dex_pod | running command: [sh -c set -e oc rollout restart deployment/argocd-dex-server -n $NAMESPACE ] logger.go:42: 11:16:46 | 1-075_validate_dex_anyuid/3-restart_dex_pod | deployment.apps/argocd-dex-server restarted === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:48 | 1-074_validate_terminating_namespace_block/99-cleanup | test step completed 99-cleanup logger.go:42: 11:16:48 | 1-074_validate_terminating_namespace_block | skipping kubernetes event logging === CONT kuttl/harness/1-072_validate_liveness_probe_removed logger.go:42: 11:16:48 | 1-072_validate_liveness_probe_removed | Creating namespace: kuttl-test-beloved-jaybird logger.go:42: 11:16:48 | 1-072_validate_liveness_probe_removed/1-install | starting test step 1-install === CONT kuttl/harness/1-074_validate_terminating_namespace_block logger.go:42: 11:16:48 | 1-074_validate_terminating_namespace_block | Deleting namespace: kuttl-test-wealthy-hawk === CONT kuttl/harness/1-075_validate_dex_anyuid logger.go:42: 11:16:50 | 1-075_validate_dex_anyuid/3-restart_dex_pod | test step completed 3-restart_dex_pod logger.go:42: 11:16:50 | 1-075_validate_dex_anyuid | skipping kubernetes event logging logger.go:42: 11:16:50 | 1-075_validate_dex_anyuid | Deleting namespace: kuttl-test-divine-grizzly I0224 11:16:51.925443 121 request.go:682] Waited for 1.027270169s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/controlplane.operator.openshift.io/v1alpha1?timeout=32s === CONT kuttl/harness/1-072_validate_liveness_probe_removed logger.go:42: 11:16:53 | 1-072_validate_liveness_probe_removed/1-install | ArgoCD:kuttl-test-beloved-jaybird/argocd created === CONT kuttl/harness/1-071_validate_SCC_HA logger.go:42: 11:16:54 | 1-071_validate_SCC_HA | Creating namespace: kuttl-test-workable-halibut logger.go:42: 11:16:54 | 1-071_validate_SCC_HA/1-create-scc | starting test step 1-create-scc logger.go:42: 11:16:57 | 1-071_validate_SCC_HA/1-create-scc | SecurityContextConstraints:/restricted-dropcaps created logger.go:42: 11:16:57 | 1-071_validate_SCC_HA/1-create-scc | test step completed 1-create-scc logger.go:42: 11:16:57 | 1-071_validate_SCC_HA/2-create-argocd | starting test step 2-create-argocd === CONT kuttl/harness/1-070_validate_config_management_plugin logger.go:42: 11:16:59 | 1-070_validate_config_management_plugin | Creating namespace: kuttl-test-quality-molly logger.go:42: 11:16:59 | 1-070_validate_config_management_plugin/1-install | starting test step 1-install === CONT kuttl/harness/1-071_validate_SCC_HA logger.go:42: 11:16:59 | 1-071_validate_SCC_HA/2-create-argocd | ArgoCD:kuttl-test-workable-halibut/argocd created I0224 11:17:01.956711 121 request.go:682] Waited for 2.378925935s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/authorization.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-070_validate_config_management_plugin logger.go:42: 11:17:02 | 1-070_validate_config_management_plugin/1-install | Namespace:/argocd created logger.go:42: 11:17:02 | 1-070_validate_config_management_plugin/1-install | ConfigMap:argocd/cmp-plugin created logger.go:42: 11:17:02 | 1-070_validate_config_management_plugin/1-install | ArgoCD:argocd/argocd created === CONT kuttl/harness/1-072_validate_liveness_probe_removed logger.go:42: 11:17:25 | 1-072_validate_liveness_probe_removed/1-install | test step completed 1-install logger.go:42: 11:17:25 | 1-072_validate_liveness_probe_removed/2-check_liveness_probe_removed | starting test step 2-check_liveness_probe_removed logger.go:42: 11:17:25 | 1-072_validate_liveness_probe_removed/2-check_liveness_probe_removed | running command: [sh -c set -e if ! test -z $(oc get statefulset.apps/argocd-application-controller -n $NAMESPACE -o jsonpath='{.spec.template.spec.containers[].livenessProbe}'); then echo "livenessProbe should not exist on statefulset.apps/argocd-application-controller." exit 1 fi ] I0224 11:17:26.886543 121 request.go:682] Waited for 1.028639477s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/oauth.openshift.io/v1?timeout=32s logger.go:42: 11:17:28 | 1-072_validate_liveness_probe_removed/2-check_liveness_probe_removed | test step completed 2-check_liveness_probe_removed logger.go:42: 11:17:28 | 1-072_validate_liveness_probe_removed | skipping kubernetes event logging logger.go:42: 11:17:28 | 1-072_validate_liveness_probe_removed | Deleting namespace: kuttl-test-beloved-jaybird === CONT kuttl/harness/1-071_validate_SCC_HA logger.go:42: 11:17:31 | 1-071_validate_SCC_HA/2-create-argocd | test step completed 2-create-argocd logger.go:42: 11:17:31 | 1-071_validate_SCC_HA/3-modify-argocd | starting test step 3-modify-argocd logger.go:42: 11:17:34 | 1-071_validate_SCC_HA/3-modify-argocd | ArgoCD:kuttl-test-workable-halibut/argocd updated === CONT kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha logger.go:42: 11:17:35 | 1-069_validate_redis_secure_comm_autotls_ha | Creating namespace: kuttl-test-hopeful-blowfish logger.go:42: 11:17:35 | 1-069_validate_redis_secure_comm_autotls_ha/1-install | starting test step 1-install I0224 11:17:36.892778 121 request.go:682] Waited for 1.425254963s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/cloud.network.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-070_validate_config_management_plugin logger.go:42: 11:17:37 | 1-070_validate_config_management_plugin/1-install | test step completed 1-install logger.go:42: 11:17:37 | 1-070_validate_config_management_plugin/2-create-app | starting test step 2-create-app === CONT kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha logger.go:42: 11:17:38 | 1-069_validate_redis_secure_comm_autotls_ha/1-install | ArgoCD:kuttl-test-hopeful-blowfish/argocd created === CONT kuttl/harness/1-070_validate_config_management_plugin logger.go:42: 11:17:40 | 1-070_validate_config_management_plugin/2-create-app | Application:argocd/guestbook created logger.go:42: 11:17:42 | 1-070_validate_config_management_plugin/2-create-app | test step completed 2-create-app logger.go:42: 11:17:42 | 1-070_validate_config_management_plugin/99-delete | starting test step 99-delete I0224 11:18:20.808062 121 request.go:682] Waited for 1.028901421s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/monitoring.coreos.com/v1?timeout=32s logger.go:42: 11:18:22 | 1-070_validate_config_management_plugin/99-delete | test step completed 99-delete logger.go:42: 11:18:22 | 1-070_validate_config_management_plugin | skipping kubernetes event logging logger.go:42: 11:18:22 | 1-070_validate_config_management_plugin | Deleting namespace: kuttl-test-quality-molly === CONT kuttl/harness/1-068_validate_redis_secure_comm_autotls_no_ha logger.go:42: 11:18:28 | 1-068_validate_redis_secure_comm_autotls_no_ha | Creating namespace: kuttl-test-tender-rat logger.go:42: 11:18:28 | 1-068_validate_redis_secure_comm_autotls_no_ha/1-install | starting test step 1-install logger.go:42: 11:18:30 | 1-068_validate_redis_secure_comm_autotls_no_ha/1-install | ArgoCD:kuttl-test-tender-rat/argocd created === CONT kuttl/harness/1-073_validate_rhsso logger.go:42: 11:18:58 | 1-073_validate_rhsso/1-argocd-rhsso | test step completed 1-argocd-rhsso logger.go:42: 11:18:58 | 1-073_validate_rhsso/2-sleep | starting test step 2-sleep logger.go:42: 11:18:58 | 1-073_validate_rhsso/2-sleep | running command: [sh -c sleep 60] === CONT kuttl/harness/1-068_validate_redis_secure_comm_autotls_no_ha logger.go:42: 11:19:04 | 1-068_validate_redis_secure_comm_autotls_no_ha/1-install | test step completed 1-install logger.go:42: 11:19:04 | 1-068_validate_redis_secure_comm_autotls_no_ha/2-enable_autotls | starting test step 2-enable_autotls logger.go:42: 11:19:04 | 1-068_validate_redis_secure_comm_autotls_no_ha/2-enable_autotls | running command: [sh -c set -e oc patch argocds.argoproj.io argocd --type=merge -p '{"spec":{"redis":{"autotls":"openshift"}}}' -n $NAMESPACE ] logger.go:42: 11:19:04 | 1-068_validate_redis_secure_comm_autotls_no_ha/2-enable_autotls | argocd.argoproj.io/argocd patched I0224 11:19:05.716306 121 request.go:682] Waited for 1.029004288s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apiextensions.k8s.io/v1?timeout=32s logger.go:42: 11:19:36 | 1-068_validate_redis_secure_comm_autotls_no_ha/2-enable_autotls | test step completed 2-enable_autotls logger.go:42: 11:19:36 | 1-068_validate_redis_secure_comm_autotls_no_ha/3-check_secret | starting test step 3-check_secret logger.go:42: 11:19:36 | 1-068_validate_redis_secure_comm_autotls_no_ha/3-check_secret | running command: [sh -c set -e secret_type="$(oc get secrets argocd-operator-redis-tls -n $NAMESPACE --template '{{.type}}')" secret_len="$(oc get secrets argocd-operator-redis-tls -n $NAMESPACE --template '{{len .data}}')" expected_secret_type="kubernetes.io/tls" expected_secret_len=2 if test ${secret_type} != ${expected_secret_type}; then echo "argocd-operator-redis-tls secret type is ${secret_type} and should be ${expected_secret_type}" exit 1 fi if test ${secret_len} != ${expected_secret_len}; then echo "argocd-operator-redis-tls secret length is ${secret_len} and should be ${expected_secret_len}" exit 1 fi ] I0224 11:19:37.942142 121 request.go:682] Waited for 1.028084416s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/storage.k8s.io/v1beta1?timeout=32s logger.go:42: 11:19:39 | 1-068_validate_redis_secure_comm_autotls_no_ha/3-check_secret | test step completed 3-check_secret logger.go:42: 11:19:39 | 1-068_validate_redis_secure_comm_autotls_no_ha/4- | starting test step 4- logger.go:42: 11:19:42 | 1-068_validate_redis_secure_comm_autotls_no_ha/4- | test step completed 4- logger.go:42: 11:19:42 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | starting test step 5-check_crt_files logger.go:42: 11:19:42 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | running command: [sh -c set -e oc exec -i $(oc get pod -l app.kubernetes.io/name=argocd-server -n $NAMESPACE -o=NAME) -n $NAMESPACE -- ls /app/config/server/tls/redis/tls.crt oc exec -i $(oc get pod -l app.kubernetes.io/name=argocd-repo-server -n $NAMESPACE -o=NAME) -n $NAMESPACE -- ls /app/config/reposerver/tls/redis/tls.crt oc exec -i $(oc get pod -l app.kubernetes.io/name=argocd-redis -n $NAMESPACE -o=NAME) -n $NAMESPACE -- ls /app/config/redis/tls/tls.crt oc exec -i $(oc get pod -l app.kubernetes.io/name=argocd-application-controller -n $NAMESPACE -o=NAME) -n $NAMESPACE -- ls /app/config/controller/tls/redis/tls.crt ] logger.go:42: 11:19:43 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | /app/config/server/tls/redis/tls.crt logger.go:42: 11:19:44 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | Defaulted container "argocd-repo-server" out of: argocd-repo-server, copyutil (init) logger.go:42: 11:19:44 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | /app/config/reposerver/tls/redis/tls.crt logger.go:42: 11:19:45 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | /app/config/redis/tls/tls.crt logger.go:42: 11:19:48 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | /app/config/controller/tls/redis/tls.crt I0224 11:19:49.429437 121 request.go:682] Waited for 1.038993654s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/user.openshift.io/v1?timeout=32s logger.go:42: 11:19:51 | 1-068_validate_redis_secure_comm_autotls_no_ha/5-check_crt_files | test step completed 5-check_crt_files logger.go:42: 11:19:51 | 1-068_validate_redis_secure_comm_autotls_no_ha | skipping kubernetes event logging logger.go:42: 11:19:51 | 1-068_validate_redis_secure_comm_autotls_no_ha | Deleting namespace: kuttl-test-tender-rat === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha I0224 11:20:03.207748 121 request.go:682] Waited for 1.00068538s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v2?timeout=32s === CONT kuttl/harness/1-073_validate_rhsso logger.go:42: 11:20:04 | 1-073_validate_rhsso/2-sleep | test step completed 2-sleep logger.go:42: 11:20:04 | 1-073_validate_rhsso/3-verify-oidc | starting test step 3-verify-oidc logger.go:42: 11:20:04 | 1-073_validate_rhsso/3-verify-oidc | running command: [sh -c issuer=$(kubectl get configmap argocd-cm -o jsonpath='{.data.oidc\.config}' -n $NAMESPACE | grep issuer | awk -F' ' '{print $2}') keycloakRoute=$(kubectl get route keycloak -n $NAMESPACE -o jsonpath='{.spec.host}') if [[ "${issuer}" == "https://${keycloakRoute}/auth/realms/argocd" ]]; then echo "issuer matched" else echo "issuer mismatched" echo "${issuer} not equals ${keycloakRoute}/auth/realms/argocd" exit 1 fi ] === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:20:04 | 1-067_validate_redis_secure_comm_no_autotls_ha | Creating namespace: kuttl-test-wealthy-condor logger.go:42: 11:20:04 | 1-067_validate_redis_secure_comm_no_autotls_ha/1-install | starting test step 1-install === CONT kuttl/harness/1-073_validate_rhsso logger.go:42: 11:20:05 | 1-073_validate_rhsso/3-verify-oidc | issuer matched logger.go:42: 11:20:05 | 1-073_validate_rhsso/3-verify-oidc | running command: [sh -c clientid=$(kubectl get configmap argocd-cm -o jsonpath='{.data.oidc\.config}' -n $NAMESPACE | grep clientid | awk -F' ' '{print $2}') name=$(kubectl get configmap argocd-cm -o jsonpath='{.data.oidc\.config}' -n $NAMESPACE | grep name | awk -F' ' '{print $2}') rootCA=$(kubectl get configmap argocd-cm -o jsonpath='{.data.oidc\.config}' -n $NAMESPACE | grep rootca | awk -F' ' '{print $2}') if [[ "${clientid}" == "argocd" && "${name}" == "Keycloak" && "${rootCA}" == "'---BEGIN---END---'" ]]; then echo "oidc name, clientid and rootCA matched" else echo "oidc name, clientid or rootCA mismatched" echo "${clientid}, ${name} and ${rootCA}" exit 1 fi ] logger.go:42: 11:20:07 | 1-073_validate_rhsso/3-verify-oidc | oidc name, clientid and rootCA matched === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:20:07 | 1-067_validate_redis_secure_comm_no_autotls_ha/1-install | ArgoCD:kuttl-test-wealthy-condor/argocd created === CONT kuttl/harness/1-073_validate_rhsso logger.go:42: 11:20:10 | 1-073_validate_rhsso/3-verify-oidc | test step completed 3-verify-oidc logger.go:42: 11:20:10 | 1-073_validate_rhsso/4-verifyRealmCreation | starting test step 4-verifyRealmCreation logger.go:42: 11:20:10 | 1-073_validate_rhsso/4-verifyRealmCreation | running command: [sh -c # Set the needed parameter for the authorization KEYCLOAK_URL=$(oc get route keycloak -n $NAMESPACE -o jsonpath='{.spec.host}') tenant=argocd USER=$(oc get secret keycloak-secret -n $NAMESPACE -o jsonpath='{.data.SSO_USERNAME}' | base64 --decode) PASSWORD=$(oc get secret keycloak-secret -n $NAMESPACE -o jsonpath='{.data.SSO_PASSWORD}' | base64 --decode) GRANT_TYPE=password CLIENT_ID=admin-cli # Execute the CURL command to request the access-token access_token=$(curl -d "client_id=$CLIENT_ID" -d "username=$USER" -d "password=$PASSWORD" -d "grant_type=$GRANT_TYPE" "https://$KEYCLOAK_URL/auth/realms/master/protocol/openid-connect/token" -k | sed -n 's|.*"access_token":"\([^"]*\)".*|\1|p') # Execute the CURL command to verify the realm and client creation clientFound=$(curl -H "Content-Type: application/json" -H "Authorization: bearer $access_token" "https://$KEYCLOAK_URL/auth/admin/realms/$tenant/clients" -k | grep '"clientId":"argocd"') if ! [ "$clientFound" = "" ]; then echo "argocd realm and client creation verified" else echo "argocd client not found" exit 1 fi # Verify OpenShift-v4 IdP creation IdPFound=$(curl -H "Content-Type: application/json" -H "Authorization: bearer $access_token" "https://$KEYCLOAK_URL/auth/admin/realms/$tenant/identity-provider/instances" -k | grep -i OpenShift-v4) if ! [ "$IdPFound" = "" ]; then echo "OpenShift-v4 IdP creation verified" else echo "OpenShift-v4 IdP not found" exit 1 fi # Verify OpenShift-v4 IdP creation syncModeVerified=$(curl -H "Content-Type: application/json" -H "Authorization: bearer $access_token" "https://$KEYCLOAK_URL/auth/admin/realms/$tenant/identity-provider/instances" -k | grep -i '"syncMode":"FORCE"') if ! [ "$syncModeVerified" = "" ]; then echo "syncMode set to Force, verified" else echo "syncMode not set to Force" exit 1 fi ] logger.go:42: 11:20:11 | 1-073_validate_rhsso/4-verifyRealmCreation | % Total % Received % Xferd Average Speed Time Time Time Current logger.go:42: 11:20:11 | 1-073_validate_rhsso/4-verifyRealmCreation | Dload Upload Total Spent Left Speed logger.go:42: 11:20:11 | 1-073_validate_rhsso/4-verifyRealmCreation | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0100 2132 100 2057 100 75 7068 257 --:--:-- --:--:-- --:--:-- 7326 logger.go:42: 11:20:11 | 1-073_validate_rhsso/4-verifyRealmCreation | % Total % Received % Xferd Average Speed Time Time Time Current logger.go:42: 11:20:11 | 1-073_validate_rhsso/4-verifyRealmCreation | Dload Upload Total Spent Left Speed logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0100 6432 100 6432 0 0 10193 0 --:--:-- --:--:-- --:--:-- 10177100 6432 100 6432 0 0 10193 0 --:--:-- --:--:-- --:--:-- 10177 logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | argocd realm and client creation verified logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | % Total % Received % Xferd Average Speed Time Time Time Current logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | Dload Upload Total Spent Left Speed logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0100 552 100 552 0 0 5632 0 --:--:-- --:--:-- --:--:-- 5632 logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | OpenShift-v4 IdP creation verified logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | % Total % Received % Xferd Average Speed Time Time Time Current logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | Dload Upload Total Spent Left Speed logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0100 552 100 552 0 0 6065 0 --:--:-- --:--:-- --:--:-- 6065 logger.go:42: 11:20:12 | 1-073_validate_rhsso/4-verifyRealmCreation | syncMode set to Force, verified I0224 11:20:13.729280 121 request.go:682] Waited for 1.028397877s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/autoscaling.openshift.io/v1beta1?timeout=32s logger.go:42: 11:20:15 | 1-073_validate_rhsso/4-verifyRealmCreation | test step completed 4-verifyRealmCreation logger.go:42: 11:20:15 | 1-073_validate_rhsso/99-delete | starting test step 99-delete logger.go:42: 11:20:15 | 1-073_validate_rhsso/99-delete | running command: [oc delete argocd example-argocd-keycloak -n kuttl-test-ample-ram] logger.go:42: 11:20:15 | 1-073_validate_rhsso/99-delete | argocd.argoproj.io "example-argocd-keycloak" deleted logger.go:42: 11:20:18 | 1-073_validate_rhsso/99-delete | test step completed 99-delete logger.go:42: 11:20:18 | 1-073_validate_rhsso | skipping kubernetes event logging logger.go:42: 11:20:18 | 1-073_validate_rhsso | Deleting namespace: kuttl-test-ample-ram === CONT kuttl/harness/1-092_validate_workload_status_monitoring_alert logger.go:42: 11:20:24 | 1-092_validate_workload_status_monitoring_alert/2-verify-alert | running command: [sh -c set -eo pipefail cleanup() { rm alerts.json } trap cleanup INT TERM EXIT oc whoami jq '.data.alerts' <<< "$(oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -s 'http://localhost:9090/api/v1/alerts')" > alerts.json result=$(jq --arg NAMESPACE "$NAMESPACE" ' .[] | select( .labels.deployment == "argocd-applicationset-controller" and .labels.namespace == $NAMESPACE and .labels.alertname == "ApplicationSetControllerNotReady" and .state == "firing")' alerts.json) [[ -n "$result" ]] && exit 0 || exit 1 ] logger.go:42: 11:20:24 | 1-092_validate_workload_status_monitoring_alert/2-verify-alert | kube:admin I0224 11:20:26.524603 121 request.go:682] Waited for 1.028825741s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha1?timeout=32s logger.go:42: 11:20:27 | 1-092_validate_workload_status_monitoring_alert/2-verify-alert | test step completed 2-verify-alert logger.go:42: 11:20:27 | 1-092_validate_workload_status_monitoring_alert/3-disable-monitoring | starting test step 3-disable-monitoring === CONT kuttl/harness/1-066_validate_redis_secure_comm_no_autotls_no_ha logger.go:42: 11:20:30 | 1-066_validate_redis_secure_comm_no_autotls_no_ha | Creating namespace: kuttl-test-relevant-flounder logger.go:42: 11:20:30 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/1-install | starting test step 1-install === CONT kuttl/harness/1-092_validate_workload_status_monitoring_alert logger.go:42: 11:20:30 | 1-092_validate_workload_status_monitoring_alert/3-disable-monitoring | ArgoCD:kuttl-test-flexible-eel/argocd updated logger.go:42: 11:20:33 | 1-092_validate_workload_status_monitoring_alert/3-disable-monitoring | test step completed 3-disable-monitoring logger.go:42: 11:20:33 | 1-092_validate_workload_status_monitoring_alert | skipping kubernetes event logging === CONT kuttl/harness/1-066_validate_redis_secure_comm_no_autotls_no_ha logger.go:42: 11:20:33 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/1-install | ArgoCD:kuttl-test-relevant-flounder/argocd created === CONT kuttl/harness/1-092_validate_workload_status_monitoring_alert logger.go:42: 11:20:33 | 1-092_validate_workload_status_monitoring_alert | Deleting namespace: kuttl-test-flexible-eel === CONT kuttl/harness/1-065_validate_redis_ha_anti_affinity logger.go:42: 11:20:39 | 1-065_validate_redis_ha_anti_affinity | Creating namespace: kuttl-test-engaged-quetzal logger.go:42: 11:20:39 | 1-065_validate_redis_ha_anti_affinity/1-install | starting test step 1-install I0224 11:20:40.398393 121 request.go:682] Waited for 1.028511591s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/admissionregistration.k8s.io/v1?timeout=32s logger.go:42: 11:20:41 | 1-065_validate_redis_ha_anti_affinity/1-install | ArgoCD:kuttl-test-engaged-quetzal/argocd created logger.go:42: 11:20:41 | 1-065_validate_redis_ha_anti_affinity/1-install | test step completed 1-install logger.go:42: 11:20:41 | 1-065_validate_redis_ha_anti_affinity/2- | starting test step 2- === CONT kuttl/harness/1-066_validate_redis_secure_comm_no_autotls_no_ha logger.go:42: 11:21:04 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/1-install | test step completed 1-install logger.go:42: 11:21:04 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/2-generate_cert | starting test step 2-generate_cert logger.go:42: 11:21:04 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/2-generate_cert | running command: [sh -c set -e if [[ $(uname -o) == "Darwin" ]]; then echo "\n[SAN]\nsubjectAltName=DNS:argocd-redis.$NAMESPACE.svc.cluster.local\n[req]\ndistinguished_name=req" >${PWD}/openssl_test.cnf else echo -e "\n[SAN]\nsubjectAltName=DNS:argocd-redis.$NAMESPACE.svc.cluster.local\n[req]\ndistinguished_name=req" >${PWD}/openssl_test.cnf fi openssl req -new -x509 \ -subj "/C=XX/ST=XX/O=Testing/CN=redis" \ -reqexts SAN -extensions SAN \ -config ${PWD}/openssl_test.cnf \ -keyout ${PWD}/redis.key \ -out ${PWD}/redis.crt \ -newkey rsa:4096 \ -nodes \ -sha256 \ -days 10 ] logger.go:42: 11:21:05 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/2-generate_cert | ...+........+.+.........+..+...+....+++++++++++++++++++++++++++++++++++++++++++++*....+..+................+..+.........+++++++++++++++++++++++++++++++++++++++++++++*...+................+.....+....+........+....+........+.+.....+...................+.......................+....+...+...........+..........+..+.......+.....+.....................+.+........+...+..................+.+......+.........+.....+.+............+...............+......+..............+.+............+.....+.......+.....+............+.+........+.......+.....+.......+...+...+............+............+...............+......+..+.............+...........+...+............+................+............+........+....+..............+.+...............+......+..+...............+......+............+....+...+......+.........+..+...+..........+.....+......+.......+...+...........+....+..........................+...............+.+...............+............+..... logger.go:42: 11:21:07 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/2-generate_cert | ....+......+............+..+.+..+....+.....+....+..+....+......+..+.+..+...+......+.+..+.......+......+.........+........+.......+...+++++++++++++++++++++++++++++++++++++++++++++*....+..............+.........+......+....+++++++++++++++++++++++++++++++++++++++++++++*...+...+.......+...............+..+...............+.+..+...............+.......+...........+............+.......+.....+...+.......+......+.....+....+..+.+........+.......+..+............+..........+......+...................................+..........+..+.+..+.........+.+...............+.....+.........+...+.............+...+..+...+......+........................+.+...........+.........+...+.+...........+.........+......+......+.......+......+..+..........+..+.......+.......................+.+..+..........+...+...............+..+...+...............+...............+.........+..........+.....................+..+....+.....+...+.............+..+...+......... logger.go:42: 11:21:07 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/2-generate_cert | ----- I0224 11:21:08.115758 121 request.go:682] Waited for 1.028881188s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/coordination.k8s.io/v1?timeout=32s logger.go:42: 11:21:09 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/2-generate_cert | test step completed 2-generate_cert logger.go:42: 11:21:09 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/3-create_secret | starting test step 3-create_secret logger.go:42: 11:21:09 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/3-create_secret | running command: [sh -c set -e # clean up key, cert and config file cleanup() { rm -rf ${PWD}/redis.crt && rm -rf ${PWD}/redis.key && rm -rf ${PWD}/openssl_test.cnf } trap cleanup INT TERM EXIT oc create secret tls argocd-operator-redis-tls --key=${PWD}/redis.key --cert=${PWD}/redis.crt -n $NAMESPACE sleep 10 ] logger.go:42: 11:21:10 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/3-create_secret | secret/argocd-operator-redis-tls created I0224 11:21:21.188190 121 request.go:682] Waited for 1.024806782s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/imageregistry.operator.openshift.io/v1?timeout=32s logger.go:42: 11:21:22 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/3-create_secret | test step completed 3-create_secret logger.go:42: 11:21:22 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/4-create_annotation | starting test step 4-create_annotation logger.go:42: 11:21:22 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/4-create_annotation | running command: [sh -c set -e oc annotate secret argocd-operator-redis-tls argocds.argoproj.io/name=argocd -n $NAMESPACE sleep 30 ] logger.go:42: 11:21:23 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/4-create_annotation | secret/argocd-operator-redis-tls annotated I0224 11:21:54.452381 121 request.go:682] Waited for 1.025678044s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/console.openshift.io/v1?timeout=32s logger.go:42: 11:21:56 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/4-create_annotation | test step completed 4-create_annotation logger.go:42: 11:21:56 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/5-check_deployments | starting test step 5-check_deployments logger.go:42: 11:21:56 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/5-check_deployments | running command: [sh -c set -e if test "$(oc get deployments.apps argocd-redis -n $NAMESPACE --template '{{range .spec.template.spec.containers}}{{.args}}{{"\n"}}{{end}}')" != \ "[redis-server \ --protected-mode no \ --save \ --appendonly no \ --requirepass \$(REDIS_PASSWORD) \ --tls-port 6379 \ --port 0 \ --tls-cert-file /app/config/redis/tls/tls.crt \ --tls-key-file /app/config/redis/tls/tls.key \ --tls-auth-clients no]"; then echo "TLS .spec.template.spec.containers.args for argocd-redis deployment are wrong" exit 1 fi ] logger.go:42: 11:21:56 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/5-check_deployments | running command: [sh -c set -e if test "$(oc get deployments.apps argocd-repo-server -n $NAMESPACE --template '{{range .spec.template.spec.containers}}{{.command}}{{"\n"}}{{end}}')" != \ "[uid_entrypoint.sh \ argocd-repo-server \ --redis argocd-redis.$NAMESPACE.svc.cluster.local:6379 \ --redis-use-tls \ --redis-ca-certificate /app/config/reposerver/tls/redis/tls.crt \ --loglevel info \ --logformat text]"; then echo "TLS .spec.template.spec.containers.command for argocd-repo-server deployment is wrong" exit 1 fi ] logger.go:42: 11:21:56 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/5-check_deployments | running command: [sh -c set -e if test "$(oc get deployments.apps argocd-server -n $NAMESPACE --template '{{range .spec.template.spec.containers}}{{.command}}{{"\n"}}{{end}}')" != \ "[argocd-server \ --staticassets /shared/app \ --dex-server https://argocd-dex-server.$NAMESPACE.svc.cluster.local:5556 \ --repo-server argocd-repo-server.$NAMESPACE.svc.cluster.local:8081 \ --redis argocd-redis.$NAMESPACE.svc.cluster.local:6379 \ --redis-use-tls \ --redis-ca-certificate /app/config/server/tls/redis/tls.crt \ --loglevel info \ --logformat text]"; then echo "TLS .spec.template.spec.containers.command for argocd-server deployment is wrong" exit 1 fi ] logger.go:42: 11:22:00 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/5-check_deployments | test step completed 5-check_deployments logger.go:42: 11:22:00 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/6-check_statefulset | starting test step 6-check_statefulset logger.go:42: 11:22:00 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/6-check_statefulset | running command: [sh -c set -e if test "$(oc get statefulsets.apps argocd-application-controller -n $NAMESPACE --template '{{range .spec.template.spec.containers}}{{.command}}{{"\n"}}{{end}}')" != \ "[argocd-application-controller \ --operation-processors 10 \ --redis argocd-redis.$NAMESPACE.svc.cluster.local:6379 \ --redis-use-tls \ --redis-ca-certificate /app/config/controller/tls/redis/tls.crt \ --repo-server argocd-repo-server.$NAMESPACE.svc.cluster.local:8081 \ --status-processors 20 \ --kubectl-parallelism-limit 10 \ --loglevel info \ --logformat text]"; then echo "TLS .spec.template.spec.containers.command for argocd-application-controller statefulsets is wrong" exit 1 fi ] logger.go:42: 11:22:03 | 1-066_validate_redis_secure_comm_no_autotls_no_ha/6-check_statefulset | test step completed 6-check_statefulset logger.go:42: 11:22:03 | 1-066_validate_redis_secure_comm_no_autotls_no_ha | skipping kubernetes event logging logger.go:42: 11:22:03 | 1-066_validate_redis_secure_comm_no_autotls_no_ha | Deleting namespace: kuttl-test-relevant-flounder === CONT kuttl/harness/1-064_validate_security_contexts logger.go:42: 11:22:09 | 1-064_validate_security_contexts | Creating namespace: kuttl-test-included-impala logger.go:42: 11:22:09 | 1-064_validate_security_contexts/1-install | starting test step 1-install I0224 11:22:10.526380 121 request.go:682] Waited for 1.029515987s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/config.openshift.io/v1?timeout=32s logger.go:42: 11:22:12 | 1-064_validate_security_contexts/1-install | ArgoCD:kuttl-test-included-impala/argocd created logger.go:42: 11:22:13 | 1-064_validate_security_contexts/1-install | test step completed 1-install logger.go:42: 11:22:13 | 1-064_validate_security_contexts/2-check-controller-manager | starting test step 2-check-controller-manager logger.go:42: 11:22:13 | 1-064_validate_security_contexts/2-check-controller-manager | running command: [sh -c set -eo pipefail ocp_major_version=$(oc version -o json | jq -r '.openshiftVersion' | cut -d'.' -f 1) ocp_minor_version=$(oc version -o json | jq -r '.openshiftVersion' | cut -d'.' -f 2) security_context=$(oc get deployment/openshift-gitops-operator-controller-manager -n openshift-operators -o jsonpath='{.spec.template.spec.containers[].securityContext}') expected_security_context='{"allowPrivilegeEscalation":false,"capabilities":{"drop":["ALL"]},"readOnlyRootFilesystem":true,"runAsNonRoot":true}' if [ "${ocp_major_version}" -eq 4 ] && [ "${ocp_minor_version}" -ge 12 ]; then if [ "${security_context}" = "${expected_security_context}" ]; then exit 0 else echo "Error: deployment/openshift-gitops-operator-controller-manager container's security context is wrong" exit 1 fi else echo "Info: This test is only applicable to OCP version 4.12 and higher." exit 0 fi ] logger.go:42: 11:22:14 | 1-064_validate_security_contexts/2-check-controller-manager | Error from server (NotFound): deployments.apps "openshift-gitops-operator-controller-manager" not found case.go:364: failed in step 2-check-controller-manager case.go:366: exit status 1 logger.go:42: 11:22:17 | 1-064_validate_security_contexts | skipping kubernetes event logging logger.go:42: 11:22:17 | 1-064_validate_security_contexts | Deleting namespace: kuttl-test-included-impala === CONT kuttl/harness/1-063_validate_statefulset_restart logger.go:42: 11:22:23 | 1-063_validate_statefulset_restart | Creating namespace: kuttl-test-correct-sailfish logger.go:42: 11:22:23 | 1-063_validate_statefulset_restart/1-install | starting test step 1-install I0224 11:22:24.478759 121 request.go:682] Waited for 1.028048648s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/autoscaling/v2?timeout=32s logger.go:42: 11:22:25 | 1-063_validate_statefulset_restart/1-install | ArgoCD:kuttl-test-correct-sailfish/example-argocd created logger.go:42: 11:22:57 | 1-063_validate_statefulset_restart/1-install | test step completed 1-install logger.go:42: 11:22:57 | 1-063_validate_statefulset_restart/2-change_to_invalid_image | starting test step 2-change_to_invalid_image logger.go:42: 11:22:57 | 1-063_validate_statefulset_restart/2-change_to_invalid_image | running command: [sh -c set -e oc patch statefulset/example-argocd-application-controller \ -n $NAMESPACE \ --type "json" \ -p '[{"op":"replace","path":"/spec/template/spec/containers/0/image","value":"invalid_image"}]' sleep 10 ] logger.go:42: 11:22:58 | 1-063_validate_statefulset_restart/2-change_to_invalid_image | statefulset.apps/example-argocd-application-controller patched I0224 11:23:09.559080 121 request.go:682] Waited for 1.028883873s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/pipelines.openshift.io/v1alpha1?timeout=32s logger.go:42: 11:23:11 | 1-063_validate_statefulset_restart/2-change_to_invalid_image | test step completed 2-change_to_invalid_image logger.go:42: 11:23:11 | 1-063_validate_statefulset_restart/3-check_image_after_change | starting test step 3-check_image_after_change logger.go:42: 11:23:11 | 1-063_validate_statefulset_restart/3-check_image_after_change | running command: [sh -c set -e image=$(oc get statefulset/example-argocd-application-controller -o jsonpath='{.spec.template.spec.containers[].image}' -n $NAMESPACE) if test "${image}" == "invalid_image"; then echo "The application-controller statefulset is using 'invalid_image'" exit 1 fi exit 0 ] logger.go:42: 11:23:14 | 1-063_validate_statefulset_restart/3-check_image_after_change | test step completed 3-check_image_after_change logger.go:42: 11:23:14 | 1-063_validate_statefulset_restart | skipping kubernetes event logging logger.go:42: 11:23:14 | 1-063_validate_statefulset_restart | Deleting namespace: kuttl-test-correct-sailfish === CONT kuttl/harness/1-063_validate_dex_liveness_probe logger.go:42: 11:23:20 | 1-063_validate_dex_liveness_probe | Creating namespace: kuttl-test-major-heron logger.go:42: 11:23:20 | 1-063_validate_dex_liveness_probe/1- | starting test step 1- I0224 11:23:21.312688 121 request.go:682] Waited for 1.029007131s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operator.openshift.io/v1?timeout=32s logger.go:42: 11:23:22 | 1-063_validate_dex_liveness_probe/1- | test step completed 1- logger.go:42: 11:23:22 | 1-063_validate_dex_liveness_probe | skipping kubernetes event logging logger.go:42: 11:23:22 | 1-063_validate_dex_liveness_probe | Deleting namespace: kuttl-test-major-heron === CONT kuttl/harness/1-021_validate_rolebindings logger.go:42: 11:23:28 | 1-021_validate_rolebindings | Creating namespace: kuttl-test-whole-squirrel logger.go:42: 11:23:28 | 1-021_validate_rolebindings/1-install | starting test step 1-install logger.go:42: 11:23:31 | 1-021_validate_rolebindings/1-install | ArgoCD:kuttl-test-whole-squirrel/argocd created logger.go:42: 11:24:03 | 1-021_validate_rolebindings/1-install | test step completed 1-install logger.go:42: 11:24:03 | 1-021_validate_rolebindings | skipping kubernetes event logging logger.go:42: 11:24:03 | 1-021_validate_rolebindings | Deleting namespace: kuttl-test-whole-squirrel === CONT kuttl/harness/1-036_validate_keycloak_resource_reqs logger.go:42: 11:24:09 | 1-036_validate_keycloak_resource_reqs | Creating namespace: kuttl-test-fluent-dodo logger.go:42: 11:24:09 | 1-036_validate_keycloak_resource_reqs/1-install | starting test step 1-install I0224 11:24:10.186258 121 request.go:682] Waited for 1.029398419s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/template.openshift.io/v1?timeout=32s logger.go:42: 11:24:11 | 1-036_validate_keycloak_resource_reqs/1-install | ArgoCD:kuttl-test-fluent-dodo/argocd created logger.go:42: 11:24:23 | 1-036_validate_keycloak_resource_reqs/1-install | test step completed 1-install logger.go:42: 11:24:23 | 1-036_validate_keycloak_resource_reqs/2-update-sso-keycloak-provider | starting test step 2-update-sso-keycloak-provider logger.go:42: 11:24:23 | 1-036_validate_keycloak_resource_reqs/2-update-sso-keycloak-provider | running command: [sh -c oc patch -n $NAMESPACE argocd/argocd --type='json' -p='[{"op": "add", "path": "/spec/sso", "value": {"provider": "keycloak"}}]' ] logger.go:42: 11:24:24 | 1-036_validate_keycloak_resource_reqs/2-update-sso-keycloak-provider | argocd.argoproj.io/argocd patched I0224 11:24:25.247198 121 request.go:682] Waited for 1.028478058s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/build.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-071_validate_SCC_HA logger.go:42: 11:26:38 | 1-071_validate_SCC_HA/3-modify-argocd | test step completed 3-modify-argocd logger.go:42: 11:26:38 | 1-071_validate_SCC_HA/99-delete | starting test step 99-delete I0224 11:26:39.475221 121 request.go:682] Waited for 1.029241095s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/network.operator.openshift.io/v1?timeout=32s logger.go:42: 11:26:40 | 1-071_validate_SCC_HA/99-delete | test step completed 99-delete logger.go:42: 11:26:40 | 1-071_validate_SCC_HA | skipping kubernetes event logging logger.go:42: 11:26:40 | 1-071_validate_SCC_HA | Deleting namespace: kuttl-test-workable-halibut === CONT kuttl/harness/1-036_validate_keycloak_resource_reqs logger.go:42: 11:26:41 | 1-036_validate_keycloak_resource_reqs/2-update-sso-keycloak-provider | test step completed 2-update-sso-keycloak-provider logger.go:42: 11:26:41 | 1-036_validate_keycloak_resource_reqs/3-check-resources | starting test step 3-check-resources logger.go:42: 11:26:41 | 1-036_validate_keycloak_resource_reqs/3-check-resources | running command: [sh -c resources=$(oc get -n $NAMESPACE pod/keycloak-1-deploy -o jsonpath='{.spec.containers[0].resources}') if [[ -n ${resources} ]]; then if [[ "${resources}" != '{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"250m","memory":"256Mi"}}' ]]; then echo "resources spec for pod/keycloak-1-deploy are incorrect" echo "${resources}" exit 1 fi else echo "resources spec not found in pod/keycloak-1-deploy" exit 1 fi ] logger.go:42: 11:26:44 | 1-036_validate_keycloak_resource_reqs/3-check-resources | test step completed 3-check-resources logger.go:42: 11:26:44 | 1-036_validate_keycloak_resource_reqs | skipping kubernetes event logging logger.go:42: 11:26:44 | 1-036_validate_keycloak_resource_reqs | Deleting namespace: kuttl-test-fluent-dodo === CONT kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha logger.go:42: 11:27:01 | 1-069_validate_redis_secure_comm_autotls_ha/1-install | test step completed 1-install logger.go:42: 11:27:01 | 1-069_validate_redis_secure_comm_autotls_ha/2-enable_autotls | starting test step 2-enable_autotls logger.go:42: 11:27:01 | 1-069_validate_redis_secure_comm_autotls_ha/2-enable_autotls | running command: [sh -c set -e oc patch argocds.argoproj.io argocd --type=merge -p '{"spec":{"redis":{"autotls":"openshift"}}}' -n $NAMESPACE ] === CONT kuttl/harness/1-034_validate_webhook_notifications logger.go:42: 11:27:02 | 1-034_validate_webhook_notifications | Creating namespace: kuttl-test-allowing-lobster logger.go:42: 11:27:02 | 1-034_validate_webhook_notifications/0-setup-webhook-server | starting test step 0-setup-webhook-server === CONT kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha logger.go:42: 11:27:02 | 1-069_validate_redis_secure_comm_autotls_ha/2-enable_autotls | argocd.argoproj.io/argocd patched I0224 11:27:03.224528 121 request.go:682] Waited for 1.029648551s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v2?timeout=32s === CONT kuttl/harness/1-034_validate_webhook_notifications logger.go:42: 11:27:04 | 1-034_validate_webhook_notifications/0-setup-webhook-server | Service:kuttl-test-allowing-lobster/webhook created logger.go:42: 11:27:04 | 1-034_validate_webhook_notifications/0-setup-webhook-server | Deployment:kuttl-test-allowing-lobster/webhook created logger.go:42: 11:27:04 | 1-034_validate_webhook_notifications/0-setup-webhook-server | ConfigMap:kuttl-test-allowing-lobster/webhook-config created logger.go:42: 11:27:04 | 1-034_validate_webhook_notifications/0-setup-webhook-server | Secret:kuttl-test-allowing-lobster/webhook-tls created logger.go:42: 11:27:10 | 1-034_validate_webhook_notifications/0-setup-webhook-server | test step completed 0-setup-webhook-server logger.go:42: 11:27:10 | 1-034_validate_webhook_notifications/1-install-argocd | starting test step 1-install-argocd logger.go:42: 11:27:12 | 1-034_validate_webhook_notifications/1-install-argocd | ArgoCD:kuttl-test-allowing-lobster/argocd created === CONT kuttl/harness/1-033_validate_resource_exclusions logger.go:42: 11:27:18 | 1-033_validate_resource_exclusions | Creating namespace: kuttl-test-model-quagga logger.go:42: 11:27:18 | 1-033_validate_resource_exclusions/1-install | starting test step 1-install I0224 11:27:19.293528 121 request.go:682] Waited for 1.028785233s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/cloudcredential.openshift.io/v1?timeout=32s logger.go:42: 11:27:20 | 1-033_validate_resource_exclusions/1-install | ArgoCD:kuttl-test-model-quagga/argocd created === CONT kuttl/harness/1-034_validate_webhook_notifications logger.go:42: 11:27:45 | 1-034_validate_webhook_notifications/1-install-argocd | test step completed 1-install-argocd logger.go:42: 11:27:45 | 1-034_validate_webhook_notifications/2-add-notification-confs | starting test step 2-add-notification-confs I0224 11:27:46.284694 121 request.go:682] Waited for 1.027563717s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/console.openshift.io/v1?timeout=32s logger.go:42: 11:27:47 | 1-034_validate_webhook_notifications/2-add-notification-confs | NotificationsConfiguration:kuttl-test-allowing-lobster/default-notifications-configuration updated logger.go:42: 11:27:47 | 1-034_validate_webhook_notifications/2-add-notification-confs | test step completed 2-add-notification-confs logger.go:42: 11:27:47 | 1-034_validate_webhook_notifications/3-sleep | starting test step 3-sleep logger.go:42: 11:27:47 | 1-034_validate_webhook_notifications/3-sleep | running command: [sh -c sleep 20] === CONT kuttl/harness/1-033_validate_resource_exclusions logger.go:42: 11:27:52 | 1-033_validate_resource_exclusions/1-install | test step completed 1-install logger.go:42: 11:27:52 | 1-033_validate_resource_exclusions/2-add_resource_exclusions | starting test step 2-add_resource_exclusions logger.go:42: 11:27:55 | 1-033_validate_resource_exclusions/2-add_resource_exclusions | ArgoCD:kuttl-test-model-quagga/argocd updated logger.go:42: 11:27:56 | 1-033_validate_resource_exclusions/2-add_resource_exclusions | test step completed 2-add_resource_exclusions logger.go:42: 11:27:56 | 1-033_validate_resource_exclusions | skipping kubernetes event logging logger.go:42: 11:27:56 | 1-033_validate_resource_exclusions | Deleting namespace: kuttl-test-model-quagga === CONT kuttl/harness/1-033_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:28:02 | 1-033_validate_applicationset_tls_scm_volume_mount | Creating namespace: kuttl-test-wired-dragon logger.go:42: 11:28:02 | 1-033_validate_applicationset_tls_scm_volume_mount/1-install | starting test step 1-install I0224 11:28:03.707259 121 request.go:682] Waited for 1.029495633s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/authorization.openshift.io/v1?timeout=32s logger.go:42: 11:28:05 | 1-033_validate_applicationset_tls_scm_volume_mount/1-install | Namespace:/test-1-32-appsets-scm-tls-mount created logger.go:42: 11:28:05 | 1-033_validate_applicationset_tls_scm_volume_mount/1-install | ConfigMap:test-1-32-appsets-scm-tls-mount/argocd-appset-gitlab-scm-tls-certs-cm created logger.go:42: 11:28:05 | 1-033_validate_applicationset_tls_scm_volume_mount/1-install | ArgoCD:test-1-32-appsets-scm-tls-mount/argocd created === CONT kuttl/harness/1-034_validate_webhook_notifications logger.go:42: 11:28:10 | 1-034_validate_webhook_notifications/3-sleep | test step completed 3-sleep logger.go:42: 11:28:10 | 1-034_validate_webhook_notifications/4-create-app | starting test step 4-create-app logger.go:42: 11:28:10 | 1-034_validate_webhook_notifications/4-create-app | running command: [sh -c set -e cat << EOF | kubectl apply -f - apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name: my-app-3 namespace: $NAMESPACE annotations: "notifications.argoproj.io/subscribe.test-on-created.test-webhook": "" spec: destination: namespace: $NAMESPACE server: https://kubernetes.default.svc project: default source: repoURL: https://github.com/redhat-developer/gitops-operator path: test/examples/nginx targetRevision: HEAD EOF ] logger.go:42: 11:28:11 | 1-034_validate_webhook_notifications/4-create-app | application.argoproj.io/my-app-3 created logger.go:42: 11:28:11 | 1-034_validate_webhook_notifications/4-create-app | running command: [sh -c sleep 10] I0224 11:28:22.152745 121 request.go:682] Waited for 1.028485116s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/security.internal.openshift.io/v1?timeout=32s logger.go:42: 11:28:23 | 1-034_validate_webhook_notifications/4-create-app | test step completed 4-create-app logger.go:42: 11:28:23 | 1-034_validate_webhook_notifications/5-verify-webhook-notification | starting test step 5-verify-webhook-notification logger.go:42: 11:28:23 | 1-034_validate_webhook_notifications/5-verify-webhook-notification | running command: [sh -c #!/bin/bash kubectl -n $NAMESPACE logs deployment.apps/example-notifications-controller | grep "x509" PREV_CMD=$? if [ $PREV_CMD -eq 1 ]; then exit 0 else exit 1 fi ] logger.go:42: 11:28:23 | 1-034_validate_webhook_notifications/5-verify-webhook-notification | error: error from server (NotFound): deployments.apps "example-notifications-controller" not found in namespace "kuttl-test-allowing-lobster" logger.go:42: 11:28:24 | 1-034_validate_webhook_notifications/5-verify-webhook-notification | running command: [sh -c #!/bin/bash # delays could occur in receiving notification, hence retry before failing for i in {1..5} do sleep 5 kubectl -n $NAMESPACE logs deployment.apps/webhook | grep '{"created":"my-app-3","type":"Directory"}' && break done ] logger.go:42: 11:28:29 | 1-034_validate_webhook_notifications/5-verify-webhook-notification | [webhook] 2025/02/24 11:28:14 [66f06d] executing /usr/bin/date (/usr/bin/date) with arguments ["/usr/bin/date"] and environment [PAYLOAD={"created":"my-app-3","type":"Directory"}] using /var/webhook as cwd logger.go:42: 11:28:31 | 1-034_validate_webhook_notifications/5-verify-webhook-notification | test step completed 5-verify-webhook-notification logger.go:42: 11:28:31 | 1-034_validate_webhook_notifications | skipping kubernetes event logging logger.go:42: 11:28:32 | 1-034_validate_webhook_notifications | Deleting namespace: kuttl-test-allowing-lobster === CONT kuttl/harness/1-033_validate_applicationset_tls_scm_volume_mount logger.go:42: 11:28:38 | 1-033_validate_applicationset_tls_scm_volume_mount/1-install | test step completed 1-install logger.go:42: 11:28:38 | 1-033_validate_applicationset_tls_scm_volume_mount | skipping kubernetes event logging logger.go:42: 11:28:38 | 1-033_validate_applicationset_tls_scm_volume_mount | Deleting namespace: kuttl-test-wired-dragon === CONT kuttl/harness/1-047_validate_custom_env logger.go:42: 11:28:38 | 1-047_validate_custom_env | Creating namespace: kuttl-test-grown-catfish logger.go:42: 11:28:38 | 1-047_validate_custom_env/1-install | starting test step 1-install I0224 11:28:39.354761 121 request.go:682] Waited for 1.022792111s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/flowcontrol.apiserver.k8s.io/v1beta3?timeout=32s logger.go:42: 11:28:40 | 1-047_validate_custom_env/1-install | ArgoCD:kuttl-test-grown-catfish/argocd created === CONT kuttl/harness/1-032_validate_resource_inclusions logger.go:42: 11:28:44 | 1-032_validate_resource_inclusions | Creating namespace: kuttl-test-desired-egret logger.go:42: 11:28:44 | 1-032_validate_resource_inclusions/1-install | starting test step 1-install logger.go:42: 11:28:46 | 1-032_validate_resource_inclusions/1-install | ArgoCD:kuttl-test-desired-egret/argocd created === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:29:10 | 1-067_validate_redis_secure_comm_no_autotls_ha/1-install | test step completed 1-install logger.go:42: 11:29:10 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | starting test step 2-generate_cert logger.go:42: 11:29:10 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | running command: [sh -c set -e if [[ $(uname -o) == "Darwin" ]]; then echo "\n[SAN]\nsubjectAltName=DNS:argocd-redis.$NAMESPACE.svc.cluster.local\n[req]\ndistinguished_name=req" > ${PWD}/openssl_test.cnf else echo -e "\n[SAN]\nsubjectAltName=DNS:argocd-redis.$NAMESPACE.svc.cluster.local\n[req]\ndistinguished_name=req" > ${PWD}/openssl_test.cnf fi openssl req -new -x509 \ -subj "/C=XX/ST=XX/O=Testing/CN=redis" \ -reqexts SAN -extensions SAN \ -config ${PWD}/openssl_test.cnf \ -keyout ${PWD}/redis-ha.key \ -out ${PWD}/redis-ha.crt \ -newkey rsa:4096 \ -nodes \ -sha256 \ -days 10 ] logger.go:42: 11:29:12 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | ...........+...+..+...............+...+...+.+...+...+.....+...+.+.........+..+..........+..+.+.........+..+...+.+++++++++++++++++++++++++++++++++++++++++++++*.+...+...+..+............+.+..+....+...+...+...+......+...+.....+.+.....+.........+......+......+...+++++++++++++++++++++++++++++++++++++++++++++*.....+.....+...+....+........+.+......+...+......+..+...+......+................+....................+.........+.........+.........+...............+..........+.....+......+.+......+...+............+..+.+..+...+......+................+...+.........+............+...........+...+..........+.........+...+...............+..............+.+........+.+...+...+........+......+.+..+..........+........+....+...+...........+................+.....+...+...............+...+.........+....+.....+.......+...+......+...+......+.....+....+...+..+.+......+.....+................+...+......+........+......+.+...+........+...+......+......... logger.go:42: 11:29:12 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | ....+..+.+..+...............+.+..............+......+.+++++++++++++++++++++++++++++++++++++++++++++*.+...............+.+..........................+.+.....+....+...+..+.+..+.......+...+......+..+...+.......+.....+....+.....+......+...+....+.....+...+...+.+++++++++++++++++++++++++++++++++++++++++++++*.........+.....+....+......+........+..........+.........+......+..+.......+..+...+...+.............+.....+.........+.+...........+....+.....+.+...+..+.............+...+...+............+..............+.............+......+......+..............+.+.........+......+........+................+..+...................+..............+..........+..+..........+...+++++ logger.go:42: 11:29:12 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | ----- I0224 11:29:13.590410 121 request.go:682] Waited for 1.028234942s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machine.openshift.io/v1?timeout=32s logger.go:42: 11:29:15 | 1-067_validate_redis_secure_comm_no_autotls_ha/2-generate_cert | test step completed 2-generate_cert logger.go:42: 11:29:15 | 1-067_validate_redis_secure_comm_no_autotls_ha/3-create_secret | starting test step 3-create_secret logger.go:42: 11:29:15 | 1-067_validate_redis_secure_comm_no_autotls_ha/3-create_secret | running command: [sh -c set -e # clean up key and cert and config file cleanup() { rm -rf ${PWD}/redis-ha.crt && rm -rf ${PWD}/redis-ha.key && rm -rf ${PWD}/openssl_test.cnf } trap cleanup INT TERM EXIT oc create secret tls argocd-operator-redis-tls --key=${PWD}/redis-ha.key --cert=${PWD}/redis-ha.crt -n $NAMESPACE ] === CONT kuttl/harness/1-047_validate_custom_env logger.go:42: 11:29:15 | 1-047_validate_custom_env/1-install | test step completed 1-install logger.go:42: 11:29:15 | 1-047_validate_custom_env/2-change-env-vars | starting test step 2-change-env-vars === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:29:15 | 1-067_validate_redis_secure_comm_no_autotls_ha/3-create_secret | secret/argocd-operator-redis-tls created === CONT kuttl/harness/1-047_validate_custom_env logger.go:42: 11:29:17 | 1-047_validate_custom_env/2-change-env-vars | ArgoCD:kuttl-test-grown-catfish/argocd updated logger.go:42: 11:29:17 | 1-047_validate_custom_env/2-change-env-vars | test step completed 2-change-env-vars logger.go:42: 11:29:17 | 1-047_validate_custom_env/3-check-workloads | starting test step 3-check-workloads === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:29:20 | 1-067_validate_redis_secure_comm_no_autotls_ha/3-create_secret | test step completed 3-create_secret logger.go:42: 11:29:20 | 1-067_validate_redis_secure_comm_no_autotls_ha/4-create_annotation | starting test step 4-create_annotation logger.go:42: 11:29:20 | 1-067_validate_redis_secure_comm_no_autotls_ha/4-create_annotation | running command: [sh -c set -e oc annotate secret argocd-operator-redis-tls argocds.argoproj.io/name=argocd -n $NAMESPACE ] === CONT kuttl/harness/1-047_validate_custom_env logger.go:42: 11:29:20 | 1-047_validate_custom_env/3-check-workloads | running command: [sh -c sleep 10] === CONT kuttl/harness/1-032_validate_resource_inclusions logger.go:42: 11:29:20 | 1-032_validate_resource_inclusions/1-install | test step completed 1-install logger.go:42: 11:29:20 | 1-032_validate_resource_inclusions/2-add_resource_inclusions | starting test step 2-add_resource_inclusions === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:29:20 | 1-067_validate_redis_secure_comm_no_autotls_ha/4-create_annotation | secret/argocd-operator-redis-tls annotated === CONT kuttl/harness/1-032_validate_resource_inclusions logger.go:42: 11:29:22 | 1-032_validate_resource_inclusions/2-add_resource_inclusions | ArgoCD:kuttl-test-desired-egret/argocd updated I0224 11:29:23.676071 121 request.go:682] Waited for 1.029063073s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1?timeout=32s logger.go:42: 11:29:25 | 1-032_validate_resource_inclusions/2-add_resource_inclusions | test step completed 2-add_resource_inclusions logger.go:42: 11:29:25 | 1-032_validate_resource_inclusions | skipping kubernetes event logging logger.go:42: 11:29:25 | 1-032_validate_resource_inclusions | Deleting namespace: kuttl-test-desired-egret === CONT kuttl/harness/1-047_validate_custom_env logger.go:42: 11:29:30 | 1-047_validate_custom_env/3-check-workloads | running command: [sh -c set -e set -o pipefail for wl in deployment/argocd-server deployment/argocd-repo-server statefulset/argocd-application-controller; do val=$(oc get -n $NAMESPACE $wl -o json | jq -r '.spec.template.spec.containers[0].env[]|select(.name=="FOO").value') if test "$val" != "bar"; then echo "Environment for $wl was not set correctly." exit 1 fi done ] === CONT kuttl/harness/1-048_validate_controller_sharding logger.go:42: 11:29:31 | 1-048_validate_controller_sharding | Creating namespace: kuttl-test-fun-bunny logger.go:42: 11:29:31 | 1-048_validate_controller_sharding/1-install | starting test step 1-install I0224 11:29:33.720830 121 request.go:682] Waited for 2.421861293s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha5?timeout=32s logger.go:42: 11:29:33 | 1-048_validate_controller_sharding/1-install | ArgoCD:kuttl-test-fun-bunny/argocd created === CONT kuttl/harness/1-047_validate_custom_env logger.go:42: 11:29:36 | 1-047_validate_custom_env/3-check-workloads | test step completed 3-check-workloads logger.go:42: 11:29:36 | 1-047_validate_custom_env | skipping kubernetes event logging logger.go:42: 11:29:36 | 1-047_validate_custom_env | Deleting namespace: kuttl-test-grown-catfish === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:29:42 | 1-032_validate_dynamic_scaling | Creating namespace: kuttl-test-finer-zebra logger.go:42: 11:29:42 | 1-032_validate_dynamic_scaling/1-install | starting test step 1-install logger.go:42: 11:29:42 | 1-032_validate_dynamic_scaling/1-install | running command: [sleep 30s] === CONT kuttl/harness/1-065_validate_redis_ha_anti_affinity logger.go:42: 11:29:45 | 1-065_validate_redis_ha_anti_affinity/2- | test step completed 2- logger.go:42: 11:29:45 | 1-065_validate_redis_ha_anti_affinity | skipping kubernetes event logging logger.go:42: 11:29:45 | 1-065_validate_redis_ha_anti_affinity | Deleting namespace: kuttl-test-engaged-quetzal === CONT kuttl/harness/1-048_validate_controller_sharding logger.go:42: 11:30:05 | 1-048_validate_controller_sharding/1-install | test step completed 1-install logger.go:42: 11:30:05 | 1-048_validate_controller_sharding/2-change-sharding | starting test step 2-change-sharding I0224 11:30:06.859889 121 request.go:682] Waited for 1.028984146s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/imageregistry.operator.openshift.io/v1?timeout=32s logger.go:42: 11:30:08 | 1-048_validate_controller_sharding/2-change-sharding | ArgoCD:kuttl-test-fun-bunny/argocd updated === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:30:14 | 1-032_validate_dynamic_scaling/1-install | ArgoCD:kuttl-test-finer-zebra/argocd created === CONT kuttl/harness/1-042_restricted_pss_compliant 2025/02/24 11:30:30 object detected with no GVK Kind for path /kuttl-e2e/gitops-operator/tests/parallel/1-042_restricted_pss_compliant/01-install-argocd-in-restricted-pss-ns copy.yaml logger.go:42: 11:30:30 | 1-042_restricted_pss_compliant | Creating namespace: kuttl-test-equipped-wildcat logger.go:42: 11:30:30 | 1-042_restricted_pss_compliant/1-install-argocd-in-restricted-pss-ns copy | starting test step 1-install-argocd-in-restricted-pss-ns copy I0224 11:30:32.000512 121 request.go:682] Waited for 1.029164433s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/template.openshift.io/v1?timeout=32s logger.go:42: 11:30:33 | 1-042_restricted_pss_compliant/1-install-argocd-in-restricted-pss-ns copy | Namespace:/test-1-042-restricted-pss-compliant created logger.go:42: 11:30:33 | 1-042_restricted_pss_compliant/1-install-argocd-in-restricted-pss-ns copy | ArgoCD:test-1-042-restricted-pss-compliant/argocd created === CONT kuttl/harness/1-048_validate_controller_sharding logger.go:42: 11:30:40 | 1-048_validate_controller_sharding/2-change-sharding | test step completed 2-change-sharding logger.go:42: 11:30:40 | 1-048_validate_controller_sharding/3-check-env | starting test step 3-check-env logger.go:42: 11:30:40 | 1-048_validate_controller_sharding/3-check-env | running command: [sh -c replicas=$(oc get -n $NAMESPACE statefulset argocd-application-controller -o json \ | jq -r '.spec.template.spec.containers[0].env[]|select(.name=="ARGOCD_CONTROLLER_REPLICAS").value') if test "$replicas" != "3"; then echo "Environment ARGOCD_CONTROLLER_REPLICAS not correct. Should '3', is '$replicas'" exit 1 fi ] I0224 11:30:42.462796 121 request.go:682] Waited for 1.029182651s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s logger.go:42: 11:30:43 | 1-048_validate_controller_sharding/3-check-env | test step completed 3-check-env logger.go:42: 11:30:43 | 1-048_validate_controller_sharding/4-change-sharding | starting test step 4-change-sharding logger.go:42: 11:30:46 | 1-048_validate_controller_sharding/4-change-sharding | ArgoCD:kuttl-test-fun-bunny/argocd updated === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:30:47 | 1-032_validate_dynamic_scaling/1-install | test step completed 1-install logger.go:42: 11:30:47 | 1-032_validate_dynamic_scaling/2-add-cluster-secrets | starting test step 2-add-cluster-secrets logger.go:42: 11:30:47 | 1-032_validate_dynamic_scaling/2-add-cluster-secrets | running command: [sleep 30s] === CONT kuttl/harness/1-048_validate_controller_sharding logger.go:42: 11:30:48 | 1-048_validate_controller_sharding/4-change-sharding | test step completed 4-change-sharding logger.go:42: 11:30:48 | 1-048_validate_controller_sharding/5-check-env | starting test step 5-check-env logger.go:42: 11:30:48 | 1-048_validate_controller_sharding/5-check-env | running command: [sh -c # we do expect error from jq here if env is not set at all replicas=$(oc get -n $NAMESPACE statefulset argocd-application-controller -o json \ | jq -r '.spec.template.spec.containers[0].env[]|select(.name=="ARGOCD_CONTROLLER_REPLICASE").value') if test "$replicas" != ""; then echo "Environment ARGOCD_CONTROLLER_REPLICAS not correct. Should '', is '$replicas'" exit 1 fi ] logger.go:42: 11:30:51 | 1-048_validate_controller_sharding/5-check-env | test step completed 5-check-env logger.go:42: 11:30:51 | 1-048_validate_controller_sharding | skipping kubernetes event logging logger.go:42: 11:30:51 | 1-048_validate_controller_sharding | Deleting namespace: kuttl-test-fun-bunny === CONT kuttl/harness/1-030_validate_reencrypt logger.go:42: 11:30:57 | 1-030_validate_reencrypt | Creating namespace: kuttl-test-divine-gnu logger.go:42: 11:30:57 | 1-030_validate_reencrypt/1-install | starting test step 1-install I0224 11:30:59.032879 121 request.go:682] Waited for 1.028870515s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/console.openshift.io/v1alpha1?timeout=32s logger.go:42: 11:31:00 | 1-030_validate_reencrypt/1-install | Namespace:/test-1-30-argo1 created logger.go:42: 11:31:00 | 1-030_validate_reencrypt/1-install | ArgoCD:test-1-30-argo1/argocd created logger.go:42: 11:31:13 | 1-030_validate_reencrypt/1-install | test step completed 1-install logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | starting test step 2-wait logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | running command: [sh -c function wait_until_pods_running() { echo -n "Waiting until all pods in namespace $1 are up" for i in {1..150}; do # timeout after 5 minutes local pods="$(oc get pods --no-headers -n $1 2>/dev/null)" # All pods must be running local not_running=$(echo "${pods}" | grep -v Running | grep -v Completed | wc -l) if [[ -n "${pods}" && ${not_running} -eq 0 ]]; then local all_ready=1 while read pod ; do local status=(`echo -n ${pod} | cut -f2 -d' ' | tr '/' ' '`) # All containers must be ready [[ -z ${status[0]} ]] && all_ready=0 && break [[ -z ${status[1]} ]] && all_ready=0 && break [[ ${status[0]} -lt 1 ]] && all_ready=0 && break [[ ${status[1]} -lt 1 ]] && all_ready=0 && break [[ ${status[0]} -ne ${status[1]} ]] && all_ready=0 && break done <<< $(echo "${pods}" | grep -v Completed) if (( all_ready )); then echo -e "\nAll pods are up:\n${pods}" return 0 fi fi echo -n "." sleep 2 done echo -e "\n\nERROR: timeout waiting for pods to come up\n${pods}" return 1 } wait_until_pods_running "test-1-30-argo1" ] logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | Waiting until all pods in namespace test-1-30-argo1 are up logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | All pods are up: logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | argocd-application-controller-0 1/1 Running 0 12s logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | argocd-redis-5d7958557c-nggdd 1/1 Running 0 12s logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | argocd-repo-server-7d4864cb4b-zkkrd 1/1 Running 0 12s logger.go:42: 11:31:13 | 1-030_validate_reencrypt/2-wait | argocd-server-7954957565-kzs7g 1/1 Running 0 12s I0224 11:31:14.888465 121 request.go:682] Waited for 1.028740568s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/user.openshift.io/v1?timeout=32s logger.go:42: 11:31:16 | 1-030_validate_reencrypt/2-wait | test step completed 2-wait logger.go:42: 11:31:16 | 1-030_validate_reencrypt/3-check-route | starting test step 3-check-route logger.go:42: 11:31:16 | 1-030_validate_reencrypt/3-check-route | running command: [sh -c routeURL=$(oc -n test-1-30-argo1 get route argocd-server -o jsonpath='{.status.ingress[0].host}') if ! curl --silent -k https://${routeURL} | grep -q "Your browser does not support JavaScript."; then echo "Route not configured properly" exit 1 fi ] logger.go:42: 11:31:19 | 1-030_validate_reencrypt/3-check-route | test step completed 3-check-route logger.go:42: 11:31:19 | 1-030_validate_reencrypt | skipping kubernetes event logging logger.go:42: 11:31:19 | 1-030_validate_reencrypt | Deleting namespace: kuttl-test-divine-gnu === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:31:21 | 1-032_validate_dynamic_scaling/2-add-cluster-secrets | Secret:kuttl-test-finer-zebra/cluster-1 created logger.go:42: 11:31:21 | 1-032_validate_dynamic_scaling/2-add-cluster-secrets | Secret:kuttl-test-finer-zebra/cluster-2 created === CONT kuttl/harness/1-029_validate_tls_secret_no_scale logger.go:42: 11:31:25 | 1-029_validate_tls_secret_no_scale | Creating namespace: kuttl-test-regular-grub logger.go:42: 11:31:25 | 1-029_validate_tls_secret_no_scale/1-install | starting test step 1-install I0224 11:31:26.355579 121 request.go:682] Waited for 1.029305462s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1?timeout=32s logger.go:42: 11:31:27 | 1-029_validate_tls_secret_no_scale/1-install | ArgoCD:kuttl-test-regular-grub/argocd created logger.go:42: 11:31:40 | 1-029_validate_tls_secret_no_scale/1-install | test step completed 1-install logger.go:42: 11:31:40 | 1-029_validate_tls_secret_no_scale/2-create-tls-secret | starting test step 2-create-tls-secret logger.go:42: 11:31:40 | 1-029_validate_tls_secret_no_scale/2-create-tls-secret | running command: [sh -c openssl req -x509 -newkey rsa:4096 -keyout /tmp/test-029-key.pem -out /tmp/test-029-cert.pem -subj '/CN=test-029-cert' -days 365 -nodes cert=$(cat /tmp/test-029-cert.pem | base64 -w 0) key=$(cat /tmp/test-029-key.pem | base64 -w 0) # Dirty hack to replace argocd-tls cat <<_EOF_ | oc replace -n $NAMESPACE secret argocd-tls -f - apiVersion: v1 kind: Secret type: kubernetes.io/tls metadata: name: argocd-tls namespace: $NAMESPACE data: tls.key: $key tls.crt: $cert _EOF_ ] logger.go:42: 11:31:40 | 1-029_validate_tls_secret_no_scale/2-create-tls-secret | ...+...+.+...+..+.+.....+...+.........+...+....+........+.............+.....+....+...+.....................+.....+....+...+..............+....+...........+...+.+..+.........+....+..+...+..........+..+....+.....+.+...............+..+..........+..+.+........+.+...+...+........+......+.+..+...+......................+...+..+.+......+.....+.+..............+.+...+.....+.+...+..+..........+.....+....+.....+....+...+............+.....+.......+...+...+..+.+.....+....+.................+....+.....+.........+.......+.....+......+.........+.+.....+....+...+.....+......+.+........+.+..+...+.+.....+.+...+....................+.+......+.....+...+............+...................+...+...........+....+.....+......+.......+..+......+.......+++++++++++++++++++++++++++++++++++++++++++++*...+..+.+.....+.+......+...+.........+.....+.......+.........+.....+.......+...+.........+..+...+++++++++++++++++++++++++++++++++++++++++++++*....+............+... logger.go:42: 11:31:40 | 1-029_validate_tls_secret_no_scale/2-create-tls-secret | ..+....+++++++++++++++++++++++++++++++++++++++++++++*.+....+...+.....+.+......+.....+....+..+...+++++++++++++++++++++++++++++++++++++++++++++*....+..+.+..+.....................+....+...+.....+...+.+..............+......+.........+.+........+.....................+......+....+..+....+.....+..........+......+++++ logger.go:42: 11:31:40 | 1-029_validate_tls_secret_no_scale/2-create-tls-secret | ----- logger.go:42: 11:31:41 | 1-029_validate_tls_secret_no_scale/2-create-tls-secret | secret/argocd-tls replaced I0224 11:31:42.284698 121 request.go:682] Waited for 1.028879114s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/network.openshift.io/v1?timeout=32s logger.go:42: 11:31:43 | 1-029_validate_tls_secret_no_scale/2-create-tls-secret | test step completed 2-create-tls-secret logger.go:42: 11:31:43 | 1-029_validate_tls_secret_no_scale/3-sleep-and-recheck | starting test step 3-sleep-and-recheck logger.go:42: 11:31:43 | 1-029_validate_tls_secret_no_scale/3-sleep-and-recheck | running command: [sh -c sleep 10] I0224 11:31:54.827864 121 request.go:682] Waited for 1.02750537s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/flowcontrol.apiserver.k8s.io/v1beta2?timeout=32s logger.go:42: 11:31:56 | 1-029_validate_tls_secret_no_scale/3-sleep-and-recheck | test step completed 3-sleep-and-recheck logger.go:42: 11:31:56 | 1-029_validate_tls_secret_no_scale | skipping kubernetes event logging === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:31:56 | 1-032_validate_dynamic_scaling/2-add-cluster-secrets | test step completed 2-add-cluster-secrets logger.go:42: 11:31:56 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | starting test step 3-cluster-secrets-exceed-maxShards logger.go:42: 11:31:56 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sleep 60s] === CONT kuttl/harness/1-029_validate_tls_secret_no_scale logger.go:42: 11:31:56 | 1-029_validate_tls_secret_no_scale | Deleting namespace: kuttl-test-regular-grub === CONT kuttl/harness/1-043_validate_log_level_format logger.go:42: 11:32:02 | 1-043_validate_log_level_format | Creating namespace: kuttl-test-keen-adder logger.go:42: 11:32:02 | 1-043_validate_log_level_format/1-install | starting test step 1-install I0224 11:32:04.840805 121 request.go:682] Waited for 2.428889639s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha2?timeout=32s logger.go:42: 11:32:04 | 1-043_validate_log_level_format/1-install | ArgoCD:kuttl-test-keen-adder/argocd created logger.go:42: 11:32:36 | 1-043_validate_log_level_format/1-install | test step completed 1-install logger.go:42: 11:32:36 | 1-043_validate_log_level_format/2-change-loglevel | starting test step 2-change-loglevel I0224 11:32:37.539134 121 request.go:682] Waited for 1.029126317s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v1alpha1?timeout=32s logger.go:42: 11:32:39 | 1-043_validate_log_level_format/2-change-loglevel | ArgoCD:kuttl-test-keen-adder/argocd updated logger.go:42: 11:32:39 | 1-043_validate_log_level_format/2-change-loglevel | test step completed 2-change-loglevel logger.go:42: 11:32:39 | 1-043_validate_log_level_format/3-check-loglevel | starting test step 3-check-loglevel logger.go:42: 11:32:39 | 1-043_validate_log_level_format/3-check-loglevel | running command: [sh -c sleep 15] logger.go:42: 11:32:54 | 1-043_validate_log_level_format/3-check-loglevel | running command: [sh -c set -e set -o pipefail for wl in deployment/argocd-server deployment/argocd-repo-server statefulset/argocd-application-controller; do wlCommand=$(oc get -n $NAMESPACE $wl -o jsonpath='{.spec.template.spec.containers[0].command}'| jq -r '.[]' ) level="debug" format="json" if ! echo "$wlCommand" | grep -qPz -- "--loglevel\\n$level(\$|\\n)"; then echo "logLevel was not set correctly for $wl" echo "CWD: $wlCommand" exit 1 fi if ! echo "$wlCommand" | grep -qPz -- "--logformat\\n$format(\$|\\n)"; then echo "logFormat was not set correctly for $wl" echo "CWD: $wlCommand" exit 1 fi done ] I0224 11:32:56.552615 121 request.go:682] Waited for 1.028793143s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/authorization.k8s.io/v1?timeout=32s logger.go:42: 11:32:58 | 1-043_validate_log_level_format/3-check-loglevel | test step completed 3-check-loglevel logger.go:42: 11:32:58 | 1-043_validate_log_level_format | skipping kubernetes event logging logger.go:42: 11:32:58 | 1-043_validate_log_level_format | Deleting namespace: kuttl-test-keen-adder === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:33:00 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | Secret:kuttl-test-finer-zebra/cluster-3 created logger.go:42: 11:33:00 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | Secret:kuttl-test-finer-zebra/cluster-4 created logger.go:42: 11:33:00 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | Secret:kuttl-test-finer-zebra/cluster-5 created logger.go:42: 11:33:00 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | Secret:kuttl-test-finer-zebra/cluster-6 created logger.go:42: 11:33:00 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:01 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:02 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:02 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:03 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:04 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 === CONT kuttl/harness/1-043_validate_custom_labels_annotations logger.go:42: 11:33:04 | 1-043_validate_custom_labels_annotations | Creating namespace: kuttl-test-awake-llama logger.go:42: 11:33:04 | 1-043_validate_custom_labels_annotations/1-install | starting test step 1-install I0224 11:33:06.558050 121 request.go:682] Waited for 2.224155161s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/network.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:33:06 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] === CONT kuttl/harness/1-043_validate_custom_labels_annotations logger.go:42: 11:33:06 | 1-043_validate_custom_labels_annotations/1-install | ArgoCD:kuttl-test-awake-llama/argocd-sample created === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:33:07 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 === CONT kuttl/harness/1-043_validate_custom_labels_annotations logger.go:42: 11:33:08 | 1-043_validate_custom_labels_annotations/1-install | test step completed 1-install logger.go:42: 11:33:08 | 1-043_validate_custom_labels_annotations/2-delete-labels-annotations | starting test step 2-delete-labels-annotations === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:33:10 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] === CONT kuttl/harness/1-043_validate_custom_labels_annotations logger.go:42: 11:33:10 | 1-043_validate_custom_labels_annotations/2-delete-labels-annotations | ArgoCD:kuttl-test-awake-llama/argocd-sample updated logger.go:42: 11:33:10 | 1-043_validate_custom_labels_annotations/2-delete-labels-annotations | test step completed 2-delete-labels-annotations logger.go:42: 11:33:10 | 1-043_validate_custom_labels_annotations | skipping kubernetes event logging logger.go:42: 11:33:10 | 1-043_validate_custom_labels_annotations | Deleting namespace: kuttl-test-awake-llama === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:33:11 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:12 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:12 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:13 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:14 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:15 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:15 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:16 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:16 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 === CONT kuttl/harness/1-025-validate-managed-by-change logger.go:42: 11:33:17 | 1-025-validate-managed-by-change | Creating namespace: kuttl-test-sound-bobcat logger.go:42: 11:33:17 | 1-025-validate-managed-by-change/1-install | starting test step 1-install I0224 11:33:18.162076 121 request.go:682] Waited for 1.030090116s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/argoproj.io/v1beta1?timeout=32s === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:33:19 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] === CONT kuttl/harness/1-025-validate-managed-by-change logger.go:42: 11:33:19 | 1-025-validate-managed-by-change/1-install | Namespace:/test-1-25-target created logger.go:42: 11:33:19 | 1-025-validate-managed-by-change/1-install | Namespace:/test-1-25-argo1 created logger.go:42: 11:33:19 | 1-025-validate-managed-by-change/1-install | Namespace:/test-1-25-argo2 created logger.go:42: 11:33:19 | 1-025-validate-managed-by-change/1-install | ArgoCD:test-1-25-argo1/argocd created logger.go:42: 11:33:19 | 1-025-validate-managed-by-change/1-install | ArgoCD:test-1-25-argo2/argocd created === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:33:20 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:21 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:21 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:22 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:22 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:24 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:24 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:25 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:25 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:26 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:27 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:28 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:28 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:29 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:30 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:31 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:31 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:32 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:33 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:34 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | running command: [sh -c stsReplicas=$(kubectl get sts argocd-application-controller -n $NAMESPACE -o jsonpath='{.status.replicas}') echo "$stsReplicas" if test "$stsReplicas" != "4"; then echo "FAILED! Number of replicas not equal to maxShards" exit 1 fi exit 0 ] logger.go:42: 11:33:34 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | 4 logger.go:42: 11:33:34 | 1-032_validate_dynamic_scaling/3-cluster-secrets-exceed-maxShards | test step completed 3-cluster-secrets-exceed-maxShards logger.go:42: 11:33:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | starting test step 4-delete-cluster-secret logger.go:42: 11:33:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | running command: [sleep 60s] === CONT kuttl/harness/1-025-validate-managed-by-change logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/1-install | test step completed 1-install logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | starting test step 2-install-app logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | running command: [sh -c function wait_until_pods_running() { echo -n "Waiting until all pods in namespace $1 are up" for i in {1..150}; do # timeout after 5 minutes local pods="$(oc get pods --no-headers -n $1 2>/dev/null)" # All pods must be running local not_running=$(echo "${pods}" | grep -v Running | grep -v Completed | wc -l) if [[ -n "${pods}" && ${not_running} -eq 0 ]]; then local all_ready=1 while read pod ; do local status=(`echo -n ${pod} | cut -f2 -d' ' | tr '/' ' '`) # All containers must be ready [[ -z ${status[0]} ]] && all_ready=0 && break [[ -z ${status[1]} ]] && all_ready=0 && break [[ ${status[0]} -lt 1 ]] && all_ready=0 && break [[ ${status[1]} -lt 1 ]] && all_ready=0 && break [[ ${status[0]} -ne ${status[1]} ]] && all_ready=0 && break done <<< $(echo "${pods}" | grep -v Completed) if (( all_ready )); then echo -e "\nAll pods are up:\n${pods}" return 0 fi fi echo -n "." sleep 2 done echo -e "\n\nERROR: timeout waiting for pods to come up\n${pods}" return 1 } wait_until_pods_running "test-1-25-argo1" wait_until_pods_running "test-1-25-argo2" ] logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | Waiting until all pods in namespace test-1-25-argo1 are up logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | All pods are up: logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | argocd-application-controller-0 1/1 Running 0 32s logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | argocd-redis-5d7958557c-lbtpw 1/1 Running 0 32s logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | argocd-repo-server-5bf9594f64-t99z7 1/1 Running 0 32s logger.go:42: 11:33:53 | 1-025-validate-managed-by-change/2-install-app | argocd-server-59b98dc699-kcwwv 1/1 Running 0 32s logger.go:42: 11:33:54 | 1-025-validate-managed-by-change/2-install-app | Waiting until all pods in namespace test-1-25-argo2 are up logger.go:42: 11:33:54 | 1-025-validate-managed-by-change/2-install-app | All pods are up: logger.go:42: 11:33:54 | 1-025-validate-managed-by-change/2-install-app | argocd-application-controller-0 1/1 Running 0 32s logger.go:42: 11:33:54 | 1-025-validate-managed-by-change/2-install-app | argocd-redis-5d7958557c-r9mgd 1/1 Running 0 32s logger.go:42: 11:33:54 | 1-025-validate-managed-by-change/2-install-app | argocd-repo-server-596cb78599-gsnt6 1/1 Running 0 32s logger.go:42: 11:33:54 | 1-025-validate-managed-by-change/2-install-app | argocd-server-6d85db57c4-trmlb 1/1 Running 0 32s I0224 11:33:55.103327 121 request.go:682] Waited for 1.028190477s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/authorization.k8s.io/v1?timeout=32s logger.go:42: 11:33:56 | 1-025-validate-managed-by-change/2-install-app | Application:test-1-25-argo1/guestbook created logger.go:42: 11:34:08 | 1-025-validate-managed-by-change/2-install-app | test step completed 2-install-app logger.go:42: 11:34:08 | 1-025-validate-managed-by-change/3-update-namespace | starting test step 3-update-namespace I0224 11:34:09.971966 121 request.go:682] Waited for 1.028690226s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/argoproj.io/v1beta1?timeout=32s logger.go:42: 11:34:11 | 1-025-validate-managed-by-change/3-update-namespace | Namespace:/test-1-25-target updated logger.go:42: 11:34:11 | 1-025-validate-managed-by-change/3-update-namespace | Application:test-1-25-argo1/guestbook updated logger.go:42: 11:34:11 | 1-025-validate-managed-by-change/3-update-namespace | Application:test-1-25-argo2/guestbook created logger.go:42: 11:34:17 | 1-025-validate-managed-by-change/3-update-namespace | test step completed 3-update-namespace logger.go:42: 11:34:17 | 1-025-validate-managed-by-change/99-delete | starting test step 99-delete I0224 11:34:31.103633 121 request.go:682] Waited for 1.029535997s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/security.internal.openshift.io/v1?timeout=32s logger.go:42: 11:34:32 | 1-025-validate-managed-by-change/99-delete | test step completed 99-delete logger.go:42: 11:34:32 | 1-025-validate-managed-by-change | skipping kubernetes event logging logger.go:42: 11:34:32 | 1-025-validate-managed-by-change | Deleting namespace: kuttl-test-sound-bobcat === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:34:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | running command: [kubectl delete Secret cluster-2 cluster-3 cluster-4 cluster-5 cluster-6 -n kuttl-test-finer-zebra] logger.go:42: 11:34:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | secret "cluster-2" deleted logger.go:42: 11:34:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | secret "cluster-3" deleted logger.go:42: 11:34:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | secret "cluster-4" deleted logger.go:42: 11:34:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | secret "cluster-5" deleted logger.go:42: 11:34:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | secret "cluster-6" deleted logger.go:42: 11:34:34 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | running command: [sleep 30s] === CONT kuttl/harness/1-007_validate_namespace_scoped_install logger.go:42: 11:34:38 | 1-007_validate_namespace_scoped_install | Creating namespace: kuttl-test-stirred-gobbler logger.go:42: 11:34:38 | 1-007_validate_namespace_scoped_install/1-install | starting test step 1-install logger.go:42: 11:34:41 | 1-007_validate_namespace_scoped_install/1-install | ArgoCD:kuttl-test-stirred-gobbler/argocd created I0224 11:35:06.008516 121 request.go:682] Waited for 1.028267487s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/discovery.k8s.io/v1?timeout=32s === CONT kuttl/harness/1-032_validate_dynamic_scaling logger.go:42: 11:35:07 | 1-032_validate_dynamic_scaling/4-delete-cluster-secret | test step completed 4-delete-cluster-secret logger.go:42: 11:35:07 | 1-032_validate_dynamic_scaling | skipping kubernetes event logging logger.go:42: 11:35:07 | 1-032_validate_dynamic_scaling | Deleting namespace: kuttl-test-finer-zebra === CONT kuttl/harness/1-007_validate_namespace_scoped_install logger.go:42: 11:35:13 | 1-007_validate_namespace_scoped_install/1-install | test step completed 1-install logger.go:42: 11:35:13 | 1-007_validate_namespace_scoped_install/2-check-cluster-secret | starting test step 2-check-cluster-secret logger.go:42: 11:35:13 | 1-007_validate_namespace_scoped_install/2-check-cluster-secret | running command: [sh -c namespaces=$(oc get secret -n $NAMESPACE argocd-default-cluster-config -o jsonpath='{.data.namespaces}' | base64 -d) if test "$namespaces" != "$NAMESPACE"; then echo "Assertion for cluster secret failed!" exit 1 fi exit 0 ] === CONT kuttl/harness/1-019_validate_volume_mounts I0224 11:35:16.048470 121 request.go:682] Waited for 2.328820006s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/api/v1?timeout=32s === CONT kuttl/harness/1-007_validate_namespace_scoped_install logger.go:42: 11:35:16 | 1-007_validate_namespace_scoped_install/2-check-cluster-secret | test step completed 2-check-cluster-secret logger.go:42: 11:35:16 | 1-007_validate_namespace_scoped_install | skipping kubernetes event logging === CONT kuttl/harness/1-019_validate_volume_mounts logger.go:42: 11:35:16 | 1-019_validate_volume_mounts | Creating namespace: kuttl-test-heroic-werewolf logger.go:42: 11:35:16 | 1-019_validate_volume_mounts/1-install | starting test step 1-install === CONT kuttl/harness/1-007_validate_namespace_scoped_install logger.go:42: 11:35:16 | 1-007_validate_namespace_scoped_install | Deleting namespace: kuttl-test-stirred-gobbler === CONT kuttl/harness/1-019_validate_volume_mounts logger.go:42: 11:35:18 | 1-019_validate_volume_mounts/1-install | ArgoCD:kuttl-test-heroic-werewolf/argocd created === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:35:22 | 1-012_validate-managed-by-chain | Ignoring README.md as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 11:35:22 | 1-012_validate-managed-by-chain | Creating namespace: kuttl-test-caring-fowl logger.go:42: 11:35:22 | 1-012_validate-managed-by-chain/1-install | starting test step 1-install logger.go:42: 11:35:24 | 1-012_validate-managed-by-chain/1-install | Namespace:/test-1-12-custom created logger.go:42: 11:35:24 | 1-012_validate-managed-by-chain/1-install | Namespace:/test-1-12-custom2 created logger.go:42: 11:35:24 | 1-012_validate-managed-by-chain/1-install | ArgoCD:kuttl-test-caring-fowl/argocd created === CONT kuttl/harness/1-019_validate_volume_mounts logger.go:42: 11:35:31 | 1-019_validate_volume_mounts/1-install | test step completed 1-install logger.go:42: 11:35:31 | 1-019_validate_volume_mounts | skipping kubernetes event logging logger.go:42: 11:35:31 | 1-019_validate_volume_mounts | Deleting namespace: kuttl-test-heroic-werewolf === CONT kuttl/harness/1-023_validate_repo_server_tls logger.go:42: 11:35:37 | 1-023_validate_repo_server_tls | Creating namespace: kuttl-test-renewing-panther logger.go:42: 11:35:37 | 1-023_validate_repo_server_tls/1-install | starting test step 1-install I0224 11:35:38.464001 121 request.go:682] Waited for 1.030468752s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apiextensions.k8s.io/v1?timeout=32s logger.go:42: 11:35:40 | 1-023_validate_repo_server_tls/1-install | Namespace:/test-1-23-custom created logger.go:42: 11:35:40 | 1-023_validate_repo_server_tls/1-install | ArgoCD:test-1-23-custom/argocd created === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:35:57 | 1-012_validate-managed-by-chain/1-install | test step completed 1-install logger.go:42: 11:35:57 | 1-012_validate-managed-by-chain/2-label-namespace | starting test step 2-label-namespace logger.go:42: 11:35:57 | 1-012_validate-managed-by-chain/2-label-namespace | running command: [sh -c kubectl label ns test-1-12-custom argocd.argoproj.io/managed-by=$NAMESPACE --overwrite] logger.go:42: 11:35:57 | 1-012_validate-managed-by-chain/2-label-namespace | namespace/test-1-12-custom labeled I0224 11:35:58.769547 121 request.go:682] Waited for 1.028393263s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s logger.go:42: 11:36:00 | 1-012_validate-managed-by-chain/2-label-namespace | test step completed 2-label-namespace logger.go:42: 11:36:00 | 1-012_validate-managed-by-chain/3-check-secret | starting test step 3-check-secret logger.go:42: 11:36:00 | 1-012_validate-managed-by-chain/3-check-secret | running command: [sh -c namespaces=$(oc get secret -n $NAMESPACE argocd-default-cluster-config -o jsonpath='{.data.namespaces}' | base64 -d) if test "$namespaces" != "$NAMESPACE,test-1-12-custom"; then echo "Assertion for cluster secret failed!" exit 1 fi exit 0 ] logger.go:42: 11:36:03 | 1-012_validate-managed-by-chain/3-check-secret | test step completed 3-check-secret logger.go:42: 11:36:03 | 1-012_validate-managed-by-chain/4-create-application | starting test step 4-create-application logger.go:42: 11:36:05 | 1-012_validate-managed-by-chain/4-create-application | Application:kuttl-test-caring-fowl/test-1-12-custom created === CONT kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha logger.go:42: 11:36:05 | 1-069_validate_redis_secure_comm_autotls_ha/2-enable_autotls | test step completed 2-enable_autotls logger.go:42: 11:36:05 | 1-069_validate_redis_secure_comm_autotls_ha/3-check_secret | starting test step 3-check_secret logger.go:42: 11:36:05 | 1-069_validate_redis_secure_comm_autotls_ha/3-check_secret | running command: [sh -c set -e secret_type="$(oc get secrets argocd-operator-redis-tls -n $NAMESPACE --template '{{.type}}')" secret_len="$(oc get secrets argocd-operator-redis-tls -n $NAMESPACE --template '{{len .data}}')" expected_secret_type="kubernetes.io/tls" expected_secret_len=2 if test ${secret_type} != ${expected_secret_type}; then echo "argocd-operator-redis-tls secret type is ${secret_type} and should be ${expected_secret_type}" exit 1 fi if test ${secret_len} != ${expected_secret_len}; then echo "argocd-operator-redis-tls secret length is ${secret_len} and should be ${expected_secret_len}" exit 1 fi ] I0224 11:36:08.782262 121 request.go:682] Waited for 2.128828136s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/route.openshift.io/v1?timeout=32s logger.go:42: 11:36:09 | 1-069_validate_redis_secure_comm_autotls_ha/3-check_secret | test step completed 3-check_secret logger.go:42: 11:36:09 | 1-069_validate_redis_secure_comm_autotls_ha | skipping kubernetes event logging logger.go:42: 11:36:09 | 1-069_validate_redis_secure_comm_autotls_ha | Deleting namespace: kuttl-test-hopeful-blowfish === CONT kuttl/harness/1-023_validate_repo_server_tls logger.go:42: 11:36:12 | 1-023_validate_repo_server_tls/1-install | test step completed 1-install logger.go:42: 11:36:12 | 1-023_validate_repo_server_tls/2-change-argocd | starting test step 2-change-argocd logger.go:42: 11:36:14 | 1-023_validate_repo_server_tls/2-change-argocd | ArgoCD:test-1-23-custom/argocd updated logger.go:42: 11:36:15 | 1-023_validate_repo_server_tls/2-change-argocd | test step completed 2-change-argocd logger.go:42: 11:36:15 | 1-023_validate_repo_server_tls/4-install-app | starting test step 4-install-app === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:36:18 | 1-012_validate-managed-by-chain/4-create-application | test step completed 4-create-application logger.go:42: 11:36:18 | 1-012_validate-managed-by-chain/7-label-namespace | starting test step 7-label-namespace logger.go:42: 11:36:18 | 1-012_validate-managed-by-chain/7-label-namespace | running command: [sh -c kubectl label ns test-1-12-custom2 argocd.argoproj.io/managed-by=$NAMESPACE --overwrite] === CONT kuttl/harness/1-023_validate_repo_server_tls logger.go:42: 11:36:18 | 1-023_validate_repo_server_tls/4-install-app | Application:test-1-23-custom/guestbook created === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:36:18 | 1-012_validate-managed-by-chain/7-label-namespace | namespace/test-1-12-custom2 labeled I0224 11:36:19.953215 121 request.go:682] Waited for 1.027135517s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/k8s.cni.cncf.io/v1?timeout=32s logger.go:42: 11:36:21 | 1-012_validate-managed-by-chain/7-label-namespace | test step completed 7-label-namespace logger.go:42: 11:36:21 | 1-012_validate-managed-by-chain/8-create-application | starting test step 8-create-application logger.go:42: 11:36:24 | 1-012_validate-managed-by-chain/8-create-application | Application:kuttl-test-caring-fowl/test-1-12-custom2 created === CONT kuttl/harness/1-023_validate_repo_server_tls logger.go:42: 11:36:30 | 1-023_validate_repo_server_tls/4-install-app | test step completed 4-install-app logger.go:42: 11:36:30 | 1-023_validate_repo_server_tls/99-delete | starting test step 99-delete === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:36:33 | 1-012_validate-managed-by-chain/8-create-application | test step completed 8-create-application logger.go:42: 11:36:33 | 1-012_validate-managed-by-chain/9-delete-app-and-namespace | starting test step 9-delete-app-and-namespace I0224 11:36:43.476986 121 request.go:682] Waited for 1.028765539s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s === CONT kuttl/harness/1-023_validate_repo_server_tls logger.go:42: 11:36:44 | 1-023_validate_repo_server_tls/99-delete | test step completed 99-delete logger.go:42: 11:36:44 | 1-023_validate_repo_server_tls | skipping kubernetes event logging logger.go:42: 11:36:44 | 1-023_validate_repo_server_tls | Deleting namespace: kuttl-test-renewing-panther === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:36:47 | 1-012_validate-managed-by-chain/9-delete-app-and-namespace | test step completed 9-delete-app-and-namespace logger.go:42: 11:36:47 | 1-012_validate-managed-by-chain/10-check-secret | starting test step 10-check-secret logger.go:42: 11:36:47 | 1-012_validate-managed-by-chain/10-check-secret | running command: [sh -c should="$NAMESPACE,test-1-12-custom2" namespaces=$(oc get secret -n $NAMESPACE argocd-default-cluster-config -o jsonpath='{.data.namespaces}' | base64 -d) if test "$namespaces" != "$should"; then echo "Assertion for cluster secret failed! '$namespaces' != '$should'" # 1.2.0 doesn't reconcile the cluster secret on namespace deletion if test GITOPS_TARGET_VERSION = "1.2.0"; then exit 0 else exit 1 fi fi exit 0 ] logger.go:42: 11:36:50 | 1-012_validate-managed-by-chain/10-check-secret | test step completed 10-check-secret logger.go:42: 11:36:50 | 1-012_validate-managed-by-chain/11-recreate-applications | starting test step 11-recreate-applications === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:36:50 | 1-009_validate-manage-other-namespace | Ignoring README.md as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 11:36:50 | 1-009_validate-manage-other-namespace | Ignoring errors.yaml as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 11:36:52 | 1-009_validate-manage-other-namespace | Creating namespace: kuttl-test-pleasing-tomcat logger.go:42: 11:36:52 | 1-009_validate-manage-other-namespace/1-install | starting test step 1-install === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:36:53 | 1-012_validate-managed-by-chain/11-recreate-applications | Namespace:/test-1-12-custom created logger.go:42: 11:36:53 | 1-012_validate-managed-by-chain/11-recreate-applications | Application:kuttl-test-caring-fowl/test-1-12-custom created logger.go:42: 11:36:53 | 1-012_validate-managed-by-chain/11-recreate-applications | Application:kuttl-test-caring-fowl/test-1-12-custom2 created I0224 11:36:54.056204 121 request.go:682] Waited for 1.01893791s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/controlplane.operator.openshift.io/v1alpha1?timeout=32s === CONT kuttl/harness/1-007_validate_volume_mounts logger.go:42: 11:36:55 | 1-007_validate_volume_mounts | Creating namespace: kuttl-test-rich-boxer logger.go:42: 11:36:55 | 1-007_validate_volume_mounts/1-install | starting test step 1-install === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:36:55 | 1-009_validate-manage-other-namespace/1-install | Namespace:/test-1-9-custom created logger.go:42: 11:36:55 | 1-009_validate-manage-other-namespace/1-install | ArgoCD:kuttl-test-pleasing-tomcat/argocd created === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:36:58 | 1-012_validate-managed-by-chain/11-recreate-applications | test step completed 11-recreate-applications logger.go:42: 11:36:58 | 1-012_validate-managed-by-chain/99-delete | starting test step 99-delete === CONT kuttl/harness/1-007_validate_volume_mounts logger.go:42: 11:36:58 | 1-007_validate_volume_mounts/1-install | ArgoCD:kuttl-test-rich-boxer/argocd created I0224 11:37:10.762935 121 request.go:682] Waited for 1.028839804s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apps/v1?timeout=32s === CONT kuttl/harness/1-012_validate-managed-by-chain logger.go:42: 11:37:12 | 1-012_validate-managed-by-chain/99-delete | test step completed 99-delete logger.go:42: 11:37:12 | 1-012_validate-managed-by-chain | skipping kubernetes event logging logger.go:42: 11:37:12 | 1-012_validate-managed-by-chain | Deleting namespace: kuttl-test-caring-fowl === CONT kuttl/harness/1-008_validate-custom-argocd-namespace logger.go:42: 11:37:18 | 1-008_validate-custom-argocd-namespace | Creating namespace: kuttl-test-massive-burro logger.go:42: 11:37:18 | 1-008_validate-custom-argocd-namespace/1-install | starting test step 1-install I0224 11:37:20.772600 121 request.go:682] Waited for 2.07772267s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machineconfiguration.openshift.io/v1?timeout=32s logger.go:42: 11:37:21 | 1-008_validate-custom-argocd-namespace/1-install | Namespace:/test-1-8-custom created logger.go:42: 11:37:21 | 1-008_validate-custom-argocd-namespace/1-install | ArgoCD:test-1-8-custom/argocd created === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:37:27 | 1-009_validate-manage-other-namespace/1-install | test step completed 1-install logger.go:42: 11:37:27 | 1-009_validate-manage-other-namespace/2-label-namespace | starting test step 2-label-namespace logger.go:42: 11:37:27 | 1-009_validate-manage-other-namespace/2-label-namespace | running command: [sh -c kubectl label ns test-1-9-custom argocd.argoproj.io/managed-by=$NAMESPACE] logger.go:42: 11:37:27 | 1-009_validate-manage-other-namespace/2-label-namespace | namespace/test-1-9-custom labeled logger.go:42: 11:37:30 | 1-009_validate-manage-other-namespace/2-label-namespace | test step completed 2-label-namespace logger.go:42: 11:37:30 | 1-009_validate-manage-other-namespace/3-check-secret | starting test step 3-check-secret logger.go:42: 11:37:30 | 1-009_validate-manage-other-namespace/3-check-secret | running command: [sh -c namespaces=$(oc get secret -n $NAMESPACE argocd-default-cluster-config -o jsonpath='{.data.namespaces}' | base64 -d) if test "$namespaces" != "$NAMESPACE,test-1-9-custom"; then echo "Assertion for cluster secret failed!" exit 1 fi exit 0 ] === CONT kuttl/harness/1-007_validate_volume_mounts logger.go:42: 11:37:30 | 1-007_validate_volume_mounts/1-install | test step completed 1-install logger.go:42: 11:37:30 | 1-007_validate_volume_mounts/2-install | starting test step 2-install I0224 11:37:31.581384 121 request.go:682] Waited for 1.037824292s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/network.operator.openshift.io/v1?timeout=32s logger.go:42: 11:37:33 | 1-007_validate_volume_mounts/2-install | ArgoCD:kuttl-test-rich-boxer/argocd updated === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:37:35 | 1-009_validate-manage-other-namespace/3-check-secret | test step completed 3-check-secret logger.go:42: 11:37:35 | 1-009_validate-manage-other-namespace/4-create-application | starting test step 4-create-application logger.go:42: 11:37:38 | 1-009_validate-manage-other-namespace/4-create-application | Application:kuttl-test-pleasing-tomcat/test-1-9-custom created === CONT kuttl/harness/1-007_validate_volume_mounts logger.go:42: 11:37:38 | 1-007_validate_volume_mounts/2-install | test step completed 2-install logger.go:42: 11:37:38 | 1-007_validate_volume_mounts | skipping kubernetes event logging logger.go:42: 11:37:38 | 1-007_validate_volume_mounts | Deleting namespace: kuttl-test-rich-boxer === CONT kuttl/harness/1-045_validate_repo_exec_timeout logger.go:42: 11:37:44 | 1-045_validate_repo_exec_timeout | Creating namespace: kuttl-test-light-monster logger.go:42: 11:37:44 | 1-045_validate_repo_exec_timeout/1-install | starting test step 1-install I0224 11:37:45.328065 121 request.go:682] Waited for 1.028947945s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/route.openshift.io/v1?timeout=32s logger.go:42: 11:37:46 | 1-045_validate_repo_exec_timeout/1-install | ArgoCD:kuttl-test-light-monster/argocd created === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:37:47 | 1-009_validate-manage-other-namespace/4-create-application | test step completed 4-create-application logger.go:42: 11:37:47 | 1-009_validate-manage-other-namespace/5-unlabel-namespace | starting test step 5-unlabel-namespace logger.go:42: 11:37:47 | 1-009_validate-manage-other-namespace/5-unlabel-namespace | running command: [sh -c kubectl label ns test-1-9-custom argocd.argoproj.io/managed-by-] logger.go:42: 11:37:48 | 1-009_validate-manage-other-namespace/5-unlabel-namespace | namespace/test-1-9-custom unlabeled logger.go:42: 11:37:48 | 1-009_validate-manage-other-namespace/5-unlabel-namespace | running command: [sh -c sleep 5] === CONT kuttl/harness/1-008_validate-custom-argocd-namespace logger.go:42: 11:37:52 | 1-008_validate-custom-argocd-namespace/1-install | test step completed 1-install logger.go:42: 11:37:52 | 1-008_validate-custom-argocd-namespace/2-wait | starting test step 2-wait logger.go:42: 11:37:52 | 1-008_validate-custom-argocd-namespace/2-wait | running command: [sh -c function wait_until_pods_running() { echo -n "Waiting until all pods in namespace $1 are up" for i in {1..150}; do # timeout after 5 minutes local pods="$(oc get pods --no-headers -n $1 2>/dev/null)" # All pods must be running local not_running=$(echo "${pods}" | grep -v Running | grep -v Completed | wc -l) if [[ -n "${pods}" && ${not_running} -eq 0 ]]; then local all_ready=1 while read pod ; do local status=(`echo -n ${pod} | cut -f2 -d' ' | tr '/' ' '`) # All containers must be ready [[ -z ${status[0]} ]] && all_ready=0 && break [[ -z ${status[1]} ]] && all_ready=0 && break [[ ${status[0]} -lt 1 ]] && all_ready=0 && break [[ ${status[1]} -lt 1 ]] && all_ready=0 && break [[ ${status[0]} -ne ${status[1]} ]] && all_ready=0 && break done <<< $(echo "${pods}" | grep -v Completed) if (( all_ready )); then echo -e "\nAll pods are up:\n${pods}" return 0 fi fi echo -n "." sleep 2 done echo -e "\n\nERROR: timeout waiting for pods to come up\n${pods}" return 1 } wait_until_pods_running "test-1-8-custom" ] logger.go:42: 11:37:53 | 1-008_validate-custom-argocd-namespace/2-wait | Waiting until all pods in namespace test-1-8-custom are up logger.go:42: 11:37:53 | 1-008_validate-custom-argocd-namespace/2-wait | All pods are up: logger.go:42: 11:37:53 | 1-008_validate-custom-argocd-namespace/2-wait | argocd-application-controller-0 1/1 Running 0 31s logger.go:42: 11:37:53 | 1-008_validate-custom-argocd-namespace/2-wait | argocd-redis-5d7958557c-gmfl6 1/1 Running 0 31s logger.go:42: 11:37:53 | 1-008_validate-custom-argocd-namespace/2-wait | argocd-repo-server-7798564bcb-p8rdg 1/1 Running 0 31s logger.go:42: 11:37:53 | 1-008_validate-custom-argocd-namespace/2-wait | argocd-server-66989cb667-9c2cr 1/1 Running 0 31s I0224 11:37:55.370288 121 request.go:682] Waited for 2.025684578s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machineconfiguration.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:37:55 | 1-009_validate-manage-other-namespace/5-unlabel-namespace | test step completed 5-unlabel-namespace logger.go:42: 11:37:55 | 1-009_validate-manage-other-namespace/6-check-secret | starting test step 6-check-secret logger.go:42: 11:37:55 | 1-009_validate-manage-other-namespace/6-check-secret | running command: [sh -c namespaces=$(oc get secret -n $NAMESPACE argocd-default-cluster-config -o jsonpath='{.data.namespaces}' | base64 -d) if test "$namespaces" != "$NAMESPACE"; then echo "Assertion for cluster secret failed!" exit 1 fi exit 0 ] === CONT kuttl/harness/1-008_validate-custom-argocd-namespace logger.go:42: 11:37:58 | 1-008_validate-custom-argocd-namespace/2-wait | test step completed 2-wait logger.go:42: 11:37:58 | 1-008_validate-custom-argocd-namespace/3-create-app | starting test step 3-create-app === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:38:03 | 1-009_validate-manage-other-namespace/6-check-secret | test step completed 6-check-secret logger.go:42: 11:38:03 | 1-009_validate-manage-other-namespace/7-check | starting test step 7-check === CONT kuttl/harness/1-045_validate_repo_exec_timeout logger.go:42: 11:38:03 | 1-045_validate_repo_exec_timeout/1-install | test step completed 1-install logger.go:42: 11:38:03 | 1-045_validate_repo_exec_timeout/2-change-exec-timeout | starting test step 2-change-exec-timeout I0224 11:38:05.371524 121 request.go:682] Waited for 1.978538437s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/argoproj.io/v1alpha1?timeout=32s === CONT kuttl/harness/1-008_validate-custom-argocd-namespace logger.go:42: 11:38:05 | 1-008_validate-custom-argocd-namespace/3-create-app | Application:test-1-8-custom/validate-custom-argocd created === CONT kuttl/harness/1-045_validate_repo_exec_timeout logger.go:42: 11:38:08 | 1-045_validate_repo_exec_timeout/2-change-exec-timeout | ArgoCD:kuttl-test-light-monster/argocd updated logger.go:42: 11:38:08 | 1-045_validate_repo_exec_timeout/2-change-exec-timeout | test step completed 2-change-exec-timeout logger.go:42: 11:38:08 | 1-045_validate_repo_exec_timeout/4-check-workload-env | starting test step 4-check-workload-env logger.go:42: 11:38:08 | 1-045_validate_repo_exec_timeout/4-check-workload-env | running command: [sh -c sleep 10] === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:38:08 | 1-009_validate-manage-other-namespace/7-check | test step completed 7-check logger.go:42: 11:38:08 | 1-009_validate-manage-other-namespace/99-delete | starting test step 99-delete === CONT kuttl/harness/1-008_validate-custom-argocd-namespace logger.go:42: 11:38:14 | 1-008_validate-custom-argocd-namespace/3-create-app | test step completed 3-create-app logger.go:42: 11:38:14 | 1-008_validate-custom-argocd-namespace/99-delete | starting test step 99-delete === CONT kuttl/harness/1-045_validate_repo_exec_timeout logger.go:42: 11:38:18 | 1-045_validate_repo_exec_timeout/4-check-workload-env | running command: [sh -c timeout=$(oc get -n $NAMESPACE deployment argocd-repo-server -o json \ | jq -r '.spec.template.spec.containers[0].env[]|select(.name=="ARGOCD_EXEC_TIMEOUT").value') if test "$timeout" != "300s"; then echo "Assertion failed. Timeout should be 300, is '$timeout'" exit 1 fi ] I0224 11:38:19.988973 121 request.go:682] Waited for 1.028144408s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/metal3.io/v1alpha1?timeout=32s logger.go:42: 11:38:21 | 1-045_validate_repo_exec_timeout/4-check-workload-env | test step completed 4-check-workload-env logger.go:42: 11:38:21 | 1-045_validate_repo_exec_timeout | skipping kubernetes event logging logger.go:42: 11:38:21 | 1-045_validate_repo_exec_timeout | Deleting namespace: kuttl-test-light-monster === CONT kuttl/harness/1-009_validate-manage-other-namespace logger.go:42: 11:38:23 | 1-009_validate-manage-other-namespace/99-delete | test step completed 99-delete logger.go:42: 11:38:23 | 1-009_validate-manage-other-namespace | skipping kubernetes event logging logger.go:42: 11:38:24 | 1-009_validate-manage-other-namespace | Deleting namespace: kuttl-test-pleasing-tomcat === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:25 | 1-067_validate_redis_secure_comm_no_autotls_ha/4-create_annotation | test step completed 4-create_annotation logger.go:42: 11:38:25 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | starting test step 5-check_redis_config logger.go:42: 11:38:25 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | running command: [sh -c set -e # Define the expected configurations expected_redis_config=( 'port 0' 'tls-port 6379' 'tls-cert-file /app/config/redis/tls/tls.crt' 'tls-ca-cert-file /app/config/redis/tls/tls.crt' 'tls-key-file /app/config/redis/tls/tls.key' 'tls-replication yes' 'tls-auth-clients no' ) expected_sentinel_config=( 'port 0' 'tls-port 26379' 'tls-cert-file "/app/config/redis/tls/tls.crt"' 'tls-ca-cert-file "/app/config/redis/tls/tls.crt"' 'tls-key-file "/app/config/redis/tls/tls.key"' 'tls-replication yes' 'tls-auth-clients no' ) # Function to execute and retry the command if necessary execute_with_retry() { local config=$1 local file=$2 local attempts=3 local previous_time=0 local found=false for attempt in $(seq 1 $attempts); do # Calculate the time interval (increasing with each attempt) interval=$((attempt + previous_time)) echo "Attempt $attempt for '${config}' (Waiting for ${interval}s before execution)" # Execute the command and check if the expected result is found if oc exec -i pod/argocd-redis-ha-server-0 -n $NAMESPACE -c redis -- grep "${config}" $file > /dev/null 2>&1; then echo "Found expected config '${config}' on attempt $attempt." found=true break else echo "Expected config '${config}' not found on attempt $attempt. Retrying..." sleep $interval fi # Update previous_time for the next attempt previous_time=$interval done # If the config was not found after all attempts, log the failure if [ "$found" = false ]; then echo "Failed to find expected config '${config}' after $attempts attempts." fi } # Loop through the redis config and check with retry logic for config in "${expected_redis_config[@]}" do execute_with_retry "$config" "/data/conf/redis.conf" done # Loop through the sentinel config and check with retry logic for config in "${expected_sentinel_config[@]}" do execute_with_retry "$config" "/data/conf/sentinel.conf" done ] logger.go:42: 11:38:25 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'port 0' (Waiting for 1s before execution) logger.go:42: 11:38:25 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'port 0' on attempt 1. logger.go:42: 11:38:25 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-port 6379' (Waiting for 1s before execution) logger.go:42: 11:38:26 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-port 6379' on attempt 1. logger.go:42: 11:38:26 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-cert-file /app/config/redis/tls/tls.crt' (Waiting for 1s before execution) logger.go:42: 11:38:27 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-cert-file /app/config/redis/tls/tls.crt' on attempt 1. logger.go:42: 11:38:27 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-ca-cert-file /app/config/redis/tls/tls.crt' (Waiting for 1s before execution) === CONT kuttl/harness/1-003_validate_console_link === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-ca-cert-file /app/config/redis/tls/tls.crt' on attempt 1. logger.go:42: 11:38:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-key-file /app/config/redis/tls/tls.key' (Waiting for 1s before execution) logger.go:42: 11:38:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-key-file /app/config/redis/tls/tls.key' on attempt 1. logger.go:42: 11:38:28 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-replication yes' (Waiting for 1s before execution) logger.go:42: 11:38:29 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-replication yes' on attempt 1. logger.go:42: 11:38:29 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-auth-clients no' (Waiting for 1s before execution) === CONT kuttl/harness/1-008_validate-custom-argocd-namespace logger.go:42: 11:38:29 | 1-008_validate-custom-argocd-namespace/99-delete | test step completed 99-delete logger.go:42: 11:38:29 | 1-008_validate-custom-argocd-namespace | skipping kubernetes event logging === CONT kuttl/harness/1-003_validate_console_link logger.go:42: 11:38:29 | 1-003_validate_console_link | Creating namespace: kuttl-test-cosmic-sturgeon logger.go:42: 11:38:29 | 1-003_validate_console_link/1-check-console-link | starting test step 1-check-console-link === CONT kuttl/harness/1-008_validate-custom-argocd-namespace logger.go:42: 11:38:29 | 1-008_validate-custom-argocd-namespace | Deleting namespace: kuttl-test-massive-burro === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:29 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-auth-clients no' on attempt 1. logger.go:42: 11:38:29 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'port 0' (Waiting for 1s before execution) === CONT kuttl/harness/1-005_validate_route_tls === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:30 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'port 0' on attempt 1. logger.go:42: 11:38:30 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-port 26379' (Waiting for 1s before execution) I0224 11:38:30.482249 121 request.go:682] Waited for 1.03988088s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/snapshot.storage.k8s.io/v1?timeout=32s logger.go:42: 11:38:31 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-port 26379' on attempt 1. logger.go:42: 11:38:31 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-cert-file "/app/config/redis/tls/tls.crt"' (Waiting for 1s before execution) logger.go:42: 11:38:31 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-cert-file "/app/config/redis/tls/tls.crt"' on attempt 1. logger.go:42: 11:38:31 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-ca-cert-file "/app/config/redis/tls/tls.crt"' (Waiting for 1s before execution) === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:38:31 | 1-005_validate_route_tls | Creating namespace: kuttl-test-charming-mosquito logger.go:42: 11:38:31 | 1-005_validate_route_tls/1-install | starting test step 1-install === CONT kuttl/harness/1-003_validate_console_link logger.go:42: 11:38:31 | 1-003_validate_console_link/1-check-console-link | test step completed 1-check-console-link logger.go:42: 11:38:31 | 1-003_validate_console_link | skipping kubernetes event logging logger.go:42: 11:38:31 | 1-003_validate_console_link | Deleting namespace: kuttl-test-cosmic-sturgeon === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:32 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-ca-cert-file "/app/config/redis/tls/tls.crt"' on attempt 1. logger.go:42: 11:38:32 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-key-file "/app/config/redis/tls/tls.key"' (Waiting for 1s before execution) logger.go:42: 11:38:33 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-key-file "/app/config/redis/tls/tls.key"' on attempt 1. logger.go:42: 11:38:33 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-replication yes' (Waiting for 1s before execution) logger.go:42: 11:38:33 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-replication yes' on attempt 1. logger.go:42: 11:38:33 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Attempt 1 for 'tls-auth-clients no' (Waiting for 1s before execution) logger.go:42: 11:38:34 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | Found expected config 'tls-auth-clients no' on attempt 1. === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:38:34 | 1-005_validate_route_tls/1-install | ArgoCD:kuttl-test-charming-mosquito/example created === CONT kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:36 | 1-067_validate_redis_secure_comm_no_autotls_ha/5-check_redis_config | test step completed 5-check_redis_config logger.go:42: 11:38:36 | 1-067_validate_redis_secure_comm_no_autotls_ha/6-check_deployments | starting test step 6-check_deployments logger.go:42: 11:38:36 | 1-067_validate_redis_secure_comm_no_autotls_ha/6-check_deployments | running command: [sh -c set -e if test "$(oc get deployments.apps argocd-repo-server -n $NAMESPACE --template \ '{{range .spec.template.spec.containers}}{{.command}}{{"\n"}}{{end}}')" != \ "[uid_entrypoint.sh \ argocd-repo-server \ --redis argocd-redis-ha-haproxy.$NAMESPACE.svc.cluster.local:6379 \ --redis-use-tls \ --redis-ca-certificate /app/config/reposerver/tls/redis/tls.crt \ --loglevel info \ --logformat text]"; then echo "TLS .spec.template.spec.containers.command for argocd-repo-server deployment is wrong" exit 1 fi ] === CONT kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm logger.go:42: 11:38:36 | 1-039_validate_fix_argocd-tls-certs-cm | Creating namespace: kuttl-test-causal-grub logger.go:42: 11:38:36 | 1-039_validate_fix_argocd-tls-certs-cm/1-install | starting test step 1-install === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:37 | 1-067_validate_redis_secure_comm_no_autotls_ha/6-check_deployments | running command: [sh -c set -e if test "$(oc get deployments.apps argocd-server -n $NAMESPACE --template \ '{{range .spec.template.spec.containers}}{{.command}}{{"\n"}}{{end}}')" != \ "[argocd-server \ --staticassets /shared/app \ --dex-server https://argocd-dex-server.$NAMESPACE.svc.cluster.local:5556 \ --repo-server argocd-repo-server.$NAMESPACE.svc.cluster.local:8081 \ --redis argocd-redis-ha-haproxy.$NAMESPACE.svc.cluster.local:6379 \ --redis-use-tls \ --redis-ca-certificate /app/config/server/tls/redis/tls.crt \ --loglevel info \ --logformat text]"; then echo "TLS .spec.template.spec.containers.command for argocd-server deployment is wrong" exit 1 fi ] === CONT kuttl/harness/1-038_validate_productized_images === CONT kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm logger.go:42: 11:38:39 | 1-039_validate_fix_argocd-tls-certs-cm/1-install | ArgoCD:kuttl-test-causal-grub/example-argocd created I0224 11:38:40.554225 121 request.go:682] Waited for 1.028651999s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/storage.k8s.io/v1beta1?timeout=32s === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:42 | 1-067_validate_redis_secure_comm_no_autotls_ha/6-check_deployments | test step completed 6-check_deployments logger.go:42: 11:38:42 | 1-067_validate_redis_secure_comm_no_autotls_ha/7-check_statefulset | starting test step 7-check_statefulset === CONT kuttl/harness/1-038_validate_productized_images logger.go:42: 11:38:42 | 1-038_validate_productized_images | Creating namespace: kuttl-test-innocent-mink === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:42 | 1-067_validate_redis_secure_comm_no_autotls_ha/7-check_statefulset | running command: [sh -c set -e if test "$(oc get statefulsets.apps argocd-application-controller -n $NAMESPACE --template \ '{{range .spec.template.spec.containers}}{{.command}}{{"\n"}}{{end}}')" != \ "[argocd-application-controller \ --operation-processors 10 \ --redis argocd-redis-ha-haproxy.$NAMESPACE.svc.cluster.local:6379 \ --redis-use-tls \ --redis-ca-certificate /app/config/controller/tls/redis/tls.crt \ --repo-server argocd-repo-server.$NAMESPACE.svc.cluster.local:8081 \ --status-processors 20 \ --kubectl-parallelism-limit 10 \ --loglevel info \ --logformat text]"; then echo "TLS .spec.template.spec.containers.command for argocd-application-controller statefulsets is wrong" exit 1 fi ] === CONT kuttl/harness/1-038_validate_productized_images logger.go:42: 11:38:42 | 1-038_validate_productized_images/1-install | starting test step 1-install logger.go:42: 11:38:44 | 1-038_validate_productized_images/1-install | ArgoCD:kuttl-test-innocent-mink/argocd created === CONT kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha logger.go:42: 11:38:47 | 1-067_validate_redis_secure_comm_no_autotls_ha/7-check_statefulset | test step completed 7-check_statefulset logger.go:42: 11:38:47 | 1-067_validate_redis_secure_comm_no_autotls_ha | skipping kubernetes event logging logger.go:42: 11:38:47 | 1-067_validate_redis_secure_comm_no_autotls_ha | Deleting namespace: kuttl-test-wealthy-condor === CONT kuttl/harness/1-038_validate_productized_images logger.go:42: 11:38:56 | 1-038_validate_productized_images/1-install | test step completed 1-install logger.go:42: 11:38:56 | 1-038_validate_productized_images/2-check-images | starting test step 2-check-images logger.go:42: 11:38:56 | 1-038_validate_productized_images/2-check-images | running command: [sh -c for wl in deployment/argocd-server deployment/argocd-repo-server statefulset/argocd-application-controller; do image=$(oc -n $NAMESPACE get ${wl} -o jsonpath='{.spec.template.spec.containers[0].image}' | awk -F'@' '{print $1}') if test "$image" != "registry.redhat.io/openshift-gitops-1/argocd-rhel8"; then echo "Non-productized image in workload $wl detected." exit 1 fi done ] I0224 11:38:58.432862 121 request.go:682] Waited for 1.028649599s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha5?timeout=32s logger.go:42: 11:38:59 | 1-038_validate_productized_images/2-check-images | test step completed 2-check-images logger.go:42: 11:38:59 | 1-038_validate_productized_images | skipping kubernetes event logging logger.go:42: 11:38:59 | 1-038_validate_productized_images | Deleting namespace: kuttl-test-innocent-mink === CONT kuttl/harness/1-004_beta_to_alpha_conversion logger.go:42: 11:39:05 | 1-004_beta_to_alpha_conversion | Creating namespace: kuttl-test-daring-lioness logger.go:42: 11:39:05 | 1-004_beta_to_alpha_conversion/1-argocd-dex | starting test step 1-argocd-dex I0224 11:39:08.483355 121 request.go:682] Waited for 2.4793323s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/ingress.operator.openshift.io/v1?timeout=32s logger.go:42: 11:39:08 | 1-004_beta_to_alpha_conversion/1-argocd-dex | ArgoCD:kuttl-test-daring-lioness/argocd created === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:39:08 | 1-005_validate_route_tls/1-install | test step completed 1-install logger.go:42: 11:39:08 | 1-005_validate_route_tls/2-embedded-tls-data | starting test step 2-embedded-tls-data === CONT kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm logger.go:42: 11:39:11 | 1-039_validate_fix_argocd-tls-certs-cm/1-install | test step completed 1-install logger.go:42: 11:39:11 | 1-039_validate_fix_argocd-tls-certs-cm/2-modify_configmap | starting test step 2-modify_configmap === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:39:11 | 1-005_validate_route_tls/2-embedded-tls-data | ArgoCD:kuttl-test-charming-mosquito/example updated === CONT kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm logger.go:42: 11:39:13 | 1-039_validate_fix_argocd-tls-certs-cm/2-modify_configmap | ConfigMap:kuttl-test-causal-grub/argocd-tls-certs-cm updated logger.go:42: 11:39:13 | 1-039_validate_fix_argocd-tls-certs-cm/2-modify_configmap | test step completed 2-modify_configmap logger.go:42: 11:39:13 | 1-039_validate_fix_argocd-tls-certs-cm/3-modify_argocd_cr | starting test step 3-modify_argocd_cr === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:39:16 | 1-005_validate_route_tls/2-embedded-tls-data | test step completed 2-embedded-tls-data logger.go:42: 11:39:16 | 1-005_validate_route_tls/3-secret-tls-data | starting test step 3-secret-tls-data === CONT kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm logger.go:42: 11:39:16 | 1-039_validate_fix_argocd-tls-certs-cm/3-modify_argocd_cr | ArgoCD:kuttl-test-causal-grub/example-argocd updated logger.go:42: 11:39:16 | 1-039_validate_fix_argocd-tls-certs-cm/3-modify_argocd_cr | test step completed 3-modify_argocd_cr logger.go:42: 11:39:16 | 1-039_validate_fix_argocd-tls-certs-cm/4- | starting test step 4- I0224 11:39:18.509848 121 request.go:682] Waited for 2.329099868s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:39:18 | 1-005_validate_route_tls/3-secret-tls-data | ArgoCD:kuttl-test-charming-mosquito/example updated logger.go:42: 11:39:18 | 1-005_validate_route_tls/3-secret-tls-data | Secret:kuttl-test-charming-mosquito/tls-data-secret created === CONT kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm logger.go:42: 11:39:21 | 1-039_validate_fix_argocd-tls-certs-cm/4- | test step completed 4- logger.go:42: 11:39:21 | 1-039_validate_fix_argocd-tls-certs-cm | skipping kubernetes event logging logger.go:42: 11:39:21 | 1-039_validate_fix_argocd-tls-certs-cm | Deleting namespace: kuttl-test-causal-grub === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:39:21 | 1-005_validate_route_tls/3-secret-tls-data | test step completed 3-secret-tls-data logger.go:42: 11:39:21 | 1-005_validate_route_tls/4-update-secret-tls-data | starting test step 4-update-secret-tls-data logger.go:42: 11:39:21 | 1-005_validate_route_tls/4-update-secret-tls-data | running command: [sh -c sleep 10] === CONT kuttl/harness/1-002_alpha_to_beta_keycloak_conversion logger.go:42: 11:39:27 | 1-002_alpha_to_beta_keycloak_conversion | Creating namespace: kuttl-test-decent-possum logger.go:42: 11:39:27 | 1-002_alpha_to_beta_keycloak_conversion/1-argocd-keycloak | starting test step 1-argocd-keycloak I0224 11:39:28.547048 121 request.go:682] Waited for 1.329693959s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/quota.openshift.io/v1?timeout=32s logger.go:42: 11:39:29 | 1-002_alpha_to_beta_keycloak_conversion/1-argocd-keycloak | ArgoCD:kuttl-test-decent-possum/argocd created === CONT kuttl/harness/1-045_validate_applicationset_image_override logger.go:42: 11:39:33 | 1-045_validate_applicationset_image_override | Creating namespace: kuttl-test-joint-buffalo logger.go:42: 11:39:33 | 1-045_validate_applicationset_image_override/1-add_applicationset_image | starting test step 1-add_applicationset_image === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:39:33 | 1-005_validate_route_tls/4-update-secret-tls-data | Secret:kuttl-test-charming-mosquito/tls-data-secret updated === CONT kuttl/harness/1-045_validate_applicationset_image_override logger.go:42: 11:39:36 | 1-045_validate_applicationset_image_override/1-add_applicationset_image | ArgoCD:kuttl-test-joint-buffalo/example-argocd created === CONT kuttl/harness/1-005_validate_route_tls logger.go:42: 11:39:36 | 1-005_validate_route_tls/4-update-secret-tls-data | test step completed 4-update-secret-tls-data logger.go:42: 11:39:36 | 1-005_validate_route_tls | skipping kubernetes event logging logger.go:42: 11:39:36 | 1-005_validate_route_tls | Deleting namespace: kuttl-test-charming-mosquito === CONT kuttl/harness/1-045_validate_applicationset_image_override logger.go:42: 11:39:38 | 1-045_validate_applicationset_image_override/1-add_applicationset_image | test step completed 1-add_applicationset_image logger.go:42: 11:39:38 | 1-045_validate_applicationset_image_override/2-remove_argocdcustom_image | starting test step 2-remove_argocdcustom_image I0224 11:39:39.475690 121 request.go:682] Waited for 1.02858025s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha1?timeout=32s === CONT kuttl/harness/1-004_beta_to_alpha_conversion logger.go:42: 11:39:40 | 1-004_beta_to_alpha_conversion/1-argocd-dex | test step completed 1-argocd-dex logger.go:42: 11:39:40 | 1-004_beta_to_alpha_conversion/2-delete | starting test step 2-delete === CONT kuttl/harness/1-045_validate_applicationset_image_override logger.go:42: 11:39:40 | 1-045_validate_applicationset_image_override/2-remove_argocdcustom_image | ArgoCD:kuttl-test-joint-buffalo/example-argocd updated === CONT kuttl/harness/1-051-validate_csv_permissions logger.go:42: 11:39:43 | 1-051-validate_csv_permissions | Creating namespace: kuttl-test-musical-crane === CONT kuttl/harness/1-045_validate_applicationset_image_override logger.go:42: 11:39:43 | 1-045_validate_applicationset_image_override/2-remove_argocdcustom_image | test step completed 2-remove_argocdcustom_image logger.go:42: 11:39:43 | 1-045_validate_applicationset_image_override | skipping kubernetes event logging === CONT kuttl/harness/1-051-validate_csv_permissions logger.go:42: 11:39:43 | 1-051-validate_csv_permissions/1-validate | starting test step 1-validate logger.go:42: 11:39:43 | 1-051-validate_csv_permissions/1-validate | running command: [sh -c set -e res=$(oc auth can-i delete resourcequotas -n openshift-gitops --as system:serviceaccount:openshift-operators:openshift-gitops-operator-controller-manager) if test "$res" != "yes"; then echo "Can't delete resourcequotas" exit 1 fi ] === CONT kuttl/harness/1-045_validate_applicationset_image_override logger.go:42: 11:39:43 | 1-045_validate_applicationset_image_override | Deleting namespace: kuttl-test-joint-buffalo === CONT kuttl/harness/1-004_beta_to_alpha_conversion logger.go:42: 11:39:43 | 1-004_beta_to_alpha_conversion/2-delete | test step completed 2-delete logger.go:42: 11:39:43 | 1-004_beta_to_alpha_conversion | skipping kubernetes event logging logger.go:42: 11:39:43 | 1-004_beta_to_alpha_conversion | Deleting namespace: kuttl-test-daring-lioness === CONT kuttl/harness/1-051-validate_csv_permissions case.go:364: failed in step 1-validate case.go:366: exit status 1 logger.go:42: 11:39:46 | 1-051-validate_csv_permissions | skipping kubernetes event logging logger.go:42: 11:39:46 | 1-051-validate_csv_permissions | Deleting namespace: kuttl-test-musical-crane === CONT kuttl/harness/1-050_validate_sso logger.go:42: 11:39:49 | 1-050_validate_sso | Creating namespace: kuttl-test-apt-raptor logger.go:42: 11:39:49 | 1-050_validate_sso/1-install | starting test step 1-install === CONT kuttl/harness/1-003_alpha_to_beta_sso_conflict_conversion I0224 11:39:50.863204 121 request.go:682] Waited for 1.027917521s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha2?timeout=32s logger.go:42: 11:39:52 | 1-003_alpha_to_beta_sso_conflict_conversion | Creating namespace: kuttl-test-vital-llama logger.go:42: 11:39:52 | 1-003_alpha_to_beta_sso_conflict_conversion/1-argocd-dex-keycloak-conflict | starting test step 1-argocd-dex-keycloak-conflict === CONT kuttl/harness/1-050_validate_sso logger.go:42: 11:39:52 | 1-050_validate_sso/1-install | ArgoCD:kuttl-test-apt-raptor/argocd created === CONT kuttl/harness/1-053_validate_cluster_admin_rbac logger.go:42: 11:39:54 | 1-053_validate_cluster_admin_rbac | Creating namespace: kuttl-test-faithful-baboon logger.go:42: 11:39:54 | 1-053_validate_cluster_admin_rbac/1- | starting test step 1- === CONT kuttl/harness/1-003_alpha_to_beta_sso_conflict_conversion logger.go:42: 11:39:54 | 1-003_alpha_to_beta_sso_conflict_conversion/1-argocd-dex-keycloak-conflict | ArgoCD:kuttl-test-vital-llama/argocd created === CONT kuttl/harness/1-053_validate_cluster_admin_rbac logger.go:42: 11:39:57 | 1-053_validate_cluster_admin_rbac/1- | test step completed 1- logger.go:42: 11:39:57 | 1-053_validate_cluster_admin_rbac/2- | starting test step 2- logger.go:42: 11:39:59 | 1-053_validate_cluster_admin_rbac/2- | test step completed 2- logger.go:42: 11:39:59 | 1-053_validate_cluster_admin_rbac | skipping kubernetes event logging logger.go:42: 11:39:59 | 1-053_validate_cluster_admin_rbac | Deleting namespace: kuttl-test-faithful-baboon === CONT kuttl/harness/1-002_alpha_to_beta_keycloak_conversion logger.go:42: 11:40:01 | 1-002_alpha_to_beta_keycloak_conversion/1-argocd-keycloak | test step completed 1-argocd-keycloak logger.go:42: 11:40:01 | 1-002_alpha_to_beta_keycloak_conversion/2-delete | starting test step 2-delete I0224 11:40:03.185554 121 request.go:682] Waited for 1.028256006s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/tuned.openshift.io/v1?timeout=32s logger.go:42: 11:40:04 | 1-002_alpha_to_beta_keycloak_conversion/2-delete | test step completed 2-delete logger.go:42: 11:40:04 | 1-002_alpha_to_beta_keycloak_conversion | skipping kubernetes event logging logger.go:42: 11:40:04 | 1-002_alpha_to_beta_keycloak_conversion | Deleting namespace: kuttl-test-decent-possum === CONT kuttl/harness/1-050_validate_sso logger.go:42: 11:40:05 | 1-050_validate_sso/1-install | test step completed 1-install logger.go:42: 11:40:05 | 1-050_validate_sso/2-remove-spec-sso | starting test step 2-remove-spec-sso logger.go:42: 11:40:05 | 1-050_validate_sso/2-remove-spec-sso | running command: [sh -c oc patch -n $NAMESPACE argocd/argocd --type='json' -p='[{"op": "remove", "path": "/spec/sso"}]' ] === CONT kuttl/harness/1-054_validate_deploymentconfig logger.go:42: 11:40:05 | 1-054_validate_deploymentconfig | Creating namespace: kuttl-test-credible-bug logger.go:42: 11:40:05 | 1-054_validate_deploymentconfig/1-install | starting test step 1-install === CONT kuttl/harness/1-050_validate_sso logger.go:42: 11:40:06 | 1-050_validate_sso/2-remove-spec-sso | argocd.argoproj.io/argocd patched logger.go:42: 11:40:06 | 1-050_validate_sso/2-remove-spec-sso | running command: [sh -c sleep 10] === CONT kuttl/harness/1-054_validate_deploymentconfig logger.go:42: 11:40:08 | 1-054_validate_deploymentconfig/1-install | ArgoCD:kuttl-test-credible-bug/argocd created I0224 11:40:17.259876 121 request.go:682] Waited for 1.028423041s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/networking.k8s.io/v1?timeout=32s === CONT kuttl/harness/1-050_validate_sso logger.go:42: 11:40:18 | 1-050_validate_sso/2-remove-spec-sso | test step completed 2-remove-spec-sso logger.go:42: 11:40:18 | 1-050_validate_sso/7-provider-keycloak-dex-spec | starting test step 7-provider-keycloak-dex-spec logger.go:42: 11:40:21 | 1-050_validate_sso/7-provider-keycloak-dex-spec | ArgoCD:kuttl-test-apt-raptor/argocd updated logger.go:42: 11:40:21 | 1-050_validate_sso/7-provider-keycloak-dex-spec | test step completed 7-provider-keycloak-dex-spec logger.go:42: 11:40:21 | 1-050_validate_sso/8-remove-spec-dex | starting test step 8-remove-spec-dex logger.go:42: 11:40:21 | 1-050_validate_sso/8-remove-spec-dex | running command: [sh -c oc patch -n $NAMESPACE argocd/argocd --type='json' -p='[{"op": "remove", "path": "/spec/sso/dex"}]' ] logger.go:42: 11:40:21 | 1-050_validate_sso/8-remove-spec-dex | argocd.argoproj.io/argocd patched === CONT kuttl/harness/1-003_alpha_to_beta_sso_conflict_conversion logger.go:42: 11:40:26 | 1-003_alpha_to_beta_sso_conflict_conversion/1-argocd-dex-keycloak-conflict | test step completed 1-argocd-dex-keycloak-conflict logger.go:42: 11:40:26 | 1-003_alpha_to_beta_sso_conflict_conversion/2-delete | starting test step 2-delete I0224 11:40:27.597756 121 request.go:682] Waited for 1.027318814s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/storage.k8s.io/v1?timeout=32s logger.go:42: 11:40:29 | 1-003_alpha_to_beta_sso_conflict_conversion/2-delete | test step completed 2-delete logger.go:42: 11:40:29 | 1-003_alpha_to_beta_sso_conflict_conversion | skipping kubernetes event logging logger.go:42: 11:40:29 | 1-003_alpha_to_beta_sso_conflict_conversion | Deleting namespace: kuttl-test-vital-llama === CONT kuttl/harness/1-052_validate_rolebinding_number logger.go:42: 11:40:35 | 1-052_validate_rolebinding_number | Creating namespace: kuttl-test-improved-cod logger.go:42: 11:40:35 | 1-052_validate_rolebinding_number/1-label_namespace | starting test step 1-label_namespace logger.go:42: 11:40:35 | 1-052_validate_rolebinding_number/1-label_namespace | running command: [sh -c oc label namespace $NAMESPACE argocd.argoproj.io/managed-by=openshift-gitops ] logger.go:42: 11:40:35 | 1-052_validate_rolebinding_number/1-label_namespace | namespace/kuttl-test-improved-cod labeled I0224 11:40:37.616507 121 request.go:682] Waited for 1.679129492s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/whereabouts.cni.cncf.io/v1alpha1?timeout=32s logger.go:42: 11:40:38 | 1-052_validate_rolebinding_number/1-label_namespace | test step completed 1-label_namespace logger.go:42: 11:40:38 | 1-052_validate_rolebinding_number/2-check_rolebindings | starting test step 2-check_rolebindings logger.go:42: 11:40:38 | 1-052_validate_rolebinding_number/2-check_rolebindings | running command: [sh -c set -eo pipefail # Expected and Current RoleBindings expected_rb=( "openshift-gitops-argocd-application-controller" "openshift-gitops-argocd-server" ) # Check that eventually the current role bindings equal the expected role # bindings. Timeout after 60 seconds timer=0 current_rb=( $(oc get rolebindings -n "${NAMESPACE}" | awk '/gitops/ {print $1}' | sort) ) while [[ "${current_rb[@]}" != "${expected_rb[@]}" ]]; do if [[ $timer -eq 60 ]]; then echo "timed out waiting for current role bindings to equal expected role bindings" echo "current role bindings: ${current_rb[*]}" echo "expected role bindings: ${expected_rb[*]}" exit 1 fi timer=$((timer+5)) sleep 5 current_rb=( $(oc get rolebindings -n "${NAMESPACE}" | awk '/gitops/ {print $1}' | sort) ) done # Check that the expected role bindings continue to exist for at least the # next 20 seconds timer=0 while [ true ]; do if [[ $timer -eq 20 ]]; then break fi current_rb=( $(oc get rolebindings -n "${NAMESPACE}" | awk '/gitops/ {print $1}' | sort) ) if [[ "${current_rb[@]}" != "${expected_rb[@]}" ]]; then echo "current role bindings have changed, now not equal to expected role bindings" echo "current role bindings: ${current_rb[*]}" echo "expected role bindings: ${expected_rb[*]}" exit 1 fi timer=$((timer+5)) sleep 5 done ] === CONT kuttl/harness/1-054_validate_deploymentconfig logger.go:42: 11:40:40 | 1-054_validate_deploymentconfig/1-install | test step completed 1-install logger.go:42: 11:40:40 | 1-054_validate_deploymentconfig/2-install-deploymentconfig | starting test step 2-install-deploymentconfig logger.go:42: 11:40:40 | 1-054_validate_deploymentconfig/2-install-deploymentconfig | running command: [sh -c set -eo pipefail # Install ArgoCD Application with 2 replicas cat << EOF | oc apply -f - apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name: app-deploymentconfig namespace: ${NAMESPACE} spec: project: default source: repoURL: https://github.com/redhat-developer/gitops-operator path: test/examples/deploymentconfig-example targetRevision: "HEAD" destination: server: https://kubernetes.default.svc namespace: ${NAMESPACE} syncPolicy: automated: {} EOF # Give some time to Application before asserting sleep 10 exit 0 ] logger.go:42: 11:40:40 | 1-054_validate_deploymentconfig/2-install-deploymentconfig | application.argoproj.io/app-deploymentconfig created I0224 11:40:51.883402 121 request.go:682] Waited for 1.028276811s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/network.operator.openshift.io/v1?timeout=32s logger.go:42: 11:40:53 | 1-054_validate_deploymentconfig/2-install-deploymentconfig | test step completed 2-install-deploymentconfig logger.go:42: 11:40:53 | 1-054_validate_deploymentconfig/3- | starting test step 3- logger.go:42: 11:40:56 | 1-054_validate_deploymentconfig/3- | test step completed 3- logger.go:42: 11:40:56 | 1-054_validate_deploymentconfig/4-scaledown-deploymentconfig | starting test step 4-scaledown-deploymentconfig logger.go:42: 11:40:59 | 1-054_validate_deploymentconfig/4-scaledown-deploymentconfig | Application:kuttl-test-credible-bug/app-deploymentconfig updated I0224 11:41:01.889847 121 request.go:682] Waited for 1.379157181s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apps.openshift.io/v1?timeout=32s === CONT kuttl/harness/1-052_validate_rolebinding_number logger.go:42: 11:41:03 | 1-052_validate_rolebinding_number/2-check_rolebindings | test step completed 2-check_rolebindings logger.go:42: 11:41:03 | 1-052_validate_rolebinding_number | skipping kubernetes event logging logger.go:42: 11:41:03 | 1-052_validate_rolebinding_number | Deleting namespace: kuttl-test-improved-cod === CONT kuttl/harness/1-054_validate_deploymentconfig logger.go:42: 11:41:03 | 1-054_validate_deploymentconfig/4-scaledown-deploymentconfig | test step completed 4-scaledown-deploymentconfig logger.go:42: 11:41:03 | 1-054_validate_deploymentconfig | skipping kubernetes event logging logger.go:42: 11:41:03 | 1-054_validate_deploymentconfig | Deleting namespace: kuttl-test-credible-bug === CONT kuttl/harness/1-058_validate_prometheus_rule logger.go:42: 11:41:08 | 1-058_validate_prometheus_rule | Creating namespace: kuttl-test-curious-wolf logger.go:42: 11:41:08 | 1-058_validate_prometheus_rule/1-install | starting test step 1-install logger.go:42: 11:41:11 | 1-058_validate_prometheus_rule/1-install | ArgoCD:kuttl-test-curious-wolf/example-argocd created === CONT kuttl/harness/1-057_validate_notifications logger.go:42: 11:41:33 | 1-057_validate_notifications | Creating namespace: kuttl-test-glorious-guinea logger.go:42: 11:41:33 | 1-057_validate_notifications/1-install | starting test step 1-install I0224 11:41:34.997316 121 request.go:682] Waited for 1.029394619s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/storage.k8s.io/v1?timeout=32s logger.go:42: 11:41:36 | 1-057_validate_notifications/1-install | ArgoCD:kuttl-test-glorious-guinea/argocd created logger.go:42: 11:41:36 | 1-057_validate_notifications/1-install | Service:kuttl-test-glorious-guinea/smtp4dev created logger.go:42: 11:41:36 | 1-057_validate_notifications/1-install | Deployment:kuttl-test-glorious-guinea/smtp4dev created === CONT kuttl/harness/1-058_validate_prometheus_rule logger.go:42: 11:41:43 | 1-058_validate_prometheus_rule/1-install | test step completed 1-install logger.go:42: 11:41:43 | 1-058_validate_prometheus_rule/2-wait | starting test step 2-wait logger.go:42: 11:41:43 | 1-058_validate_prometheus_rule/2-wait | running command: [sh -c function wait_until_pods_running() { echo -n "Waiting until all pods in namespace $1 are up" for i in {1..150}; do # timeout after 5 minutes local pods="$(oc get pods --no-headers -n $1 2>/dev/null)" # All pods must be running local not_running=$(echo "${pods}" | grep -v Running | grep -v Completed | wc -l) if [[ -n "${pods}" && ${not_running} -eq 0 ]]; then local all_ready=1 while read pod ; do local status=(`echo -n ${pod} | cut -f2 -d' ' | tr '/' ' '`) # All containers must be ready [[ -z ${status[0]} ]] && all_ready=0 && break [[ -z ${status[1]} ]] && all_ready=0 && break [[ ${status[0]} -lt 1 ]] && all_ready=0 && break [[ ${status[1]} -lt 1 ]] && all_ready=0 && break [[ ${status[0]} -ne ${status[1]} ]] && all_ready=0 && break done <<< $(echo "${pods}" | grep -v Completed) if (( all_ready )); then echo -e "\nAll pods are up:\n${pods}" return 0 fi fi echo -n "." sleep 2 done echo -e "\n\nERROR: timeout waiting for pods to come up\n${pods}" return 1 } wait_until_pods_running $NAMESPACE ] logger.go:42: 11:41:44 | 1-058_validate_prometheus_rule/2-wait | Waiting until all pods in namespace kuttl-test-curious-wolf are up logger.go:42: 11:41:44 | 1-058_validate_prometheus_rule/2-wait | All pods are up: logger.go:42: 11:41:44 | 1-058_validate_prometheus_rule/2-wait | example-argocd-application-controller-0 1/1 Running 0 31s logger.go:42: 11:41:44 | 1-058_validate_prometheus_rule/2-wait | example-argocd-redis-8546f5cccc-ck7vg 1/1 Running 0 31s logger.go:42: 11:41:44 | 1-058_validate_prometheus_rule/2-wait | example-argocd-repo-server-7767df68c9-rjskq 1/1 Running 0 31s logger.go:42: 11:41:44 | 1-058_validate_prometheus_rule/2-wait | example-argocd-server-676b88ccc8-rt6hv 1/1 Running 0 31s I0224 11:41:45.061212 121 request.go:682] Waited for 1.027942137s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/controlplane.operator.openshift.io/v1alpha1?timeout=32s logger.go:42: 11:41:46 | 1-058_validate_prometheus_rule/2-wait | test step completed 2-wait logger.go:42: 11:41:46 | 1-058_validate_prometheus_rule/3-create_application | starting test step 3-create_application logger.go:42: 11:41:46 | 1-058_validate_prometheus_rule/3-create_application | running command: [sh -c set -e cat << EOF | oc apply -f - apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name: test-1-58-custom namespace: ${NAMESPACE} spec: project: default source: repoURL: https://github.com/jaideepr97/gitops-examples path: bgd-k8s targetRevision: "HEAD" destination: server: "https://kubernetes.default.svc" namespace: ${NAMESPACE} syncPolicy: automated: {} EOF ] logger.go:42: 11:41:46 | 1-058_validate_prometheus_rule/3-create_application | application.argoproj.io/test-1-58-custom created logger.go:42: 11:41:49 | 1-058_validate_prometheus_rule/3-create_application | test step completed 3-create_application logger.go:42: 11:41:49 | 1-058_validate_prometheus_rule | skipping kubernetes event logging logger.go:42: 11:41:49 | 1-058_validate_prometheus_rule | Deleting namespace: kuttl-test-curious-wolf === CONT kuttl/harness/1-057_validate_notifications logger.go:42: 11:41:49 | 1-057_validate_notifications/1-install | test step completed 1-install logger.go:42: 11:41:49 | 1-057_validate_notifications/2-update-notifications-cm | starting test step 2-update-notifications-cm logger.go:42: 11:41:49 | 1-057_validate_notifications/2-update-notifications-cm | running command: [sh -c sleep 15] logger.go:42: 11:42:04 | 1-057_validate_notifications/2-update-notifications-cm | running command: [sh -c set -e kubectl patch notificationsconfiguration default-notifications-configuration -n $NAMESPACE --type='json' -p='[{"op": "add", "path": "/spec/services", "value": {"service.email.gmail": "{host: smtp4dev, port: 2525, from: fake@email.com }" } }]' ] logger.go:42: 11:42:04 | 1-057_validate_notifications/2-update-notifications-cm | notificationsconfiguration.argoproj.io/default-notifications-configuration patched logger.go:42: 11:42:05 | 1-057_validate_notifications/2-update-notifications-cm | running command: [sh -c sleep 5] I0224 11:42:11.056516 121 request.go:682] Waited for 1.029176894s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/monitoring.coreos.com/v1beta1?timeout=32s logger.go:42: 11:42:12 | 1-057_validate_notifications/2-update-notifications-cm | test step completed 2-update-notifications-cm logger.go:42: 11:42:12 | 1-057_validate_notifications/3-create-app | starting test step 3-create-app logger.go:42: 11:42:12 | 1-057_validate_notifications/3-create-app | running command: [sh -c set -e cat << EOF | oc apply -f - apiVersion: argoproj.io/v1alpha1 kind: Application metadata: name: my-app-3 namespace: $NAMESPACE annotations: "notifications.argoproj.io/subscribe.on-created.gmail": "jdfake@email.com" spec: destination: namespace: $NAMESPACE server: https://kubernetes.default.svc project: default source: repoURL: https://github.com/redhat-developer/gitops-operator path: test/examples/nginx targetRevision: HEAD EOF ] logger.go:42: 11:42:12 | 1-057_validate_notifications/3-create-app | application.argoproj.io/my-app-3 created logger.go:42: 11:42:12 | 1-057_validate_notifications/3-create-app | running command: [sh -c sleep 5] logger.go:42: 11:42:20 | 1-057_validate_notifications/3-create-app | test step completed 3-create-app logger.go:42: 11:42:20 | 1-057_validate_notifications/4-delete-app | starting test step 4-delete-app logger.go:42: 11:42:20 | 1-057_validate_notifications/4-delete-app | running command: [sh -c set -e kubectl delete -n $NAMESPACE application.argoproj.io my-app-3 ] logger.go:42: 11:42:20 | 1-057_validate_notifications/4-delete-app | application.argoproj.io "my-app-3" deleted logger.go:42: 11:42:20 | 1-057_validate_notifications/4-delete-app | running command: [sh -c sleep 5] I0224 11:42:27.085954 121 request.go:682] Waited for 1.029252094s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha2?timeout=32s logger.go:42: 11:42:28 | 1-057_validate_notifications/4-delete-app | test step completed 4-delete-app logger.go:42: 11:42:28 | 1-057_validate_notifications/5-verify-email | starting test step 5-verify-email logger.go:42: 11:42:28 | 1-057_validate_notifications/5-verify-email | running command: [sh -c set -e smtp4dev_pod=$(kubectl get pod -l=app=smtp4dev -o NAME -n $NAMESPACE) exit_code=$(kubectl -n $NAMESPACE exec -i --stdin "${smtp4dev_pod}" -- /bin/bash \ -c 'if [[ $(grep -rnw /tmp -e "Subject: Application my-app-3 has been created.") ]]; then exit 0; else exit 1; fi') if [ $exit_code=0 ]; then exit 0 else exit 1 fi ] logger.go:42: 11:42:32 | 1-057_validate_notifications/5-verify-email | test step completed 5-verify-email logger.go:42: 11:42:32 | 1-057_validate_notifications | skipping kubernetes event logging logger.go:42: 11:42:32 | 1-057_validate_notifications | Deleting namespace: kuttl-test-glorious-guinea === CONT kuttl/harness/1-042_restricted_pss_compliant logger.go:42: 11:42:33 | 1-042_restricted_pss_compliant/1-install-argocd-in-restricted-pss-ns copy | test step failed 1-install-argocd-in-restricted-pss-ns copy case.go:364: failed in step 1-install-argocd-in-restricted-pss-ns copy case.go:366: --- Namespace:/test-1-042-restricted-pss-compliant +++ Namespace:/test-1-042-restricted-pss-compliant @@ -1,12 +1,72 @@ apiVersion: v1 kind: Namespace metadata: + annotations: + openshift.io/sa.scc.mcs: s0:c40,c20 + openshift.io/sa.scc.supplemental-groups: 1001600000/10000 + openshift.io/sa.scc.uid-range: 1001600000/10000 labels: + kubernetes.io/metadata.name: test-1-042-restricted-pss-compliant + olm.operatorgroup.uid/4f5a97c4-56ff-4009-ae21-94a919a61f2a: "" + openshift.io/cluster-monitoring: "true" pod-security.kubernetes.io/audit: restricted - pod-security.kubernetes.io/audit-version: latest + pod-security.kubernetes.io/audit-version: v1.24 pod-security.kubernetes.io/enforce: restricted pod-security.kubernetes.io/enforce-version: latest pod-security.kubernetes.io/warn: restricted - pod-security.kubernetes.io/warn-version: latest + pod-security.kubernetes.io/warn-version: v1.24 + managedFields: + - apiVersion: v1 + fieldsType: FieldsV1 + fieldsV1: + f:metadata: + f:annotations: + .: {} + f:openshift.io/sa.scc.mcs: {} + f:openshift.io/sa.scc.supplemental-groups: {} + f:openshift.io/sa.scc.uid-range: {} + f:labels: + f:pod-security.kubernetes.io/audit-version: {} + f:pod-security.kubernetes.io/warn-version: {} + manager: cluster-policy-controller + operation: Update + time: "2025-02-24T11:30:33Z" + - apiVersion: v1 + fieldsType: FieldsV1 + fieldsV1: + f:metadata: + f:labels: + .: {} + f:kubernetes.io/metadata.name: {} + f:pod-security.kubernetes.io/audit: {} + f:pod-security.kubernetes.io/enforce: {} + f:pod-security.kubernetes.io/enforce-version: {} + f:pod-security.kubernetes.io/warn: {} + manager: kubectl-kuttl + operation: Update + time: "2025-02-24T11:30:33Z" + - apiVersion: v1 + fieldsType: FieldsV1 + fieldsV1: + f:metadata: + f:labels: + f:openshift.io/cluster-monitoring: {} + manager: manager + operation: Update + time: "2025-02-24T11:30:33Z" + - apiVersion: v1 + fieldsType: FieldsV1 + fieldsV1: + f:metadata: + f:labels: + f:olm.operatorgroup.uid/4f5a97c4-56ff-4009-ae21-94a919a61f2a: {} + manager: olm + operation: Update + time: "2025-02-24T11:30:57Z" name: test-1-042-restricted-pss-compliant +spec: + finalizers: + - kubernetes +status: + phase: Active case.go:366: resource Namespace:/test-1-042-restricted-pss-compliant: .metadata.labels.pod-security.kubernetes.io/audit-version: value mismatch, expected: latest != actual: v1.24 logger.go:42: 11:42:33 | 1-042_restricted_pss_compliant | skipping kubernetes event logging logger.go:42: 11:42:33 | 1-042_restricted_pss_compliant | Deleting namespace: kuttl-test-equipped-wildcat === CONT kuttl/harness/1-050_validate_sso logger.go:42: 11:42:37 | 1-050_validate_sso/8-remove-spec-dex | test step completed 8-remove-spec-dex logger.go:42: 11:42:37 | 1-050_validate_sso | skipping kubernetes event logging logger.go:42: 11:42:37 | 1-050_validate_sso | Deleting namespace: kuttl-test-apt-raptor === CONT kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (2012.81s) --- FAIL: kuttl/harness (0.00s) --- PASS: kuttl/harness/1-055_drop_resource_customizations (28.33s) --- PASS: kuttl/harness/1-001_alpha_to_beta_dex_conversion (61.65s) --- PASS: kuttl/harness/1-114_validate_server_sidecar (20.20s) --- PASS: kuttl/harness/1-049_validate_parallelism_limit (94.23s) --- PASS: kuttl/harness/1-062_validate_extra_config (94.38s) --- PASS: kuttl/harness/1-115_validate_controller_extra_command_args (68.25s) --- PASS: kuttl/harness/1-037_validate_argocd_setting_replicas (97.21s) --- PASS: kuttl/harness/1-113_validate_appcontroller_sidecar (16.02s) --- PASS: kuttl/harness/1-112_validate_server_initcontainers (18.72s) --- PASS: kuttl/harness/1-111_validate_appcontroller_initcontainers (18.56s) --- FAIL: kuttl/harness/1-108_alternate_cluster_roles_cluster_scoped_instance (19.32s) --- PASS: kuttl/harness/1-103_argocd_alpha_to_beta_conversion (43.35s) --- PASS: kuttl/harness/1-098_validate_dex_clientsecret_deprecated (24.97s) --- PASS: kuttl/harness/1-096-validate_home_env_argocd_controller (8.39s) --- PASS: kuttl/harness/1-107_host_attribute_sso_provider (102.19s) --- PASS: kuttl/harness/1-099_validate_server_autoscale (98.44s) --- PASS: kuttl/harness/1-102_validate_handle_terminating_namespaces (116.15s) --- PASS: kuttl/harness/1-091_argocd_app_validate-applicationset-status (24.16s) --- PASS: kuttl/harness/1-095_validate_dex_clientsecret (51.41s) --- PASS: kuttl/harness/1-090_validate_permissions (16.84s) --- PASS: kuttl/harness/1-104_validate_applicationset_tls_scm_volume_mount (172.80s) --- PASS: kuttl/harness/1-088_validate_applicationset_add_env_vars (48.11s) --- PASS: kuttl/harness/1-089_validate_extra_repo_commands_args (64.94s) --- PASS: kuttl/harness/1-087_validate_repo_server_settings (60.15s) --- PASS: kuttl/harness/1-061_validate_resource_tracking_method (38.49s) --- PASS: kuttl/harness/1-084_validate_status_host_ingress (23.65s) --- PASS: kuttl/harness/1-086_validate_applicationset_extra_command_args (60.20s) --- PASS: kuttl/harness/1-044_validate_resource_limit_changes (56.92s) --- PASS: kuttl/harness/1-083_validate_resource_customization_subkeys (41.24s) --- PASS: kuttl/harness/1-081_validate_applicationset_deployment (8.58s) --- PASS: kuttl/harness/1-055_validate_notification_controller (78.96s) --- PASS: kuttl/harness/1-082_validate_node_placement (27.75s) --- FAIL: kuttl/harness/1-077_validate_disable_dex_removed (9.07s) --- PASS: kuttl/harness/1-083_validate_kustomize_namereference (64.66s) --- PASS: kuttl/harness/1-079_validate_vars_for_notificaitons (53.20s) --- PASS: kuttl/harness/1-080_validate_regex_support_argocd_rbac (61.45s) --- PASS: kuttl/harness/1-074_validate_terminating_namespace_block (35.86s) --- PASS: kuttl/harness/1-075_validate_dex_anyuid (49.85s) --- PASS: kuttl/harness/1-072_validate_liveness_probe_removed (49.90s) --- PASS: kuttl/harness/1-070_validate_config_management_plugin (90.99s) --- PASS: kuttl/harness/1-068_validate_redis_secure_comm_autotls_no_ha (92.41s) --- PASS: kuttl/harness/1-073_validate_rhsso (229.88s) --- PASS: kuttl/harness/1-092_validate_workload_status_monitoring_alert (475.41s) --- PASS: kuttl/harness/1-066_validate_redis_secure_comm_no_autotls_no_ha (99.49s) --- FAIL: kuttl/harness/1-064_validate_security_contexts (13.95s) --- PASS: kuttl/harness/1-063_validate_statefulset_restart (56.83s) --- PASS: kuttl/harness/1-063_validate_dex_liveness_probe (8.41s) --- PASS: kuttl/harness/1-021_validate_rolebindings (40.46s) --- PASS: kuttl/harness/1-036_validate_keycloak_resource_reqs (172.97s) --- PASS: kuttl/harness/1-071_validate_SCC_HA (623.81s) --- PASS: kuttl/harness/1-033_validate_resource_exclusions (44.38s) --- PASS: kuttl/harness/1-034_validate_webhook_notifications (96.19s) --- PASS: kuttl/harness/1-033_validate_applicationset_tls_scm_volume_mount (41.48s) --- PASS: kuttl/harness/1-032_validate_resource_inclusions (47.17s) --- PASS: kuttl/harness/1-047_validate_custom_env (64.09s) --- PASS: kuttl/harness/1-065_validate_redis_ha_anti_affinity (591.53s) --- PASS: kuttl/harness/1-048_validate_controller_sharding (86.71s) --- PASS: kuttl/harness/1-030_validate_reencrypt (27.32s) --- PASS: kuttl/harness/1-029_validate_tls_secret_no_scale (37.07s) --- PASS: kuttl/harness/1-043_validate_log_level_format (61.93s) --- PASS: kuttl/harness/1-043_validate_custom_labels_annotations (12.80s) --- PASS: kuttl/harness/1-025-validate-managed-by-change (81.41s) --- PASS: kuttl/harness/1-032_validate_dynamic_scaling (331.60s) --- PASS: kuttl/harness/1-007_validate_namespace_scoped_install (43.78s) --- PASS: kuttl/harness/1-019_validate_volume_mounts (23.42s) --- PASS: kuttl/harness/1-023_validate_repo_server_tls (73.43s) --- PASS: kuttl/harness/1-069_validate_redis_secure_comm_autotls_ha (1159.60s) --- PASS: kuttl/harness/1-012_validate-managed-by-chain (116.37s) --- PASS: kuttl/harness/1-007_validate_volume_mounts (49.24s) --- PASS: kuttl/harness/1-045_validate_repo_exec_timeout (43.36s) --- PASS: kuttl/harness/1-009_validate-manage-other-namespace (99.35s) --- PASS: kuttl/harness/1-008_validate-custom-argocd-namespace (76.80s) --- PASS: kuttl/harness/1-003_validate_console_link (10.22s) --- PASS: kuttl/harness/1-038_validate_productized_images (28.12s) --- PASS: kuttl/harness/1-039_validate_fix_argocd-tls-certs-cm (51.71s) --- PASS: kuttl/harness/1-067_validate_redis_secure_comm_no_autotls_ha (1172.45s) --- PASS: kuttl/harness/1-005_validate_route_tls (72.33s) --- PASS: kuttl/harness/1-045_validate_applicationset_image_override (16.66s) --- PASS: kuttl/harness/1-004_beta_to_alpha_conversion (44.07s) --- FAIL: kuttl/harness/1-051-validate_csv_permissions (10.10s) --- PASS: kuttl/harness/1-053_validate_cluster_admin_rbac (13.18s) --- PASS: kuttl/harness/1-003_alpha_to_beta_sso_conflict_conversion (45.11s) --- PASS: kuttl/harness/1-052_validate_rolebinding_number (33.80s) --- PASS: kuttl/harness/1-002_alpha_to_beta_keycloak_conversion (126.75s) --- PASS: kuttl/harness/1-054_validate_deploymentconfig (101.82s) --- PASS: kuttl/harness/1-058_validate_prometheus_rule (46.84s) --- PASS: kuttl/harness/1-057_validate_notifications (64.98s) --- FAIL: kuttl/harness/1-042_restricted_pss_compliant (728.68s) --- PASS: kuttl/harness/1-050_validate_sso (179.98s) FAIL Running sequential test suite 2025/02/24 11:42:50 kutt-test config testdirs is overridden with args: [ /kuttl-e2e/gitops-operator/tests/sequential ] === RUN kuttl harness.go:462: starting setup harness.go:252: running tests using configured kubeconfig. I0224 11:42:51.173572 3736 request.go:682] Waited for 1.036582817s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/image.openshift.io/v1?timeout=32s harness.go:275: Successful connection to cluster at: https://api.nas-psi-414-02.ocp-gitops-qe.com:6443 harness.go:360: running tests harness.go:73: going to run test suite with timeout of 600 seconds for each step harness.go:372: testsuite: /kuttl-e2e/gitops-operator/tests/sequential has 37 tests === RUN kuttl/harness === RUN kuttl/harness/1-002_validate_backend_service === PAUSE kuttl/harness/1-002_validate_backend_service === RUN kuttl/harness/1-003_validate_cluster_config === PAUSE kuttl/harness/1-003_validate_cluster_config === RUN kuttl/harness/1-004_validate_argocd_installation === PAUSE kuttl/harness/1-004_validate_argocd_installation === RUN kuttl/harness/1-005_validate_metrics === PAUSE kuttl/harness/1-005_validate_metrics === RUN kuttl/harness/1-006_validate_machine_config === PAUSE kuttl/harness/1-006_validate_machine_config === RUN kuttl/harness/1-010_validate-ootb-manage-other-namespace === PAUSE kuttl/harness/1-010_validate-ootb-manage-other-namespace === RUN kuttl/harness/1-018_validate_disable_default_instance === PAUSE kuttl/harness/1-018_validate_disable_default_instance === RUN kuttl/harness/1-020_validate_redis_ha_nonha === PAUSE kuttl/harness/1-020_validate_redis_ha_nonha === RUN kuttl/harness/1-026-validate_backend_service_permissions === PAUSE kuttl/harness/1-026-validate_backend_service_permissions === RUN kuttl/harness/1-027_validate_operand_from_git === PAUSE kuttl/harness/1-027_validate_operand_from_git === RUN kuttl/harness/1-028_validate_run_on_infra === PAUSE kuttl/harness/1-028_validate_run_on_infra === RUN kuttl/harness/1-031_validate_toolchain === PAUSE kuttl/harness/1-031_validate_toolchain === RUN kuttl/harness/1-034_validate_custom_roles === PAUSE kuttl/harness/1-034_validate_custom_roles === RUN kuttl/harness/1-035_validate_argocd_secret_repopulate === PAUSE kuttl/harness/1-035_validate_argocd_secret_repopulate === RUN kuttl/harness/1-036_validate_role_rolebinding_for_source_namespace === PAUSE kuttl/harness/1-036_validate_role_rolebinding_for_source_namespace === RUN kuttl/harness/1-037_validate_applicationset_in_any_namespace === PAUSE kuttl/harness/1-037_validate_applicationset_in_any_namespace === RUN kuttl/harness/1-040_validate_quoted_RBAC_group_names === PAUSE kuttl/harness/1-040_validate_quoted_RBAC_group_names === RUN kuttl/harness/1-041_validate_argocd_sync_alert === PAUSE kuttl/harness/1-041_validate_argocd_sync_alert === RUN kuttl/harness/1-042_validate_status_host === PAUSE kuttl/harness/1-042_validate_status_host === RUN kuttl/harness/1-050_validate_sso === PAUSE kuttl/harness/1-050_validate_sso === RUN kuttl/harness/1-056_validate_managed-by === PAUSE kuttl/harness/1-056_validate_managed-by === RUN kuttl/harness/1-064_validate_tcp_reset_error === PAUSE kuttl/harness/1-064_validate_tcp_reset_error === RUN kuttl/harness/1-071_validate_node_selectors === PAUSE kuttl/harness/1-071_validate_node_selectors === RUN kuttl/harness/1-078_validate_default_argocd_consoleLink === PAUSE kuttl/harness/1-078_validate_default_argocd_consoleLink === RUN kuttl/harness/1-083_validate_apps_in_any_namespace === PAUSE kuttl/harness/1-083_validate_apps_in_any_namespace === RUN kuttl/harness/1-084_validate_prune_templates === PAUSE kuttl/harness/1-084_validate_prune_templates === RUN kuttl/harness/1-085_validate_dynamic_plugin_installation === PAUSE kuttl/harness/1-085_validate_dynamic_plugin_installation === RUN kuttl/harness/1-086_validate_default_argocd_role === PAUSE kuttl/harness/1-086_validate_default_argocd_role === RUN kuttl/harness/1-100_validate_rollouts_resources_creation === PAUSE kuttl/harness/1-100_validate_rollouts_resources_creation === RUN kuttl/harness/1-101_validate_rollout_policyrules === PAUSE kuttl/harness/1-101_validate_rollout_policyrules === RUN kuttl/harness/1-104_validate_prometheus_alert === PAUSE kuttl/harness/1-104_validate_prometheus_alert === RUN kuttl/harness/1-105_validate_label_selector === PAUSE kuttl/harness/1-105_validate_label_selector === RUN kuttl/harness/1-106_validate_argocd_metrics_controller === PAUSE kuttl/harness/1-106_validate_argocd_metrics_controller === RUN kuttl/harness/1-109_validate_reencrypt_termination_policy === PAUSE kuttl/harness/1-109_validate_reencrypt_termination_policy === RUN kuttl/harness/1-110_validate_podsecurity_alerts === PAUSE kuttl/harness/1-110_validate_podsecurity_alerts === RUN kuttl/harness/1-111_validate_default_argocd_route === PAUSE kuttl/harness/1-111_validate_default_argocd_route === RUN kuttl/harness/1-112_validate_rollout_plugin_support === PAUSE kuttl/harness/1-112_validate_rollout_plugin_support === CONT kuttl/harness/1-002_validate_backend_service logger.go:42: 11:42:57 | 1-002_validate_backend_service | Creating namespace: kuttl-test-noble-deer logger.go:42: 11:42:57 | 1-002_validate_backend_service/1-check-backend-service | starting test step 1-check-backend-service logger.go:42: 11:43:00 | 1-002_validate_backend_service/1-check-backend-service | test step completed 1-check-backend-service logger.go:42: 11:43:00 | 1-002_validate_backend_service | skipping kubernetes event logging logger.go:42: 11:43:00 | 1-002_validate_backend_service | Deleting namespace: kuttl-test-noble-deer === CONT kuttl/harness/1-078_validate_default_argocd_consoleLink logger.go:42: 11:43:06 | 1-078_validate_default_argocd_consoleLink | Creating namespace: kuttl-test-next-flamingo logger.go:42: 11:43:06 | 1-078_validate_default_argocd_consoleLink/1- | starting test step 1- I0224 11:43:07.224249 3736 request.go:682] Waited for 1.027245811s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/autoscaling.openshift.io/v1?timeout=32s logger.go:42: 11:43:08 | 1-078_validate_default_argocd_consoleLink/1- | test step completed 1- logger.go:42: 11:43:08 | 1-078_validate_default_argocd_consoleLink/2-add_env | starting test step 2-add_env logger.go:42: 11:43:08 | 1-078_validate_default_argocd_consoleLink/2-add_env | running command: [sh -c oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "DISABLE_DEFAULT_ARGOCD_CONSOLELINK", "value": "true"}]}}}' ] logger.go:42: 11:43:09 | 1-078_validate_default_argocd_consoleLink/2-add_env | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found case.go:364: failed in step 2-add_env case.go:366: exit status 1 logger.go:42: 11:43:11 | 1-078_validate_default_argocd_consoleLink | skipping kubernetes event logging logger.go:42: 11:43:11 | 1-078_validate_default_argocd_consoleLink | Deleting namespace: kuttl-test-next-flamingo === CONT kuttl/harness/1-112_validate_rollout_plugin_support logger.go:42: 11:43:17 | 1-112_validate_rollout_plugin_support | Creating namespace: kuttl-test-flexible-quagga logger.go:42: 11:43:17 | 1-112_validate_rollout_plugin_support/1-install-rolloutmanager | starting test step 1-install-rolloutmanager I0224 11:43:18.659740 3736 request.go:682] Waited for 1.028228838s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/argoproj.io/v1alpha1?timeout=32s logger.go:42: 11:43:20 | 1-112_validate_rollout_plugin_support/1-install-rolloutmanager | RolloutManager:openshift-gitops/example-rollout-manager created logger.go:42: 11:43:46 | 1-112_validate_rollout_plugin_support/1-install-rolloutmanager | test step completed 1-install-rolloutmanager logger.go:42: 11:43:46 | 1-112_validate_rollout_plugin_support/3-delete | starting test step 3-delete I0224 11:43:47.554611 3736 request.go:682] Waited for 1.028451272s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/metal3.io/v1alpha1?timeout=32s logger.go:42: 11:43:49 | 1-112_validate_rollout_plugin_support/3-delete | test step completed 3-delete logger.go:42: 11:43:49 | 1-112_validate_rollout_plugin_support | skipping kubernetes event logging logger.go:42: 11:43:49 | 1-112_validate_rollout_plugin_support | Deleting namespace: kuttl-test-flexible-quagga === CONT kuttl/harness/1-111_validate_default_argocd_route logger.go:42: 11:43:54 | 1-111_validate_default_argocd_route | Creating namespace: kuttl-test-pure-warthog logger.go:42: 11:43:54 | 1-111_validate_default_argocd_route/1- | starting test step 1- logger.go:42: 11:43:57 | 1-111_validate_default_argocd_route/1- | test step completed 1- logger.go:42: 11:43:57 | 1-111_validate_default_argocd_route/2-update_tls | starting test step 2-update_tls I0224 11:43:58.500054 3736 request.go:682] Waited for 1.028524313s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s logger.go:42: 11:44:00 | 1-111_validate_default_argocd_route/2-update_tls | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 11:44:01 | 1-111_validate_default_argocd_route/2-update_tls | test step completed 2-update_tls logger.go:42: 11:44:01 | 1-111_validate_default_argocd_route/3-cleanup | starting test step 3-cleanup logger.go:42: 11:44:01 | 1-111_validate_default_argocd_route/3-cleanup | running command: [sh -c kubectl patch argocd openshift-gitops -n openshift-gitops --type='json' -p='[{"op": "remove", "path": "/spec/server/route/tls"}]' ] logger.go:42: 11:44:01 | 1-111_validate_default_argocd_route/3-cleanup | argocd.argoproj.io/openshift-gitops patched logger.go:42: 11:44:01 | 1-111_validate_default_argocd_route/3-cleanup | running command: [sh -c sleep 10] I0224 11:44:12.484954 3736 request.go:682] Waited for 1.028165374s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/console.openshift.io/v1alpha1?timeout=32s logger.go:42: 11:44:13 | 1-111_validate_default_argocd_route/3-cleanup | test step completed 3-cleanup logger.go:42: 11:44:13 | 1-111_validate_default_argocd_route | skipping kubernetes event logging logger.go:42: 11:44:13 | 1-111_validate_default_argocd_route | Deleting namespace: kuttl-test-pure-warthog === CONT kuttl/harness/1-110_validate_podsecurity_alerts logger.go:42: 11:44:19 | 1-110_validate_podsecurity_alerts | Creating namespace: kuttl-test-closing-crayfish logger.go:42: 11:44:19 | 1-110_validate_podsecurity_alerts/1- | starting test step 1- logger.go:42: 11:44:22 | 1-110_validate_podsecurity_alerts/1- | test step completed 1- logger.go:42: 11:44:22 | 1-110_validate_podsecurity_alerts | skipping kubernetes event logging logger.go:42: 11:44:22 | 1-110_validate_podsecurity_alerts | Deleting namespace: kuttl-test-closing-crayfish === CONT kuttl/harness/1-109_validate_reencrypt_termination_policy logger.go:42: 11:44:28 | 1-109_validate_reencrypt_termination_policy | Creating namespace: kuttl-test-on-reptile logger.go:42: 11:44:28 | 1-109_validate_reencrypt_termination_policy/1- | starting test step 1- I0224 11:44:29.457057 3736 request.go:682] Waited for 1.027868042s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/k8s.cni.cncf.io/v1?timeout=32s logger.go:42: 11:44:30 | 1-109_validate_reencrypt_termination_policy/1- | test step completed 1- logger.go:42: 11:44:30 | 1-109_validate_reencrypt_termination_policy/2-check-certificate | starting test step 2-check-certificate logger.go:42: 11:44:30 | 1-109_validate_reencrypt_termination_policy/2-check-certificate | running command: [sh -c route=https://$(oc get route -n openshift-gitops openshift-gitops-server -o jsonpath='{.spec.host}') issuer=$(curl --insecure -v "$route" 2>&1 | awk '/issuer:/') if [ $issuer != *"root-ca"* ] && [ $issuer != *"ingress-operator"* ]; then echo "TLS connections rely on the default ingress operator certificate or root-ca" exit 1 fi ] logger.go:42: 11:44:31 | 1-109_validate_reencrypt_termination_policy/2-check-certificate | sh: line 5: [: too many arguments logger.go:42: 11:44:33 | 1-109_validate_reencrypt_termination_policy/2-check-certificate | test step completed 2-check-certificate logger.go:42: 11:44:33 | 1-109_validate_reencrypt_termination_policy | skipping kubernetes event logging logger.go:42: 11:44:33 | 1-109_validate_reencrypt_termination_policy | Deleting namespace: kuttl-test-on-reptile === CONT kuttl/harness/1-106_validate_argocd_metrics_controller logger.go:42: 11:44:39 | 1-106_validate_argocd_metrics_controller | Creating namespace: kuttl-test-comic-buzzard logger.go:42: 11:44:39 | 1-106_validate_argocd_metrics_controller/1- | starting test step 1- I0224 11:44:40.855636 3736 request.go:682] Waited for 1.028476286s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/snapshot.storage.k8s.io/v1?timeout=32s logger.go:42: 11:44:42 | 1-106_validate_argocd_metrics_controller/1- | test step completed 1- logger.go:42: 11:44:42 | 1-106_validate_argocd_metrics_controller/2-disable-metrics | starting test step 2-disable-metrics logger.go:42: 11:44:42 | 1-106_validate_argocd_metrics_controller/2-disable-metrics | running command: [sh -c oc patch argocd openshift-gitops -n openshift-gitops --type='json' -p='[{"op": "replace", "path": "/spec/monitoring/disableMetrics", "value": true}]' ] logger.go:42: 11:44:42 | 1-106_validate_argocd_metrics_controller/2-disable-metrics | argocd.argoproj.io/openshift-gitops patched logger.go:42: 11:44:45 | 1-106_validate_argocd_metrics_controller/2-disable-metrics | test step completed 2-disable-metrics logger.go:42: 11:44:45 | 1-106_validate_argocd_metrics_controller/3-enable-metrics | starting test step 3-enable-metrics logger.go:42: 11:44:45 | 1-106_validate_argocd_metrics_controller/3-enable-metrics | running command: [sh -c oc patch argocd openshift-gitops -n openshift-gitops --type='json' -p='[{"op": "replace", "path": "/spec/monitoring/disableMetrics", "value": false}]' ] logger.go:42: 11:44:45 | 1-106_validate_argocd_metrics_controller/3-enable-metrics | argocd.argoproj.io/openshift-gitops patched logger.go:42: 11:44:48 | 1-106_validate_argocd_metrics_controller/3-enable-metrics | test step completed 3-enable-metrics logger.go:42: 11:44:48 | 1-106_validate_argocd_metrics_controller | skipping kubernetes event logging logger.go:42: 11:44:48 | 1-106_validate_argocd_metrics_controller | Deleting namespace: kuttl-test-comic-buzzard === CONT kuttl/harness/1-105_validate_label_selector logger.go:42: 11:44:54 | 1-105_validate_label_selector | Creating namespace: kuttl-test-factual-turkey logger.go:42: 11:44:54 | 1-105_validate_label_selector/1-add-label-selector | starting test step 1-add-label-selector logger.go:42: 11:44:54 | 1-105_validate_label_selector/1-add-label-selector | running command: [sh -c if ! [ -z $NON_OLM ]; then oc set env deployment openshift-gitops-operator-controller-manager -n openshift-gitops-operator ARGOCD_LABEL_SELECTOR=foo=bar -c manager elif ! [ -z $CI ]; then oc patch -n openshift-gitops-operator subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "ARGOCD_LABEL_SELECTOR", "value": "foo=bar"}]}}}' else oc patch -n openshift-operators subscription `subscription=gitops-operator && oc get subscription --all-namespaces | grep $subscription | head -1 | awk '{print $2}'` \ --type merge --patch '{"spec": {"config": {"env": [{"name": "ARGOCD_LABEL_SELECTOR", "value": "foo=bar"}]}}}' fi ] logger.go:42: 11:44:55 | 1-105_validate_label_selector/1-add-label-selector | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found logger.go:42: 11:44:55 | 1-105_validate_label_selector/1-add-label-selector | command failure, skipping 1 additional commands I0224 11:44:56.449939 3736 request.go:682] Waited for 1.028683967s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/samples.operator.openshift.io/v1?timeout=32s case.go:364: failed in step 1-add-label-selector case.go:366: exit status 1 logger.go:42: 11:44:57 | 1-105_validate_label_selector | skipping kubernetes event logging logger.go:42: 11:44:57 | 1-105_validate_label_selector | Deleting namespace: kuttl-test-factual-turkey === CONT kuttl/harness/1-104_validate_prometheus_alert logger.go:42: 11:45:03 | 1-104_validate_prometheus_alert | Creating namespace: kuttl-test-intimate-goat logger.go:42: 11:45:03 | 1-104_validate_prometheus_alert/1- | starting test step 1- I0224 11:45:06.481259 3736 request.go:682] Waited for 2.477228702s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v1?timeout=32s logger.go:42: 11:55:06 | 1-104_validate_prometheus_alert/1- | test step failed 1- case.go:364: failed in step 1- case.go:366: servicemonitors.monitoring.coreos.com "openshift-gitops-operator-metrics-monitor" not found logger.go:42: 11:55:06 | 1-104_validate_prometheus_alert | skipping kubernetes event logging logger.go:42: 11:55:06 | 1-104_validate_prometheus_alert | Deleting namespace: kuttl-test-intimate-goat === CONT kuttl/harness/1-101_validate_rollout_policyrules logger.go:42: 11:55:12 | 1-101_validate_rollout_policyrules | Creating namespace: kuttl-test-touching-python logger.go:42: 11:55:12 | 1-101_validate_rollout_policyrules/1-install-rollloutmanager | starting test step 1-install-rollloutmanager I0224 11:55:13.550998 3736 request.go:682] Waited for 1.028642146s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/samples.operator.openshift.io/v1?timeout=32s logger.go:42: 11:55:15 | 1-101_validate_rollout_policyrules/1-install-rollloutmanager | RolloutManager:openshift-gitops/example-rollout-manager created logger.go:42: 11:55:16 | 1-101_validate_rollout_policyrules/1-install-rollloutmanager | test step completed 1-install-rollloutmanager logger.go:42: 11:55:16 | 1-101_validate_rollout_policyrules/2-delete | starting test step 2-delete logger.go:42: 11:55:18 | 1-101_validate_rollout_policyrules/2-delete | test step completed 2-delete logger.go:42: 11:55:18 | 1-101_validate_rollout_policyrules | skipping kubernetes event logging logger.go:42: 11:55:18 | 1-101_validate_rollout_policyrules | Deleting namespace: kuttl-test-touching-python === CONT kuttl/harness/1-084_validate_prune_templates 2025/02/24 11:55:24 object detected with no GVK Kind for path /kuttl-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/04-delete.yaml 2025/02/24 11:55:24 object detected with no GVK Kind for path /kuttl-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/01-assert.yaml 2025/02/24 11:55:24 object detected with no GVK Kind for path /kuttl-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/01-create-ns-managed-by.yaml 2025/02/24 11:55:24 object detected with no GVK Kind for path /kuttl-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/02-prune-duplicateGVK-resource.yaml 2025/02/24 11:55:24 object detected with no GVK Kind for path /kuttl-e2e/gitops-operator/tests/sequential/1-084_validate_prune_templates/03-errors.yaml logger.go:42: 11:55:24 | 1-084_validate_prune_templates | Creating namespace: kuttl-test-ample-garfish logger.go:42: 11:55:24 | 1-084_validate_prune_templates/1-create-ns-managed-by | starting test step 1-create-ns-managed-by I0224 11:55:25.603760 3736 request.go:682] Waited for 1.026507363s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/k8s.cni.cncf.io/v1?timeout=32s logger.go:42: 11:55:27 | 1-084_validate_prune_templates/1-create-ns-managed-by | test step completed 1-create-ns-managed-by logger.go:42: 11:55:27 | 1-084_validate_prune_templates/2-prune-duplicateGVK-resource | starting test step 2-prune-duplicateGVK-resource logger.go:42: 11:55:29 | 1-084_validate_prune_templates/2-prune-duplicateGVK-resource | test step completed 2-prune-duplicateGVK-resource logger.go:42: 11:55:29 | 1-084_validate_prune_templates/3- | starting test step 3- logger.go:42: 11:55:32 | 1-084_validate_prune_templates/3- | test step completed 3- logger.go:42: 11:55:32 | 1-084_validate_prune_templates/4-delete | starting test step 4-delete logger.go:42: 11:55:34 | 1-084_validate_prune_templates/4-delete | test step completed 4-delete logger.go:42: 11:55:34 | 1-084_validate_prune_templates | skipping kubernetes event logging logger.go:42: 11:55:34 | 1-084_validate_prune_templates | Deleting namespace: kuttl-test-ample-garfish === CONT kuttl/harness/1-085_validate_dynamic_plugin_installation logger.go:42: 11:55:40 | 1-085_validate_dynamic_plugin_installation | Creating namespace: kuttl-test-primary-rat logger.go:42: 11:55:40 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | starting test step 1-install-dynamic-plugin logger.go:42: 11:55:40 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | running command: [sh -c set -eo pipefail # Define constants export subscription="openshift-gitops-operator" ns=$(oc get subscription openshift-gitops-operator -n openshift-operators -o jsonpath='{.metadata.namespace}' --ignore-not-found) installation_ns=${ns:-openshift-gitops-operator} # Get OCP version echo "Detecting OpenShift Container Platform (OCP) version..." ocp_version=$(oc version | awk '/Server Version/ {print $3}' | cut -d '.' -f1,2) echo "Detected OCP version: ${ocp_version}" if [[ ${ocp_version} > '4.15' ]]; then echo "OCP version ${ocp_version} does not require manual enabling of the GitOps plugin." exit 0 fi # Check if the gitops-plugin Deployment exists and is ready plugin_status=$(oc get deployment/gitops-plugin -n openshift-gitops -o jsonpath='{.status.readyReplicas}' 2>/dev/null || echo "0") if [ "$plugin_status" -ge 1 ]; then echo "GitOps plugin is already enabled and running." exit 0 fi echo "GitOps plugin is not enabled. Proceeding to enable it." # Patch the Subscription to add the necessary env key:value for Dynamic Plugin echo "Appending the required environment variable to 'env'." oc patch subscription "${subscription}" -n $installation_ns \ --type='json' \ -p='[{ "op": "add", "path": "/spec/config", "value": { "env": [{ "name": "DYNAMIC_PLUGIN_START_OCP_VERSION", "value": "'${ocp_version}'" }] } }]' echo "Successfully patched the subscription to enable the GitOps plugin." # Allow resources to stabilize before the next step sleep 5 ] logger.go:42: 11:55:40 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | Detecting OpenShift Container Platform (OCP) version... logger.go:42: 11:55:41 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | Detected OCP version: 4.13 logger.go:42: 11:55:41 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | GitOps plugin is not enabled. Proceeding to enable it. logger.go:42: 11:55:41 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | Appending the required environment variable to 'env'. logger.go:42: 11:55:41 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | subscription.operators.coreos.com/openshift-gitops-operator patched logger.go:42: 11:55:41 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | Successfully patched the subscription to enable the GitOps plugin. I0224 11:55:47.967322 3736 request.go:682] Waited for 1.029108971s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machineconfiguration.openshift.io/v1?timeout=32s logger.go:42: 11:55:49 | 1-085_validate_dynamic_plugin_installation/1-install-dynamic-plugin | test step completed 1-install-dynamic-plugin logger.go:42: 11:55:49 | 1-085_validate_dynamic_plugin_installation/2- | starting test step 2- logger.go:42: 11:56:20 | 1-085_validate_dynamic_plugin_installation/2- | test step completed 2- logger.go:42: 11:56:20 | 1-085_validate_dynamic_plugin_installation | skipping kubernetes event logging logger.go:42: 11:56:20 | 1-085_validate_dynamic_plugin_installation | Deleting namespace: kuttl-test-primary-rat === CONT kuttl/harness/1-100_validate_rollouts_resources_creation logger.go:42: 11:56:26 | 1-100_validate_rollouts_resources_creation | Creating namespace: kuttl-test-tolerant-swan logger.go:42: 11:56:26 | 1-100_validate_rollouts_resources_creation/1-install-rolloutmanager | starting test step 1-install-rolloutmanager I0224 11:56:27.393051 3736 request.go:682] Waited for 1.029745628s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/coordination.k8s.io/v1?timeout=32s logger.go:42: 11:56:28 | 1-100_validate_rollouts_resources_creation/1-install-rolloutmanager | RolloutManager:openshift-gitops/example-rollout-manager created logger.go:42: 11:56:45 | 1-100_validate_rollouts_resources_creation/1-install-rolloutmanager | test step completed 1-install-rolloutmanager logger.go:42: 11:56:45 | 1-100_validate_rollouts_resources_creation/2- | starting test step 2- I0224 11:56:46.484916 3736 request.go:682] Waited for 1.029159037s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/autoscaling/v1?timeout=32s logger.go:42: 11:56:47 | 1-100_validate_rollouts_resources_creation/2- | test step completed 2- logger.go:42: 11:56:47 | 1-100_validate_rollouts_resources_creation/3-delete | starting test step 3-delete logger.go:42: 11:56:50 | 1-100_validate_rollouts_resources_creation/3-delete | test step completed 3-delete logger.go:42: 11:56:50 | 1-100_validate_rollouts_resources_creation | skipping kubernetes event logging logger.go:42: 11:56:50 | 1-100_validate_rollouts_resources_creation | Deleting namespace: kuttl-test-tolerant-swan === CONT kuttl/harness/1-086_validate_default_argocd_role logger.go:42: 11:56:56 | 1-086_validate_default_argocd_role | Creating namespace: kuttl-test-verified-weevil logger.go:42: 11:56:56 | 1-086_validate_default_argocd_role/1- | starting test step 1- I0224 11:56:57.657892 3736 request.go:682] Waited for 1.029261792s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/build.openshift.io/v1?timeout=32s logger.go:42: 11:56:59 | 1-086_validate_default_argocd_role/1- | test step completed 1- logger.go:42: 11:56:59 | 1-086_validate_default_argocd_role/2-install | starting test step 2-install logger.go:42: 11:57:01 | 1-086_validate_default_argocd_role/2-install | Namespace:/test-1-086-custom created logger.go:42: 11:57:01 | 1-086_validate_default_argocd_role/2-install | Namespace:/test-1-086-custom2 created logger.go:42: 11:57:01 | 1-086_validate_default_argocd_role/2-install | Namespace:/test-1-086-custom3 created logger.go:42: 11:57:01 | 1-086_validate_default_argocd_role/2-install | ArgoCD:test-1-086-custom/argocd-default-policy created logger.go:42: 11:57:01 | 1-086_validate_default_argocd_role/2-install | ArgoCD:test-1-086-custom2/argocd-default-policy-empty created logger.go:42: 11:57:01 | 1-086_validate_default_argocd_role/2-install | ArgoCD:test-1-086-custom3/argocd-default-policy-admin created logger.go:42: 11:57:35 | 1-086_validate_default_argocd_role/2-install | test step completed 2-install logger.go:42: 11:57:35 | 1-086_validate_default_argocd_role | skipping kubernetes event logging logger.go:42: 11:57:35 | 1-086_validate_default_argocd_role | Deleting namespace: kuttl-test-verified-weevil === CONT kuttl/harness/1-083_validate_apps_in_any_namespace logger.go:42: 11:57:41 | 1-083_validate_apps_in_any_namespace | Ignoring errors.yaml as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 11:57:41 | 1-083_validate_apps_in_any_namespace | Creating namespace: kuttl-test-united-reindeer logger.go:42: 11:57:41 | 1-083_validate_apps_in_any_namespace/1-create-ns-managed-by | starting test step 1-create-ns-managed-by I0224 11:57:42.758160 3736 request.go:682] Waited for 1.029275777s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/ingress.operator.openshift.io/v1?timeout=32s logger.go:42: 11:57:44 | 1-083_validate_apps_in_any_namespace/1-create-ns-managed-by | Namespace:/test-1-24-custom created logger.go:42: 11:57:44 | 1-083_validate_apps_in_any_namespace/1-create-ns-managed-by | test step completed 1-create-ns-managed-by logger.go:42: 11:57:44 | 1-083_validate_apps_in_any_namespace/2-add-source-ns | starting test step 2-add-source-ns logger.go:42: 11:57:46 | 1-083_validate_apps_in_any_namespace/2-add-source-ns | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 11:57:47 | 1-083_validate_apps_in_any_namespace/2-add-source-ns | test step completed 2-add-source-ns logger.go:42: 11:57:47 | 1-083_validate_apps_in_any_namespace/3-delete | starting test step 3-delete I0224 11:57:54.037526 3736 request.go:682] Waited for 1.028959112s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha2?timeout=32s logger.go:42: 11:57:55 | 1-083_validate_apps_in_any_namespace/3-delete | test step completed 3-delete logger.go:42: 11:57:55 | 1-083_validate_apps_in_any_namespace/4-change-source-namespaces | starting test step 4-change-source-namespaces logger.go:42: 11:57:58 | 1-083_validate_apps_in_any_namespace/4-change-source-namespaces | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 11:57:58 | 1-083_validate_apps_in_any_namespace/4-change-source-namespaces | test step completed 4-change-source-namespaces logger.go:42: 11:57:58 | 1-083_validate_apps_in_any_namespace/5-create-ns-and-add-source-ns | starting test step 5-create-ns-and-add-source-ns logger.go:42: 11:58:00 | 1-083_validate_apps_in_any_namespace/5-create-ns-and-add-source-ns | Namespace:/test-1-24-custom created logger.go:42: 11:58:00 | 1-083_validate_apps_in_any_namespace/5-create-ns-and-add-source-ns | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 11:58:10 | 1-083_validate_apps_in_any_namespace/5-create-ns-and-add-source-ns | test step completed 5-create-ns-and-add-source-ns logger.go:42: 11:58:10 | 1-083_validate_apps_in_any_namespace/6-add-managed-by | starting test step 6-add-managed-by I0224 11:58:11.656649 3736 request.go:682] Waited for 1.029259266s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/node.k8s.io/v1?timeout=32s logger.go:42: 11:58:13 | 1-083_validate_apps_in_any_namespace/6-add-managed-by | Namespace:/test-1-24-custom updated logger.go:42: 11:58:14 | 1-083_validate_apps_in_any_namespace/6-add-managed-by | test step completed 6-add-managed-by logger.go:42: 11:58:14 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | starting test step 7-remove-managed-by logger.go:42: 11:58:14 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | running command: [sh -c oc label ns test-1-24-custom argocd.argoproj.io/managed-by-] logger.go:42: 11:58:14 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | namespace/test-1-24-custom unlabeled logger.go:42: 11:58:14 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | running command: [sh -c oc rollout restart deployment.apps/openshift-gitops-server -n openshift-gitops] logger.go:42: 11:58:15 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | deployment.apps/openshift-gitops-server restarted logger.go:42: 11:58:15 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | running command: [sh -c oc rollout restart statefulset.apps/openshift-gitops-application-controller -n openshift-gitops] logger.go:42: 11:58:15 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | statefulset.apps/openshift-gitops-application-controller restarted logger.go:42: 11:58:15 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | running command: [sh -c sleep 5] I0224 11:58:21.688446 3736 request.go:682] Waited for 1.128667412s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/ingress.operator.openshift.io/v1?timeout=32s logger.go:42: 11:58:46 | 1-083_validate_apps_in_any_namespace/7-remove-managed-by | test step completed 7-remove-managed-by logger.go:42: 11:58:46 | 1-083_validate_apps_in_any_namespace/8-change-source-namespaces | starting test step 8-change-source-namespaces I0224 11:58:47.347879 3736 request.go:682] Waited for 1.028785225s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operator.openshift.io/v1?timeout=32s logger.go:42: 11:58:48 | 1-083_validate_apps_in_any_namespace/8-change-source-namespaces | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 11:58:50 | 1-083_validate_apps_in_any_namespace/8-change-source-namespaces | test step completed 8-change-source-namespaces logger.go:42: 11:58:50 | 1-083_validate_apps_in_any_namespace/99-delete | starting test step 99-delete I0224 11:58:57.378461 3736 request.go:682] Waited for 1.378818523s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/cloudcredential.openshift.io/v1?timeout=32s logger.go:42: 11:58:58 | 1-083_validate_apps_in_any_namespace/99-delete | test step completed 99-delete logger.go:42: 11:58:58 | 1-083_validate_apps_in_any_namespace | skipping kubernetes event logging logger.go:42: 11:58:58 | 1-083_validate_apps_in_any_namespace | Deleting namespace: kuttl-test-united-reindeer === CONT kuttl/harness/1-034_validate_custom_roles logger.go:42: 11:59:04 | 1-034_validate_custom_roles | Creating namespace: kuttl-test-calm-beagle logger.go:42: 11:59:04 | 1-034_validate_custom_roles/1-install | starting test step 1-install logger.go:42: 11:59:06 | 1-034_validate_custom_roles/1-install | Namespace:/test-1-034-custom created logger.go:42: 11:59:06 | 1-034_validate_custom_roles/1-install | ArgoCD:test-1-034-custom/argocd created logger.go:42: 11:59:07 | 1-034_validate_custom_roles/1-install | Namespace:/custom-role-namespace created logger.go:42: 11:59:07 | 1-034_validate_custom_roles/1-install | ClusterRole:/custom-argocd-role created logger.go:42: 11:59:39 | 1-034_validate_custom_roles/1-install | test step completed 1-install logger.go:42: 11:59:39 | 1-034_validate_custom_roles/2-patch-subscription | starting test step 2-patch-subscription logger.go:42: 11:59:39 | 1-034_validate_custom_roles/2-patch-subscription | running command: [sh -c if ! [ -z $NON_OLM ]; then oc set env deployment openshift-gitops-operator-controller-manager -n openshift-gitops-operator CONTROLLER_CLUSTER_ROLE=custom-argocd-role oc set env deployment openshift-gitops-operator-controller-manager -n openshift-gitops-operator SERVER_CLUSTER_ROLE=custom-argocd-role elif ! [ -z $CI ]; then oc patch -n openshift-gitops-operator subscription `subscription=gitops-operator- && oc get subscription --all-namespaces | grep $subscription | head -1 | awk '{print $2}'`\ --type merge --patch '{"spec": {"config": {"env": [{"name": "CONTROLLER_CLUSTER_ROLE", "value": "custom-argocd-role"},{"name": "SERVER_CLUSTER_ROLE", "value": "custom-argocd-role"}]}}}' else oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "CONTROLLER_CLUSTER_ROLE", "value": "custom-argocd-role"},{"name": "SERVER_CLUSTER_ROLE", "value": "custom-argocd-role"}]}}}' fi ] logger.go:42: 11:59:39 | 1-034_validate_custom_roles/2-patch-subscription | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found logger.go:42: 11:59:39 | 1-034_validate_custom_roles/2-patch-subscription | command failure, skipping 1 additional commands I0224 11:59:40.847272 3736 request.go:682] Waited for 1.029680822s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/quota.openshift.io/v1?timeout=32s case.go:364: failed in step 2-patch-subscription case.go:366: exit status 1 logger.go:42: 11:59:42 | 1-034_validate_custom_roles | skipping kubernetes event logging logger.go:42: 11:59:42 | 1-034_validate_custom_roles | Deleting namespace: kuttl-test-calm-beagle === CONT kuttl/harness/1-071_validate_node_selectors logger.go:42: 11:59:48 | 1-071_validate_node_selectors | Creating namespace: kuttl-test-hopeful-polecat logger.go:42: 11:59:48 | 1-071_validate_node_selectors/1- | starting test step 1- logger.go:42: 11:59:50 | 1-071_validate_node_selectors/1- | test step completed 1- logger.go:42: 11:59:50 | 1-071_validate_node_selectors/2-custom-node-selector | starting test step 2-custom-node-selector logger.go:42: 11:59:50 | 1-071_validate_node_selectors/2-custom-node-selector | running command: [sh -c oc patch gitopsservice cluster --type=merge --patch='{"spec": {"nodeSelector": {"key1": "value1"}}}' ] logger.go:42: 11:59:51 | 1-071_validate_node_selectors/2-custom-node-selector | gitopsservice.pipelines.openshift.io/cluster patched I0224 11:59:52.360399 3736 request.go:682] Waited for 1.029201655s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/argoproj.io/v1beta1?timeout=32s logger.go:42: 11:59:53 | 1-071_validate_node_selectors/2-custom-node-selector | test step completed 2-custom-node-selector logger.go:42: 11:59:53 | 1-071_validate_node_selectors/3-patch-run-on-infra | starting test step 3-patch-run-on-infra logger.go:42: 11:59:53 | 1-071_validate_node_selectors/3-patch-run-on-infra | running command: [sh -c oc patch gitopsservice cluster --type=merge --patch='{"spec": {"runOnInfra": true, "tolerations": [{"effect": "NoSchedule", "key": "infra", "value": "reserved"}]}}' ] logger.go:42: 11:59:54 | 1-071_validate_node_selectors/3-patch-run-on-infra | gitopsservice.pipelines.openshift.io/cluster patched logger.go:42: 11:59:56 | 1-071_validate_node_selectors/3-patch-run-on-infra | test step completed 3-patch-run-on-infra logger.go:42: 11:59:56 | 1-071_validate_node_selectors/4-change-back | starting test step 4-change-back logger.go:42: 11:59:56 | 1-071_validate_node_selectors/4-change-back | running command: [sh -c oc patch gitopsservice cluster --type=json --patch='[{"op": "remove", "path": "/spec/tolerations"}, {"op": "remove", "path": "/spec/runOnInfra"}, {"op": "remove", "path": "/spec/nodeSelector"}]' oc patch statefulset openshift-gitops-application-controller -n openshift-gitops -p '{"spec":{"replicas":0}}' ] logger.go:42: 11:59:57 | 1-071_validate_node_selectors/4-change-back | gitopsservice.pipelines.openshift.io/cluster patched logger.go:42: 11:59:57 | 1-071_validate_node_selectors/4-change-back | statefulset.apps/openshift-gitops-application-controller patched logger.go:42: 12:00:00 | 1-071_validate_node_selectors/4-change-back | test step completed 4-change-back logger.go:42: 12:00:00 | 1-071_validate_node_selectors | skipping kubernetes event logging logger.go:42: 12:00:00 | 1-071_validate_node_selectors | Deleting namespace: kuttl-test-hopeful-polecat === CONT kuttl/harness/1-064_validate_tcp_reset_error logger.go:42: 12:00:05 | 1-064_validate_tcp_reset_error | Creating namespace: kuttl-test-many-eagle logger.go:42: 12:00:05 | 1-064_validate_tcp_reset_error/1- | starting test step 1- I0224 12:00:07.047404 3736 request.go:682] Waited for 1.028859331s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s logger.go:42: 12:00:08 | 1-064_validate_tcp_reset_error/1- | test step completed 1- logger.go:42: 12:00:08 | 1-064_validate_tcp_reset_error/2-install | starting test step 2-install logger.go:42: 12:00:11 | 1-064_validate_tcp_reset_error/2-install | Application:openshift-gitops/1-27-argocd created logger.go:42: 12:00:49 | 1-064_validate_tcp_reset_error/2-install | test step completed 2-install logger.go:42: 12:00:49 | 1-064_validate_tcp_reset_error/3-create-app | starting test step 3-create-app I0224 12:00:50.106301 3736 request.go:682] Waited for 1.027614597s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/performance.openshift.io/v2?timeout=32s logger.go:42: 12:00:51 | 1-064_validate_tcp_reset_error/3-create-app | Application:test-1-27-custom/guestbook created logger.go:42: 12:00:59 | 1-064_validate_tcp_reset_error/3-create-app | test step completed 3-create-app logger.go:42: 12:00:59 | 1-064_validate_tcp_reset_error/4-check-app-manifest | starting test step 4-check-app-manifest logger.go:42: 12:00:59 | 1-064_validate_tcp_reset_error/4-check-app-manifest | running command: [sh -c set -e cleanup() { argocd logout "${api_server}" unset api_server unset password } trap cleanup INT TERM EXIT # Get credentials api_server=$(oc get routes -n openshift-gitops --field-selector metadata.name=openshift-gitops-server -o jsonpath="{.items[*]['spec.host']}") password=$(oc get secret openshift-gitops-cluster -n openshift-gitops -o jsonpath='{.data.admin\.password}' | base64 -d) # Login into ArgoCD login=$(argocd login $api_server --username admin --password $password --insecure) if ! [[ "${login}" =~ "'admin:login' logged in successfully" ]]; then echo "ERROR: unable to login to ArgoCD remote api server" exit 1 fi # Execute 'argocd app manifest' and check the 'read tcp' error app_manifests=$(argocd app manifests 1-27-argocd --source git --revision HEAD) if [[ "${app_manifests}" =~ 'Original error: read tcp' ]]; then echo "ERROR: TCP reset error is present in this code" exit 2 fi exit 0 ] logger.go:42: 12:01:00 | 1-064_validate_tcp_reset_error/4-check-app-manifest | time="2025-02-24T12:01:00Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." logger.go:42: 12:01:02 | 1-064_validate_tcp_reset_error/4-check-app-manifest | time="2025-02-24T12:01:02Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." logger.go:42: 12:01:02 | 1-064_validate_tcp_reset_error/4-check-app-manifest | Logged out from 'openshift-gitops-server-openshift-gitops.apps.nas-psi-414-02.ocp-gitops-qe.com' I0224 12:01:03.709719 3736 request.go:682] Waited for 1.028084318s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/autoscaling.openshift.io/v1?timeout=32s logger.go:42: 12:01:05 | 1-064_validate_tcp_reset_error/4-check-app-manifest | test step completed 4-check-app-manifest logger.go:42: 12:01:05 | 1-064_validate_tcp_reset_error/99-delete | starting test step 99-delete I0224 12:01:18.415362 3736 request.go:682] Waited for 1.028870326s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/helm.openshift.io/v1beta1?timeout=32s logger.go:42: 12:01:19 | 1-064_validate_tcp_reset_error/99-delete | test step completed 99-delete logger.go:42: 12:01:19 | 1-064_validate_tcp_reset_error | skipping kubernetes event logging logger.go:42: 12:01:19 | 1-064_validate_tcp_reset_error | Deleting namespace: kuttl-test-many-eagle === CONT kuttl/harness/1-056_validate_managed-by logger.go:42: 12:01:25 | 1-056_validate_managed-by | Creating namespace: kuttl-test-regular-goat logger.go:42: 12:01:25 | 1-056_validate_managed-by/1-install | starting test step 1-install logger.go:42: 12:01:28 | 1-056_validate_managed-by/1-install | Namespace:/test-1-56-target created logger.go:42: 12:01:28 | 1-056_validate_managed-by/1-install | Namespace:/test-1-56-custom created logger.go:42: 12:01:28 | 1-056_validate_managed-by/1-install | ArgoCD:test-1-56-target/example-argocd created logger.go:42: 12:02:00 | 1-056_validate_managed-by/1-install | test step completed 1-install logger.go:42: 12:02:00 | 1-056_validate_managed-by/2-delete | starting test step 2-delete I0224 12:02:02.078976 3736 request.go:682] Waited for 1.025971644s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/build.openshift.io/v1?timeout=32s logger.go:42: 12:02:03 | 1-056_validate_managed-by/2-delete | test step completed 2-delete logger.go:42: 12:02:03 | 1-056_validate_managed-by/3-check | starting test step 3-check logger.go:42: 12:02:03 | 1-056_validate_managed-by/3-check | running command: [sh -c set -e label_value=$(oc get ns/test-1-56-custom -o go-template=$'{{index .metadata.labels "argocd.argoproj.io/managed-by"}}') echo "label value: ${label_value}" if [[ "${label_value}" == "test-1-56-target" ]]; then echo "managed-by label exists, set REMOVE_MANAGED_BY_LABEL_ON_ARGOCD_DELETION variable to delete the label" exit 0 fi exit 1 ] logger.go:42: 12:02:03 | 1-056_validate_managed-by/3-check | label value: test-1-56-target logger.go:42: 12:02:03 | 1-056_validate_managed-by/3-check | managed-by label exists, set REMOVE_MANAGED_BY_LABEL_ON_ARGOCD_DELETION variable to delete the label logger.go:42: 12:02:06 | 1-056_validate_managed-by/3-check | test step completed 3-check logger.go:42: 12:02:06 | 1-056_validate_managed-by/4-add_env | starting test step 4-add_env logger.go:42: 12:02:06 | 1-056_validate_managed-by/4-add_env | running command: [sh -c set -e oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "REMOVE_MANAGED_BY_LABEL_ON_ARGOCD_DELETION", "value": "true"}]}}}' ] logger.go:42: 12:02:06 | 1-056_validate_managed-by/4-add_env | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found case.go:364: failed in step 4-add_env case.go:366: exit status 1 logger.go:42: 12:02:09 | 1-056_validate_managed-by | skipping kubernetes event logging logger.go:42: 12:02:09 | 1-056_validate_managed-by | Deleting namespace: kuttl-test-regular-goat === CONT kuttl/harness/1-050_validate_sso logger.go:42: 12:02:15 | 1-050_validate_sso | Creating namespace: kuttl-test-up-dinosaur logger.go:42: 12:02:15 | 1-050_validate_sso/1-install | starting test step 1-install I0224 12:02:16.185408 3736 request.go:682] Waited for 1.029896998s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/oauth.openshift.io/v1?timeout=32s logger.go:42: 12:02:17 | 1-050_validate_sso/1-install | ArgoCD:kuttl-test-up-dinosaur/argocd created logger.go:42: 12:02:50 | 1-050_validate_sso/1-install | test step completed 1-install logger.go:42: 12:02:50 | 1-050_validate_sso/2-remove-spec-sso | starting test step 2-remove-spec-sso logger.go:42: 12:02:50 | 1-050_validate_sso/2-remove-spec-sso | running command: [sh -c oc patch -n $NAMESPACE argocd/argocd --type='json' -p='[{"op": "remove", "path": "/spec/sso"}]' ] logger.go:42: 12:02:50 | 1-050_validate_sso/2-remove-spec-sso | argocd.argoproj.io/argocd patched logger.go:42: 12:02:50 | 1-050_validate_sso/2-remove-spec-sso | running command: [sh -c sleep 10] I0224 12:03:01.685373 3736 request.go:682] Waited for 1.028466758s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apiserver.openshift.io/v1?timeout=32s logger.go:42: 12:03:03 | 1-050_validate_sso/2-remove-spec-sso | test step completed 2-remove-spec-sso logger.go:42: 12:03:03 | 1-050_validate_sso/7-provider-keycloak-dex-spec | starting test step 7-provider-keycloak-dex-spec logger.go:42: 12:03:05 | 1-050_validate_sso/7-provider-keycloak-dex-spec | ArgoCD:kuttl-test-up-dinosaur/argocd updated logger.go:42: 12:03:05 | 1-050_validate_sso/7-provider-keycloak-dex-spec | test step completed 7-provider-keycloak-dex-spec logger.go:42: 12:03:05 | 1-050_validate_sso/8-remove-spec-dex | starting test step 8-remove-spec-dex logger.go:42: 12:03:05 | 1-050_validate_sso/8-remove-spec-dex | running command: [sh -c oc patch -n $NAMESPACE argocd/argocd --type='json' -p='[{"op": "remove", "path": "/spec/sso/dex"}]' ] logger.go:42: 12:03:06 | 1-050_validate_sso/8-remove-spec-dex | argocd.argoproj.io/argocd patched logger.go:42: 12:05:21 | 1-050_validate_sso/8-remove-spec-dex | test step completed 8-remove-spec-dex logger.go:42: 12:05:21 | 1-050_validate_sso | skipping kubernetes event logging logger.go:42: 12:05:21 | 1-050_validate_sso | Deleting namespace: kuttl-test-up-dinosaur === CONT kuttl/harness/1-042_validate_status_host logger.go:42: 12:05:32 | 1-042_validate_status_host | Creating namespace: kuttl-test-beloved-coyote logger.go:42: 12:05:33 | 1-042_validate_status_host/1-install | starting test step 1-install I0224 12:05:34.313067 3736 request.go:682] Waited for 1.03757711s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/samples.operator.openshift.io/v1?timeout=32s logger.go:42: 12:05:35 | 1-042_validate_status_host/1-install | ArgoCD:kuttl-test-beloved-coyote/example-argocd created logger.go:42: 12:06:07 | 1-042_validate_status_host/1-install | test step completed 1-install logger.go:42: 12:06:07 | 1-042_validate_status_host/2-check_URL | starting test step 2-check_URL logger.go:42: 12:06:07 | 1-042_validate_status_host/2-check_URL | running command: [sh -c until [[ $i -eq 20 ]] do route_URL=$(oc get routes -o jsonpath="{.items[*]['spec.host']}" --field-selector metadata.name=example-argocd-server -n $NAMESPACE) status_URL=$(oc get argocd -o jsonpath="{.items[*]['status.host']}" -n $NAMESPACE) echo -e "route_URL:${route_URL}\nstatus_URL:${status_URL}" if ! [[ "${status_URL}" == "${route_URL}" ]]; then i=$((i+1)) sleep 6 else exit 0 fi done echo "Error: Route does not match" exit 1 ] logger.go:42: 12:06:08 | 1-042_validate_status_host/2-check_URL | route_URL:example-argocd-server-kuttl-test-beloved-coyote.apps.nas-psi-414-02.ocp-gitops-qe.com logger.go:42: 12:06:08 | 1-042_validate_status_host/2-check_URL | status_URL:example-argocd-server-kuttl-test-beloved-coyote.apps.nas-psi-414-02.ocp-gitops-qe.com I0224 12:06:09.443297 3736 request.go:682] Waited for 1.024401248s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/samples.operator.openshift.io/v1?timeout=32s logger.go:42: 12:06:10 | 1-042_validate_status_host/2-check_URL | test step completed 2-check_URL logger.go:42: 12:06:10 | 1-042_validate_status_host/3-modify_route_URL | starting test step 3-modify_route_URL logger.go:42: 12:06:10 | 1-042_validate_status_host/3-modify_route_URL | running command: [sh -c oc patch route example-argocd-server -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/host", "value":"modified-route"}]' ] logger.go:42: 12:06:11 | 1-042_validate_status_host/3-modify_route_URL | route.route.openshift.io/example-argocd-server patched logger.go:42: 12:06:14 | 1-042_validate_status_host/3-modify_route_URL | test step completed 3-modify_route_URL logger.go:42: 12:06:14 | 1-042_validate_status_host/4-disable_route | starting test step 4-disable_route logger.go:42: 12:06:18 | 1-042_validate_status_host/4-disable_route | ArgoCD:kuttl-test-beloved-coyote/example-argocd updated logger.go:42: 12:06:18 | 1-042_validate_status_host/4-disable_route | test step completed 4-disable_route logger.go:42: 12:06:18 | 1-042_validate_status_host/5-check_URL_gone | starting test step 5-check_URL_gone logger.go:42: 12:06:18 | 1-042_validate_status_host/5-check_URL_gone | running command: [sh -c sleep 5 status_URL=$(oc get argocd -o jsonpath="{.items[*]['status.host']}" -n $NAMESPACE) echo "${status_URL}" if test "${status_URL}" != ""; then echo "Error: status.host should not be present in argocd" exit 1 fi exit 0 ] logger.go:42: 12:06:23 | 1-042_validate_status_host/5-check_URL_gone | I0224 12:06:24.969128 3736 request.go:682] Waited for 1.028889481s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/quota.openshift.io/v1?timeout=32s logger.go:42: 12:06:26 | 1-042_validate_status_host/5-check_URL_gone | test step completed 5-check_URL_gone logger.go:42: 12:06:26 | 1-042_validate_status_host | skipping kubernetes event logging logger.go:42: 12:06:26 | 1-042_validate_status_host | Deleting namespace: kuttl-test-beloved-coyote === CONT kuttl/harness/1-041_validate_argocd_sync_alert logger.go:42: 12:06:32 | 1-041_validate_argocd_sync_alert | Creating namespace: kuttl-test-handy-scorpion logger.go:42: 12:06:32 | 1-041_validate_argocd_sync_alert/1- | starting test step 1- I0224 12:06:35.018244 3736 request.go:682] Waited for 2.479269341s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s logger.go:42: 12:06:35 | 1-041_validate_argocd_sync_alert/1- | test step completed 1- logger.go:42: 12:06:35 | 1-041_validate_argocd_sync_alert | skipping kubernetes event logging logger.go:42: 12:06:35 | 1-041_validate_argocd_sync_alert | Deleting namespace: kuttl-test-handy-scorpion === CONT kuttl/harness/1-040_validate_quoted_RBAC_group_names logger.go:42: 12:06:40 | 1-040_validate_quoted_RBAC_group_names | Creating namespace: kuttl-test-bright-shepherd logger.go:42: 12:06:40 | 1-040_validate_quoted_RBAC_group_names/1-login_argocd_api_server | starting test step 1-login_argocd_api_server logger.go:42: 12:06:40 | 1-040_validate_quoted_RBAC_group_names/1-login_argocd_api_server | running command: [sh -c api_server=$(oc get routes -n openshift-gitops --field-selector metadata.name=openshift-gitops-server -o jsonpath="{.items[*]['spec.host']}") password=$(oc get secret openshift-gitops-cluster -n openshift-gitops -o jsonpath='{.data.admin\.password}' | base64 -d) output=$(argocd login $api_server --username admin --password $password --insecure) if ! [[ "${output}" =~ "'admin:login' logged in successfully" ]]; then exit 1 fi exit 0 ] logger.go:42: 12:06:42 | 1-040_validate_quoted_RBAC_group_names/1-login_argocd_api_server | time="2025-02-24T12:06:42Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." I0224 12:06:45.058049 3736 request.go:682] Waited for 2.079152424s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/pipelines.openshift.io/v1alpha1?timeout=32s logger.go:42: 12:06:45 | 1-040_validate_quoted_RBAC_group_names/1-login_argocd_api_server | test step completed 1-login_argocd_api_server logger.go:42: 12:06:45 | 1-040_validate_quoted_RBAC_group_names/2-create_role | starting test step 2-create_role logger.go:42: 12:06:45 | 1-040_validate_quoted_RBAC_group_names/2-create_role | running command: [sh -c output=$(argocd proj role create default somerole) if ! [[ "$output" =~ "Role 'somerole' created" ]]; then echo "Error creating role" exit 1 fi exit 0 ] logger.go:42: 12:06:45 | 1-040_validate_quoted_RBAC_group_names/2-create_role | time="2025-02-24T12:06:45Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." logger.go:42: 12:06:48 | 1-040_validate_quoted_RBAC_group_names/2-create_role | test step completed 2-create_role logger.go:42: 12:06:48 | 1-040_validate_quoted_RBAC_group_names/3-specify_group_names | starting test step 3-specify_group_names logger.go:42: 12:06:48 | 1-040_validate_quoted_RBAC_group_names/3-specify_group_names | running command: [sh -c output=$(argocd proj role add-group default somerole '"CN=foo,OU=bar,O=baz"') cleanup() { argocd proj role delete default somerole } trap cleanup INT TERM EXIT if ! [[ "${output}" =~ "added to role 'somerole'" ]]; then echo "Contains comma characters!" exit 1 fi ] logger.go:42: 12:06:48 | 1-040_validate_quoted_RBAC_group_names/3-specify_group_names | time="2025-02-24T12:06:48Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." logger.go:42: 12:06:48 | 1-040_validate_quoted_RBAC_group_names/3-specify_group_names | time="2025-02-24T12:06:48Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." logger.go:42: 12:06:48 | 1-040_validate_quoted_RBAC_group_names/3-specify_group_names | Role 'somerole' deleted logger.go:42: 12:06:51 | 1-040_validate_quoted_RBAC_group_names/3-specify_group_names | test step completed 3-specify_group_names logger.go:42: 12:06:51 | 1-040_validate_quoted_RBAC_group_names | skipping kubernetes event logging logger.go:42: 12:06:51 | 1-040_validate_quoted_RBAC_group_names | Deleting namespace: kuttl-test-bright-shepherd === CONT kuttl/harness/1-037_validate_applicationset_in_any_namespace logger.go:42: 12:06:57 | 1-037_validate_applicationset_in_any_namespace | Creating namespace: kuttl-test-more-ant logger.go:42: 12:06:57 | 1-037_validate_applicationset_in_any_namespace/0-prepare | starting test step 0-prepare I0224 12:06:58.378754 3736 request.go:682] Waited for 1.028428585s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/ingress.operator.openshift.io/v1?timeout=32s logger.go:42: 12:06:59 | 1-037_validate_applicationset_in_any_namespace/0-prepare | Namespace:/appset-argocd created logger.go:42: 12:06:59 | 1-037_validate_applicationset_in_any_namespace/0-prepare | Namespace:/appset-old-ns created logger.go:42: 12:06:59 | 1-037_validate_applicationset_in_any_namespace/0-prepare | Namespace:/appset-new-ns created logger.go:42: 12:07:00 | 1-037_validate_applicationset_in_any_namespace/0-prepare | test step completed 0-prepare logger.go:42: 12:07:00 | 1-037_validate_applicationset_in_any_namespace/1-argocd | starting test step 1-argocd logger.go:42: 12:07:02 | 1-037_validate_applicationset_in_any_namespace/1-argocd | ArgoCD:appset-argocd/example created logger.go:42: 12:07:14 | 1-037_validate_applicationset_in_any_namespace/1-argocd | test step completed 1-argocd logger.go:42: 12:07:14 | 1-037_validate_applicationset_in_any_namespace/2-enable-appset-in-any-ns | starting test step 2-enable-appset-in-any-ns I0224 12:07:15.686646 3736 request.go:682] Waited for 1.029177604s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/argoproj.io/v1beta1?timeout=32s logger.go:42: 12:07:17 | 1-037_validate_applicationset_in_any_namespace/2-enable-appset-in-any-ns | ArgoCD:appset-argocd/example updated logger.go:42: 12:07:17 | 1-037_validate_applicationset_in_any_namespace/2-enable-appset-in-any-ns | test step completed 2-enable-appset-in-any-ns logger.go:42: 12:07:17 | 1-037_validate_applicationset_in_any_namespace/3-add-new-appset-ns | starting test step 3-add-new-appset-ns logger.go:42: 12:07:19 | 1-037_validate_applicationset_in_any_namespace/3-add-new-appset-ns | ArgoCD:appset-argocd/example updated logger.go:42: 12:07:19 | 1-037_validate_applicationset_in_any_namespace/3-add-new-appset-ns | test step completed 3-add-new-appset-ns logger.go:42: 12:07:19 | 1-037_validate_applicationset_in_any_namespace/4-enable-apps-in-new-ns | starting test step 4-enable-apps-in-new-ns logger.go:42: 12:07:22 | 1-037_validate_applicationset_in_any_namespace/4-enable-apps-in-new-ns | ArgoCD:appset-argocd/example updated logger.go:42: 12:07:23 | 1-037_validate_applicationset_in_any_namespace/4-enable-apps-in-new-ns | test step completed 4-enable-apps-in-new-ns logger.go:42: 12:07:23 | 1-037_validate_applicationset_in_any_namespace/5-enable-apps-in-old-ns | starting test step 5-enable-apps-in-old-ns I0224 12:07:25.729766 3736 request.go:682] Waited for 1.928623374s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machine.openshift.io/v1?timeout=32s logger.go:42: 12:07:26 | 1-037_validate_applicationset_in_any_namespace/5-enable-apps-in-old-ns | ArgoCD:appset-argocd/example updated logger.go:42: 12:07:27 | 1-037_validate_applicationset_in_any_namespace/5-enable-apps-in-old-ns | test step completed 5-enable-apps-in-old-ns logger.go:42: 12:07:27 | 1-037_validate_applicationset_in_any_namespace/6-disable-appset-in-new-ns | starting test step 6-disable-appset-in-new-ns logger.go:42: 12:07:30 | 1-037_validate_applicationset_in_any_namespace/6-disable-appset-in-new-ns | ArgoCD:appset-argocd/example updated logger.go:42: 12:07:31 | 1-037_validate_applicationset_in_any_namespace/6-disable-appset-in-new-ns | test step completed 6-disable-appset-in-new-ns logger.go:42: 12:07:31 | 1-037_validate_applicationset_in_any_namespace/7-disable-apps-in-all-ns | starting test step 7-disable-apps-in-all-ns logger.go:42: 12:07:33 | 1-037_validate_applicationset_in_any_namespace/7-disable-apps-in-all-ns | ArgoCD:appset-argocd/example updated logger.go:42: 12:07:35 | 1-037_validate_applicationset_in_any_namespace/7-disable-apps-in-all-ns | test step completed 7-disable-apps-in-all-ns logger.go:42: 12:07:35 | 1-037_validate_applicationset_in_any_namespace/99-cleanup | starting test step 99-cleanup I0224 12:08:10.966121 3736 request.go:682] Waited for 1.029394976s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/networking.k8s.io/v1?timeout=32s logger.go:42: 12:08:12 | 1-037_validate_applicationset_in_any_namespace/99-cleanup | test step completed 99-cleanup logger.go:42: 12:08:12 | 1-037_validate_applicationset_in_any_namespace | skipping kubernetes event logging logger.go:42: 12:08:12 | 1-037_validate_applicationset_in_any_namespace | Deleting namespace: kuttl-test-more-ant === CONT kuttl/harness/1-036_validate_role_rolebinding_for_source_namespace logger.go:42: 12:08:18 | 1-036_validate_role_rolebinding_for_source_namespace | Creating namespace: kuttl-test-able-iguana logger.go:42: 12:08:18 | 1-036_validate_role_rolebinding_for_source_namespace/1-sourcenamespace_without_wildcard | starting test step 1-sourcenamespace_without_wildcard logger.go:42: 12:08:20 | 1-036_validate_role_rolebinding_for_source_namespace/1-sourcenamespace_without_wildcard | Namespace:/test created logger.go:42: 12:08:20 | 1-036_validate_role_rolebinding_for_source_namespace/1-sourcenamespace_without_wildcard | ArgoCD:default/example-argocd created logger.go:42: 12:08:22 | 1-036_validate_role_rolebinding_for_source_namespace/1-sourcenamespace_without_wildcard | test step completed 1-sourcenamespace_without_wildcard logger.go:42: 12:08:22 | 1-036_validate_role_rolebinding_for_source_namespace/2-sourceNamespace_with_wildcard_pattern | starting test step 2-sourceNamespace_with_wildcard_pattern I0224 12:08:23.084311 3736 request.go:682] Waited for 1.029576199s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/ingress.operator.openshift.io/v1?timeout=32s logger.go:42: 12:08:24 | 1-036_validate_role_rolebinding_for_source_namespace/2-sourceNamespace_with_wildcard_pattern | Namespace:/test-1 created logger.go:42: 12:08:24 | 1-036_validate_role_rolebinding_for_source_namespace/2-sourceNamespace_with_wildcard_pattern | Namespace:/dev created logger.go:42: 12:08:24 | 1-036_validate_role_rolebinding_for_source_namespace/2-sourceNamespace_with_wildcard_pattern | ArgoCD:default/example-argocd updated logger.go:42: 12:08:25 | 1-036_validate_role_rolebinding_for_source_namespace/2-sourceNamespace_with_wildcard_pattern | test step completed 2-sourceNamespace_with_wildcard_pattern logger.go:42: 12:08:25 | 1-036_validate_role_rolebinding_for_source_namespace/3-new_namespace_with_match_pattern | starting test step 3-new_namespace_with_match_pattern logger.go:42: 12:08:28 | 1-036_validate_role_rolebinding_for_source_namespace/3-new_namespace_with_match_pattern | Namespace:/test-2 created logger.go:42: 12:08:29 | 1-036_validate_role_rolebinding_for_source_namespace/3-new_namespace_with_match_pattern | test step completed 3-new_namespace_with_match_pattern logger.go:42: 12:08:29 | 1-036_validate_role_rolebinding_for_source_namespace/4-sourceNamespace_with_wildcard | starting test step 4-sourceNamespace_with_wildcard logger.go:42: 12:08:32 | 1-036_validate_role_rolebinding_for_source_namespace/4-sourceNamespace_with_wildcard | Namespace:/test-3 created logger.go:42: 12:08:32 | 1-036_validate_role_rolebinding_for_source_namespace/4-sourceNamespace_with_wildcard | ArgoCD:default/example-argocd updated logger.go:42: 12:08:36 | 1-036_validate_role_rolebinding_for_source_namespace/4-sourceNamespace_with_wildcard | test step completed 4-sourceNamespace_with_wildcard logger.go:42: 12:08:36 | 1-036_validate_role_rolebinding_for_source_namespace/5-multiple_sourcenamespace | starting test step 5-multiple_sourcenamespace I0224 12:08:37.253572 3736 request.go:682] Waited for 1.027145177s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/discovery.k8s.io/v1?timeout=32s logger.go:42: 12:08:39 | 1-036_validate_role_rolebinding_for_source_namespace/5-multiple_sourcenamespace | Namespace:/test-ns-1 created logger.go:42: 12:08:39 | 1-036_validate_role_rolebinding_for_source_namespace/5-multiple_sourcenamespace | Namespace:/dev-ns-1 created logger.go:42: 12:08:39 | 1-036_validate_role_rolebinding_for_source_namespace/5-multiple_sourcenamespace | Namespace:/other-ns created logger.go:42: 12:08:39 | 1-036_validate_role_rolebinding_for_source_namespace/5-multiple_sourcenamespace | ArgoCD:default/example-argocd updated logger.go:42: 12:08:43 | 1-036_validate_role_rolebinding_for_source_namespace/5-multiple_sourcenamespace | test step completed 5-multiple_sourcenamespace logger.go:42: 12:08:43 | 1-036_validate_role_rolebinding_for_source_namespace/6-validate_labels_role_rolebinding_after_removing_namespace_from_sourcenamespace | starting test step 6-validate_labels_role_rolebinding_after_removing_namespace_from_sourcenamespace logger.go:42: 12:08:46 | 1-036_validate_role_rolebinding_for_source_namespace/6-validate_labels_role_rolebinding_after_removing_namespace_from_sourcenamespace | ArgoCD:default/example-argocd updated logger.go:42: 12:08:47 | 1-036_validate_role_rolebinding_for_source_namespace/6-validate_labels_role_rolebinding_after_removing_namespace_from_sourcenamespace | test step completed 6-validate_labels_role_rolebinding_after_removing_namespace_from_sourcenamespace logger.go:42: 12:08:47 | 1-036_validate_role_rolebinding_for_source_namespace | skipping kubernetes event logging logger.go:42: 12:08:47 | 1-036_validate_role_rolebinding_for_source_namespace | Deleting namespace: kuttl-test-able-iguana === CONT kuttl/harness/1-018_validate_disable_default_instance logger.go:42: 12:08:53 | 1-018_validate_disable_default_instance | Ignoring errors.yaml as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 12:08:53 | 1-018_validate_disable_default_instance | Creating namespace: kuttl-test-possible-duckling logger.go:42: 12:08:53 | 1-018_validate_disable_default_instance/1- | starting test step 1- I0224 12:08:54.565379 3736 request.go:682] Waited for 1.028571317s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/cloudcredential.openshift.io/v1?timeout=32s logger.go:42: 12:08:56 | 1-018_validate_disable_default_instance/1- | test step completed 1- logger.go:42: 12:08:56 | 1-018_validate_disable_default_instance/2-patch-subscription | starting test step 2-patch-subscription logger.go:42: 12:08:56 | 1-018_validate_disable_default_instance/2-patch-subscription | running command: [sh -c oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "DISABLE_DEFAULT_ARGOCD_INSTANCE", "value": "true"}]}}}' ] logger.go:42: 12:08:56 | 1-018_validate_disable_default_instance/2-patch-subscription | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found logger.go:42: 12:08:56 | 1-018_validate_disable_default_instance/2-patch-subscription | command failure, skipping 1 additional commands case.go:364: failed in step 2-patch-subscription case.go:366: exit status 1 logger.go:42: 12:08:58 | 1-018_validate_disable_default_instance | skipping kubernetes event logging logger.go:42: 12:08:58 | 1-018_validate_disable_default_instance | Deleting namespace: kuttl-test-possible-duckling === CONT kuttl/harness/1-035_validate_argocd_secret_repopulate logger.go:42: 12:09:04 | 1-035_validate_argocd_secret_repopulate | Creating namespace: kuttl-test-evolving-gazelle logger.go:42: 12:09:04 | 1-035_validate_argocd_secret_repopulate/1- | starting test step 1- I0224 12:09:05.855314 3736 request.go:682] Waited for 1.028505116s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/migration.k8s.io/v1alpha1?timeout=32s logger.go:42: 12:09:07 | 1-035_validate_argocd_secret_repopulate/1- | test step completed 1- logger.go:42: 12:09:07 | 1-035_validate_argocd_secret_repopulate/2-remove_secret_data | starting test step 2-remove_secret_data logger.go:42: 12:09:07 | 1-035_validate_argocd_secret_repopulate/2-remove_secret_data | running command: [sh -c oc patch secret/argocd-secret -p '{"data":null}' -n openshift-gitops ] logger.go:42: 12:09:07 | 1-035_validate_argocd_secret_repopulate/2-remove_secret_data | secret/argocd-secret patched logger.go:42: 12:09:10 | 1-035_validate_argocd_secret_repopulate/2-remove_secret_data | test step completed 2-remove_secret_data logger.go:42: 12:09:10 | 1-035_validate_argocd_secret_repopulate/3-check_secret_repopulate | starting test step 3-check_secret_repopulate logger.go:42: 12:09:10 | 1-035_validate_argocd_secret_repopulate/3-check_secret_repopulate | running command: [sh -c until [[ $i -eq 20 ]] do secret_data=$(oc get secret/argocd-secret -n openshift-gitops -o custom-columns=SECRET:.data --no-headers) if [[ $secret_data == "" ]] then i=$((i+1)) sleep 6 else echo "argocd-secret was repopulated" exit 0 fi done echo "argocd-secret was not repopulated" exit 1 ] logger.go:42: 12:09:10 | 1-035_validate_argocd_secret_repopulate/3-check_secret_repopulate | argocd-secret was repopulated logger.go:42: 12:09:13 | 1-035_validate_argocd_secret_repopulate/3-check_secret_repopulate | test step completed 3-check_secret_repopulate logger.go:42: 12:09:13 | 1-035_validate_argocd_secret_repopulate/4-check_controller_pod_status | starting test step 4-check_controller_pod_status logger.go:42: 12:09:13 | 1-035_validate_argocd_secret_repopulate/4-check_controller_pod_status | running command: [sh -c oc rollout status deployment openshift-gitops-operator-controller-manager -n openshift-operators --timeout=1m rollout_status=$? if [ "${rollout_status}" -ne 0 ]; then echo "openshift-gitops-operator-controller-manager deployment was not successfully rolled out" exit 1 fi exit 0 ] logger.go:42: 12:09:13 | 1-035_validate_argocd_secret_repopulate/4-check_controller_pod_status | Error from server (NotFound): deployments.apps "openshift-gitops-operator-controller-manager" not found logger.go:42: 12:09:13 | 1-035_validate_argocd_secret_repopulate/4-check_controller_pod_status | openshift-gitops-operator-controller-manager deployment was not successfully rolled out I0224 12:09:15.896434 3736 request.go:682] Waited for 2.378775175s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/template.openshift.io/v1?timeout=32s case.go:364: failed in step 4-check_controller_pod_status case.go:366: exit status 1 logger.go:42: 12:09:16 | 1-035_validate_argocd_secret_repopulate | skipping kubernetes event logging logger.go:42: 12:09:16 | 1-035_validate_argocd_secret_repopulate | Deleting namespace: kuttl-test-evolving-gazelle === CONT kuttl/harness/1-031_validate_toolchain logger.go:42: 12:09:21 | 1-031_validate_toolchain | Creating namespace: kuttl-test-uncommon-louse logger.go:42: 12:09:21 | 1-031_validate_toolchain/1-check | starting test step 1-check logger.go:42: 12:09:21 | 1-031_validate_toolchain/1-check | running command: [sh -c set -e set -o pipefail # These variables need to be maintained according to the component matrix: https://spaces.redhat.com/display/GITOPS/GitOps+Component+Matrix expected_kustomizeVersion='v5.4.3' expected_helmVersion='v3.15.4' expected_argocdVersion='v2.13.5' expected_dexVersion='v2.41.1-1-ga7854d65' expected_redisVersion='6.2.17' gitops_server_pod=$(oc get -n openshift-gitops pods \ -o custom-columns=NAME:.metadata.name --no-headers | \ grep openshift-gitops-server | \ head -1 ) dex_pod=$(oc get -n openshift-gitops pods \ -o custom-columns=NAME:.metadata.name --no-headers | \ grep openshift-gitops-dex-server | \ head -1 ) redis_pod=$(oc get -n openshift-gitops pods \ -o custom-columns=NAME:.metadata.name --no-headers | \ grep openshift-gitops-redis | \ head -1 ) route=$(oc get route -n openshift-gitops \ -o custom-columns=NAME:.spec.host --no-headers | \ grep openshift-gitops-server | \ head -1 ) kustomizeVersion=$(oc -n openshift-gitops exec $gitops_server_pod \ -- kustomize version ) helmVersion=$(oc -n openshift-gitops exec $gitops_server_pod \ -- helm version | \ sed -e 's/version.BuildInfo//' -e 's/\"//g' | \ awk -F':' '{ print $2 }' | \ awk -F',' '{ print $1 }' ) argocdVersion=$(oc -n openshift-gitops exec $gitops_server_pod \ -- argocd version --short --server $route --insecure | \ grep 'argocd-server' | \ awk -F' ' '{ print $2 }' | \ sed 's/\+.*//' ) dexVersion=$(oc -n openshift-gitops exec $dex_pod -- dex version 2>&1 | \ grep '^Dex Version' | \ awk -F': ' '{ print $2 }' ) redisVersion=$(oc -n openshift-gitops exec $redis_pod -- \ redis-server -v | awk -F '=' '{ print $2 }' | cut -d' ' -f 1 ) if test "${kustomizeVersion}" != "${expected_kustomizeVersion}"; then echo "Kustomize version mismatch. Should be ${expected_kustomizeVersion}, is ${kustomizeVersion}" exit 1 fi if test "${helmVersion}" != "${expected_helmVersion}"; then echo "Helm version mismatch. Should be ${expected_helmVersion}, is ${helmVersion}" exit 1 fi if test "${argocdVersion}" != "${expected_argocdVersion}"; then echo "ArgoCD version mismatch. Should be ${expected_argocdVersion}, is ${argocdVersion}" exit 1 fi if test "${dexVersion}" != "${expected_dexVersion}"; then echo "Dex version mismatch. Should be ${expected_dexVersion}, is ${dexVersion}" exit 1 fi if test "${redisVersion}" != "${expected_redisVersion}"; then echo "Redis version mismatch. Should be ${expected_redisVersion}, is ${redisVersion}" exit 1 fi ] logger.go:42: 12:09:25 | 1-031_validate_toolchain/1-check | time="2025-02-24T12:09:25Z" level=warning msg="Failed to invoke grpc call. Use flag --grpc-web in grpc calls. To avoid this warning message, use flag --grpc-web." I0224 12:09:28.155824 3736 request.go:682] Waited for 1.028564279s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/machineconfiguration.openshift.io/v1?timeout=32s logger.go:42: 12:09:29 | 1-031_validate_toolchain/1-check | test step completed 1-check logger.go:42: 12:09:29 | 1-031_validate_toolchain | skipping kubernetes event logging logger.go:42: 12:09:29 | 1-031_validate_toolchain | Deleting namespace: kuttl-test-uncommon-louse === CONT kuttl/harness/1-028_validate_run_on_infra logger.go:42: 12:09:35 | 1-028_validate_run_on_infra | Ignoring errors.yaml as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 12:09:35 | 1-028_validate_run_on_infra | Creating namespace: kuttl-test-hip-grackle logger.go:42: 12:09:35 | 1-028_validate_run_on_infra/1-install | starting test step 1-install logger.go:42: 12:09:35 | 1-028_validate_run_on_infra/1-install | running command: [sh -c oc patch gitopsservice cluster --type=merge --patch='{"spec": {"runOnInfra": true, "tolerations": [{"effect": "NoSchedule", "key": "infra", "value": "reserved"}]}}' ] logger.go:42: 12:09:35 | 1-028_validate_run_on_infra/1-install | gitopsservice.pipelines.openshift.io/cluster patched I0224 12:09:38.194387 3736 request.go:682] Waited for 2.279470179s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/network.openshift.io/v1?timeout=32s logger.go:42: 12:09:38 | 1-028_validate_run_on_infra/1-install | test step completed 1-install logger.go:42: 12:09:38 | 1-028_validate_run_on_infra/2-custom-argocd | starting test step 2-custom-argocd logger.go:42: 12:09:41 | 1-028_validate_run_on_infra/2-custom-argocd | ArgoCD:kuttl-test-hip-grackle/argocd created logger.go:42: 12:09:53 | 1-028_validate_run_on_infra/2-custom-argocd | test step completed 2-custom-argocd logger.go:42: 12:09:53 | 1-028_validate_run_on_infra/3-change-back | starting test step 3-change-back logger.go:42: 12:09:53 | 1-028_validate_run_on_infra/3-change-back | running command: [sh -c oc patch gitopsservice cluster --type=json --patch='[{"op": "remove", "path": "/spec/tolerations"}, {"op": "remove", "path": "/spec/runOnInfra"}]' oc patch statefulset openshift-gitops-application-controller -n openshift-gitops -p '{"spec":{"replicas":0}}' ] logger.go:42: 12:09:53 | 1-028_validate_run_on_infra/3-change-back | gitopsservice.pipelines.openshift.io/cluster patched logger.go:42: 12:09:53 | 1-028_validate_run_on_infra/3-change-back | statefulset.apps/openshift-gitops-application-controller patched I0224 12:09:54.945656 3736 request.go:682] Waited for 1.029269212s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/template.openshift.io/v1?timeout=32s logger.go:42: 12:09:56 | 1-028_validate_run_on_infra/3-change-back | test step completed 3-change-back logger.go:42: 12:09:56 | 1-028_validate_run_on_infra/4-check | starting test step 4-check logger.go:42: 12:09:59 | 1-028_validate_run_on_infra/4-check | test step completed 4-check logger.go:42: 12:09:59 | 1-028_validate_run_on_infra | skipping kubernetes event logging logger.go:42: 12:09:59 | 1-028_validate_run_on_infra | Deleting namespace: kuttl-test-hip-grackle === CONT kuttl/harness/1-005_validate_metrics logger.go:42: 12:10:05 | 1-005_validate_metrics | Creating namespace: kuttl-test-natural-ringtail logger.go:42: 12:10:05 | 1-005_validate_metrics/1- | starting test step 1- I0224 12:10:06.144580 3736 request.go:682] Waited for 1.028681437s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/monitoring.coreos.com/v1?timeout=32s logger.go:42: 12:10:07 | 1-005_validate_metrics/1- | test step completed 1- logger.go:42: 12:10:07 | 1-005_validate_metrics | skipping kubernetes event logging logger.go:42: 12:10:07 | 1-005_validate_metrics | Deleting namespace: kuttl-test-natural-ringtail === CONT kuttl/harness/1-027_validate_operand_from_git logger.go:42: 12:10:13 | 1-027_validate_operand_from_git | Creating namespace: kuttl-test-stirred-cow logger.go:42: 12:10:13 | 1-027_validate_operand_from_git/1- | starting test step 1- logger.go:42: 12:10:15 | 1-027_validate_operand_from_git/1- | test step completed 1- logger.go:42: 12:10:15 | 1-027_validate_operand_from_git/2-install | starting test step 2-install I0224 12:10:17.002456 3736 request.go:682] Waited for 1.029074225s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/console.openshift.io/v1?timeout=32s logger.go:42: 12:10:18 | 1-027_validate_operand_from_git/2-install | Application:openshift-gitops/1-27-argocd created logger.go:42: 12:10:56 | 1-027_validate_operand_from_git/2-install | test step completed 2-install logger.go:42: 12:10:56 | 1-027_validate_operand_from_git/3-create-app | starting test step 3-create-app I0224 12:10:57.535668 3736 request.go:682] Waited for 1.029682986s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/console.openshift.io/v1?timeout=32s logger.go:42: 12:10:59 | 1-027_validate_operand_from_git/3-create-app | Application:test-1-27-custom/guestbook created logger.go:42: 12:11:08 | 1-027_validate_operand_from_git/3-create-app | test step completed 3-create-app logger.go:42: 12:11:08 | 1-027_validate_operand_from_git/99-delete | starting test step 99-delete I0224 12:11:21.139339 3736 request.go:682] Waited for 1.029460802s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/monitoring.coreos.com/v1?timeout=32s logger.go:42: 12:11:22 | 1-027_validate_operand_from_git/99-delete | test step completed 99-delete logger.go:42: 12:11:22 | 1-027_validate_operand_from_git | skipping kubernetes event logging logger.go:42: 12:11:22 | 1-027_validate_operand_from_git | Deleting namespace: kuttl-test-stirred-cow === CONT kuttl/harness/1-026-validate_backend_service_permissions logger.go:42: 12:11:28 | 1-026-validate_backend_service_permissions | Creating namespace: kuttl-test-true-ram logger.go:42: 12:11:28 | 1-026-validate_backend_service_permissions/1-check-backend-service | starting test step 1-check-backend-service logger.go:42: 12:11:31 | 1-026-validate_backend_service_permissions/1-check-backend-service | test step completed 1-check-backend-service logger.go:42: 12:11:31 | 1-026-validate_backend_service_permissions | skipping kubernetes event logging logger.go:42: 12:11:31 | 1-026-validate_backend_service_permissions | Deleting namespace: kuttl-test-true-ram === CONT kuttl/harness/1-010_validate-ootb-manage-other-namespace logger.go:42: 12:11:36 | 1-010_validate-ootb-manage-other-namespace | Ignoring README.md as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 12:11:36 | 1-010_validate-ootb-manage-other-namespace | Ignoring errors.yaml as it does not match file name regexp: ^(\d+)-(?:[^\.]+)(?:\.yaml)?$ logger.go:42: 12:11:36 | 1-010_validate-ootb-manage-other-namespace | Creating namespace: kuttl-test-firm-osprey logger.go:42: 12:11:36 | 1-010_validate-ootb-manage-other-namespace/1-install | starting test step 1-install I0224 12:11:37.988525 3736 request.go:682] Waited for 1.029392177s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/project.openshift.io/v1?timeout=32s logger.go:42: 12:11:39 | 1-010_validate-ootb-manage-other-namespace/1-install | Namespace:/test-1-10-custom created logger.go:42: 12:11:39 | 1-010_validate-ootb-manage-other-namespace/1-install | test step completed 1-install logger.go:42: 12:11:39 | 1-010_validate-ootb-manage-other-namespace/2- | starting test step 2- logger.go:42: 12:11:42 | 1-010_validate-ootb-manage-other-namespace/2- | test step completed 2- logger.go:42: 12:11:42 | 1-010_validate-ootb-manage-other-namespace/3-create-application | starting test step 3-create-application logger.go:42: 12:11:44 | 1-010_validate-ootb-manage-other-namespace/3-create-application | Application:openshift-gitops/test-1-10-custom created logger.go:42: 12:11:52 | 1-010_validate-ootb-manage-other-namespace/3-create-application | test step completed 3-create-application logger.go:42: 12:11:52 | 1-010_validate-ootb-manage-other-namespace/4-unlabel-namespace | starting test step 4-unlabel-namespace logger.go:42: 12:11:52 | 1-010_validate-ootb-manage-other-namespace/4-unlabel-namespace | running command: [sh -c kubectl label ns test-1-10-custom argocd.argoproj.io/managed-by-] logger.go:42: 12:11:53 | 1-010_validate-ootb-manage-other-namespace/4-unlabel-namespace | namespace/test-1-10-custom unlabeled logger.go:42: 12:11:53 | 1-010_validate-ootb-manage-other-namespace/4-unlabel-namespace | running command: [sh -c sleep 5] I0224 12:11:59.275139 3736 request.go:682] Waited for 1.028754221s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/snapshot.storage.k8s.io/v1?timeout=32s logger.go:42: 12:12:00 | 1-010_validate-ootb-manage-other-namespace/4-unlabel-namespace | test step completed 4-unlabel-namespace logger.go:42: 12:12:00 | 1-010_validate-ootb-manage-other-namespace/5-check-rbac | starting test step 5-check-rbac logger.go:42: 12:12:03 | 1-010_validate-ootb-manage-other-namespace/5-check-rbac | test step completed 5-check-rbac logger.go:42: 12:12:03 | 1-010_validate-ootb-manage-other-namespace/99-delete | starting test step 99-delete I0224 12:12:15.839903 3736 request.go:682] Waited for 1.029469289s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/image.openshift.io/v1?timeout=32s logger.go:42: 12:12:17 | 1-010_validate-ootb-manage-other-namespace/99-delete | test step completed 99-delete logger.go:42: 12:12:17 | 1-010_validate-ootb-manage-other-namespace | skipping kubernetes event logging logger.go:42: 12:12:17 | 1-010_validate-ootb-manage-other-namespace | Deleting namespace: kuttl-test-firm-osprey === CONT kuttl/harness/1-020_validate_redis_ha_nonha logger.go:42: 12:12:23 | 1-020_validate_redis_ha_nonha | Creating namespace: kuttl-test-clever-drum logger.go:42: 12:12:23 | 1-020_validate_redis_ha_nonha/1- | starting test step 1- logger.go:42: 12:12:25 | 1-020_validate_redis_ha_nonha/1- | test step completed 1- logger.go:42: 12:12:25 | 1-020_validate_redis_ha_nonha/2-enable-ha | starting test step 2-enable-ha I0224 12:12:26.850464 3736 request.go:682] Waited for 1.028014936s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1alpha2?timeout=32s logger.go:42: 12:12:28 | 1-020_validate_redis_ha_nonha/2-enable-ha | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 12:21:31 | 1-020_validate_redis_ha_nonha/2-enable-ha | test step completed 2-enable-ha logger.go:42: 12:21:31 | 1-020_validate_redis_ha_nonha/3-update-ha-resources | starting test step 3-update-ha-resources I0224 12:21:32.785840 3736 request.go:682] Waited for 1.028985532s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/apps.openshift.io/v1?timeout=32s logger.go:42: 12:21:34 | 1-020_validate_redis_ha_nonha/3-update-ha-resources | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 12:21:35 | 1-020_validate_redis_ha_nonha/3-update-ha-resources | test step completed 3-update-ha-resources logger.go:42: 12:21:35 | 1-020_validate_redis_ha_nonha/4-disable-ha | starting test step 4-disable-ha logger.go:42: 12:21:37 | 1-020_validate_redis_ha_nonha/4-disable-ha | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 12:21:50 | 1-020_validate_redis_ha_nonha/4-disable-ha | test step completed 4-disable-ha logger.go:42: 12:21:50 | 1-020_validate_redis_ha_nonha | skipping kubernetes event logging logger.go:42: 12:21:50 | 1-020_validate_redis_ha_nonha | Deleting namespace: kuttl-test-clever-drum === CONT kuttl/harness/1-004_validate_argocd_installation logger.go:42: 12:21:56 | 1-004_validate_argocd_installation | Creating namespace: kuttl-test-charming-jaguar logger.go:42: 12:21:56 | 1-004_validate_argocd_installation/1-check-prereqs | starting test step 1-check-prereqs I0224 12:21:57.787134 3736 request.go:682] Waited for 1.028491621s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operator.openshift.io/v1?timeout=32s logger.go:42: 12:21:59 | 1-004_validate_argocd_installation/1-check-prereqs | test step completed 1-check-prereqs logger.go:42: 12:21:59 | 1-004_validate_argocd_installation/2-change-operand | starting test step 2-change-operand logger.go:42: 12:22:01 | 1-004_validate_argocd_installation/2-change-operand | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 12:22:01 | 1-004_validate_argocd_installation/2-change-operand | test step completed 2-change-operand logger.go:42: 12:22:01 | 1-004_validate_argocd_installation/3-wait | starting test step 3-wait logger.go:42: 12:22:01 | 1-004_validate_argocd_installation/3-wait | running command: [sh -c sleep 5] I0224 12:22:07.890838 3736 request.go:682] Waited for 1.028575655s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/operators.coreos.com/v1?timeout=32s logger.go:42: 12:22:09 | 1-004_validate_argocd_installation/3-wait | test step completed 3-wait logger.go:42: 12:22:09 | 1-004_validate_argocd_installation/4- | starting test step 4- logger.go:42: 12:22:13 | 1-004_validate_argocd_installation/4- | test step completed 4- logger.go:42: 12:22:13 | 1-004_validate_argocd_installation | skipping kubernetes event logging logger.go:42: 12:22:13 | 1-004_validate_argocd_installation | Deleting namespace: kuttl-test-charming-jaguar === CONT kuttl/harness/1-003_validate_cluster_config logger.go:42: 12:22:19 | 1-003_validate_cluster_config | Creating namespace: kuttl-test-tender-arachnid logger.go:42: 12:22:19 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | starting test step 0-cluster-scoped-argocd I0224 12:22:20.838757 3736 request.go:682] Waited for 1.028764337s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/security.internal.openshift.io/v1?timeout=32s logger.go:42: 12:22:22 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | Namespace:/argocd-e2e-cluster-config created logger.go:42: 12:22:22 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | ArgoCD:argocd-e2e-cluster-config/example-argocd created logger.go:42: 12:22:22 | 1-003_validate_cluster_config/0-cluster-scoped-argocd | test step completed 0-cluster-scoped-argocd logger.go:42: 12:22:22 | 1-003_validate_cluster_config/1-cluster-scoped | starting test step 1-cluster-scoped logger.go:42: 12:22:22 | 1-003_validate_cluster_config/1-cluster-scoped | running command: [sh -c oc patch -n openshift-operators subscription openshift-gitops-operator \ --type merge --patch '{"spec": {"config": {"env": [{"name": "ARGOCD_CLUSTER_CONFIG_NAMESPACES", "value": "openshift-gitops, argocd-e2e-cluster-config"}]}}}' ] logger.go:42: 12:22:22 | 1-003_validate_cluster_config/1-cluster-scoped | Error from server (NotFound): subscriptions.operators.coreos.com "openshift-gitops-operator" not found case.go:364: failed in step 1-cluster-scoped case.go:366: exit status 1 logger.go:42: 12:22:25 | 1-003_validate_cluster_config | skipping kubernetes event logging logger.go:42: 12:22:25 | 1-003_validate_cluster_config | Deleting namespace: kuttl-test-tender-arachnid === CONT kuttl/harness/1-006_validate_machine_config logger.go:42: 12:22:31 | 1-006_validate_machine_config | Creating namespace: kuttl-test-pleased-snipe logger.go:42: 12:22:31 | 1-006_validate_machine_config/1-install | starting test step 1-install I0224 12:22:32.222270 3736 request.go:682] Waited for 1.029899611s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/authorization.openshift.io/v1?timeout=32s logger.go:42: 12:22:33 | 1-006_validate_machine_config/1-install | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 12:22:33 | 1-006_validate_machine_config/1-install | Application:openshift-gitops/validate-machine-config created logger.go:42: 12:22:44 | 1-006_validate_machine_config/1-install | test step completed 1-install logger.go:42: 12:22:44 | 1-006_validate_machine_config/2- | starting test step 2- I0224 12:22:46.034981 3736 request.go:682] Waited for 1.029224974s due to client-side throttling, not priority and fairness, request: GET:https://api.nas-psi-414-02.ocp-gitops-qe.com:6443/apis/route.openshift.io/v1?timeout=32s logger.go:42: 12:22:47 | 1-006_validate_machine_config/2- | test step completed 2- logger.go:42: 12:22:47 | 1-006_validate_machine_config/3-scale-down-repo-server | starting test step 3-scale-down-repo-server logger.go:42: 12:22:50 | 1-006_validate_machine_config/3-scale-down-repo-server | ArgoCD:openshift-gitops/openshift-gitops updated logger.go:42: 12:22:51 | 1-006_validate_machine_config/3-scale-down-repo-server | test step completed 3-scale-down-repo-server logger.go:42: 12:22:51 | 1-006_validate_machine_config/99-delete | starting test step 99-delete logger.go:42: 12:22:53 | 1-006_validate_machine_config/99-delete | test step completed 99-delete logger.go:42: 12:22:53 | 1-006_validate_machine_config | skipping kubernetes event logging logger.go:42: 12:22:53 | 1-006_validate_machine_config | Deleting namespace: kuttl-test-pleased-snipe === CONT kuttl harness.go:405: run tests finished harness.go:513: cleaning up harness.go:570: removing temp folder: "" --- FAIL: kuttl (2409.46s) --- FAIL: kuttl/harness (0.00s) --- PASS: kuttl/harness/1-002_validate_backend_service (8.52s) --- FAIL: kuttl/harness/1-078_validate_default_argocd_consoleLink (11.43s) --- PASS: kuttl/harness/1-112_validate_rollout_plugin_support (37.29s) --- PASS: kuttl/harness/1-111_validate_default_argocd_route (25.02s) --- PASS: kuttl/harness/1-110_validate_podsecurity_alerts (8.50s) --- PASS: kuttl/harness/1-109_validate_reencrypt_termination_policy (11.39s) --- PASS: kuttl/harness/1-106_validate_argocd_metrics_controller (14.73s) --- FAIL: kuttl/harness/1-105_validate_label_selector (9.44s) --- FAIL: kuttl/harness/1-104_validate_prometheus_alert (608.53s) --- PASS: kuttl/harness/1-101_validate_rollout_policyrules (12.05s) --- PASS: kuttl/harness/1-084_validate_prune_templates (15.91s) --- PASS: kuttl/harness/1-085_validate_dynamic_plugin_installation (45.88s) --- PASS: kuttl/harness/1-100_validate_rollouts_resources_creation (30.27s) --- PASS: kuttl/harness/1-086_validate_default_argocd_role (45.08s) --- PASS: kuttl/harness/1-083_validate_apps_in_any_namespace (82.70s) --- FAIL: kuttl/harness/1-034_validate_custom_roles (43.84s) --- PASS: kuttl/harness/1-071_validate_node_selectors (17.76s) --- PASS: kuttl/harness/1-064_validate_tcp_reset_error (79.67s) --- FAIL: kuttl/harness/1-056_validate_managed-by (49.46s) --- PASS: kuttl/harness/1-050_validate_sso (197.81s) --- PASS: kuttl/harness/1-042_validate_status_host (59.58s) --- PASS: kuttl/harness/1-041_validate_argocd_sync_alert (8.40s) --- PASS: kuttl/harness/1-040_validate_quoted_RBAC_group_names (16.40s) --- PASS: kuttl/harness/1-037_validate_applicationset_in_any_namespace (81.02s) --- PASS: kuttl/harness/1-036_validate_role_rolebinding_for_source_namespace (35.17s) --- FAIL: kuttl/harness/1-018_validate_disable_default_instance (11.29s) --- FAIL: kuttl/harness/1-035_validate_argocd_secret_repopulate (17.07s) --- PASS: kuttl/harness/1-031_validate_toolchain (13.60s) --- PASS: kuttl/harness/1-028_validate_run_on_infra (29.61s) --- PASS: kuttl/harness/1-005_validate_metrics (8.34s) --- PASS: kuttl/harness/1-027_validate_operand_from_git (75.06s) --- PASS: kuttl/harness/1-026-validate_backend_service_permissions (8.45s) --- PASS: kuttl/harness/1-010_validate-ootb-manage-other-namespace (46.26s) --- PASS: kuttl/harness/1-020_validate_redis_ha_nonha (573.54s) --- PASS: kuttl/harness/1-004_validate_argocd_installation (23.05s) --- FAIL: kuttl/harness/1-003_validate_cluster_config (11.38s) --- PASS: kuttl/harness/1-006_validate_machine_config (28.37s) FAIL ========================== ==== E2E TESTS FAILED ==== ========================== Copying results Deleted temp working directory /kuttl-e2e/gitops-operator/tmp.AnE1RheTnd make: *** [Makefile:4: e2e-tests] Error 1 make: Leaving directory '/kuttl-e2e/gitops-operator' File has been uploaded to CI/z-stream-test-pipeline-nas/250224-110821/sequential_2025.02.24-11.09.14.xml 🚀 File has been uploaded to CI/z-stream-test-pipeline-nas/250224-110821/sequential_2025.02.24-11.09.14.log 🚀 File has been uploaded to CI/z-stream-test-pipeline-nas/250224-110821/parallel_2025.02.24-11.09.14.xml 🚀 File has been uploaded to CI/z-stream-test-pipeline-nas/250224-110821/parallel_2025.02.24-11.09.14.log 🚀 Updating artifacts path to results http://uploader.devtools-gitops--pipeline.svc.cluster.local:8080/CI/z-stream-test-pipeline-nas/250224-110821/1 undefined step-run-argocd-e2e-tests $RUN_ARGOCD_E2E_TESTS is set to false, skipping the execution 0 http://uploader.devtools-gitops--pipeline.svc.cluster.local:8080/CI/z-stream-test-pipeline-nas/250224-110821/ undefined step-evaluate-failed-tasks KuTTL test execution has failed with exit code 1 Visit http://uploader.devtools-gitops--pipeline.svc.cluster.local:8080/CI/z-stream-test-pipeline-nas/250224-110821/ to fetch the results or refer to the run-kuttl-tests task undefined step-send-slack-notification ok