sh run-rollouts-e2e-tests.sh ++ mktemp -d + ROLLOUTS_TMP_DIR=/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.GjZRVhrxcw + cd /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.GjZRVhrxcw + git clone https://github.com/argoproj-labs/argo-rollouts-manager Cloning into 'argo-rollouts-manager'... remote: Enumerating objects: 1456, done. remote: Counting objects: 100% (379/379), done. remote: Compressing objects: 100% (160/160), done. remote: Total 1456 (delta 232), reused 274 (delta 205), pack-reused 1077 (from 1) Receiving objects: 100% (1456/1456), 21.49 MiB | 21.16 MiB/s, done. Resolving deltas: 100% (924/924), done. + cd /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.GjZRVhrxcw/argo-rollouts-manager + TARGET_ROLLOUT_MANAGER_COMMIT=a96aa79b546433ee2d68f48d424baaabed0cb2ac + TARGET_OPENSHIFT_ROUTE_ROLLOUT_PLUGIN_COMMIT=8b4125a7f9ecffb0247df91a4c890f88c0c523b7 + git checkout a96aa79b546433ee2d68f48d424baaabed0cb2ac Note: switching to 'a96aa79b546433ee2d68f48d424baaabed0cb2ac'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at a96aa79 Move controllers back to controllers/ due to gitops-operator + make test-e2e NAMESPACE_SCOPED_ARGO_ROLLOUTS=false hack/run-rollouts-manager-e2e-tests.sh + '[' false == true ']' + go test -v -p=1 -timeout=30m -race -count=1 -coverprofile=coverage.out ./tests/e2e/cluster-scoped === RUN TestClusterScoped Running Suite: Cluster-scoped Suite - /private/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.GjZRVhrxcw/argo-rollouts-manager/tests/e2e/cluster-scoped ============================================================================================================================================================ Random Seed: 1726481071 Will run 16 of 16 specs HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled True 0 2024-09-16 11:04:49 +0100 IST Success } Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-view Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts-metrics Object exists in ExistByName: argo-rollouts-notification-secret Object exists in ExistByName: argo-rollouts Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled True 0 2024-09-16 11:05:29 +0100 IST Success } Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-view Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts-metrics Object exists in ExistByName: argo-rollouts-notification-secret Object exists in ExistByName: argo-rollouts Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled True 0 2024-09-16 11:06:40 +0100 IST Success } Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview HavePhase: expected: Failure actual: Failure HaveCondition: expected: {Reconciled False 0 0001-01-01 00:00:00 +0000 UTC InvalidRolloutManagerScope when Subscription has environment variable NAMESPACE_SCOPED_ARGO_ROLLOUTS set to False, there may not exist any namespace-scoped RolloutManagers: only a single cluster-scoped RolloutManager is supported} actual: {Reconciled False 0 2024-09-16 11:06:54 +0100 IST InvalidRolloutManagerScope when Subscription has environment variable NAMESPACE_SCOPED_ARGO_ROLLOUTS set to False, there may not exist any namespace-scoped RolloutManagers: only a single cluster-scoped RolloutManager is supported} Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview HavePhase: expected: Available actual: Available HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled True 0 2024-09-16 11:06:40 +0100 IST Success } Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled True 0 2024-09-16 11:07:50 +0100 IST Success } Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview HavePhase: expected: Failure actual: Failure HaveCondition: expected: {Reconciled False 0 0001-01-01 00:00:00 +0000 UTC MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} actual: {Reconciled False 0 2024-09-16 11:08:04 +0100 IST MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview HavePhase: expected: Failure actual: Failure HaveCondition: expected: {Reconciled False 0 0001-01-01 00:00:00 +0000 UTC MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} actual: {Reconciled False 0 2024-09-16 11:08:04 +0100 IST MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} Object exists in ExistByName: rollout-bluegreen-active Object exists in ExistByName: rollout-bluegreen-preview •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled True 0 2024-09-16 11:08:55 +0100 IST Success } HavePhase: expected: Failure actual: Failure HaveCondition: expected: {Reconciled False 0 0001-01-01 00:00:00 +0000 UTC MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} actual: {Reconciled False 0 2024-09-16 11:09:12 +0100 IST MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} HaveCondition: expected: {Reconciled False 0 0001-01-01 00:00:00 +0000 UTC MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} actual: {Reconciled False 0 2024-09-16 11:09:12 +0100 IST MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled False 0 2024-09-16 11:09:12 +0100 IST MultipleClusterScopedRolloutManager when there exists a cluster-scoped RolloutManager on the cluster, there may not exist another: only a single cluster-scoped RolloutManager is supported} HaveSuccessCondition: expected: {Reconciled True 0 0001-01-01 00:00:00 +0000 UTC Success } actual: {Reconciled True 0 2024-09-16 11:09:13 +0100 IST Success } •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-view Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts-metrics Object exists in ExistByName: argo-rollouts-notification-secret Object exists in ExistByName: argo-rollouts •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available Object does not exists in ExistByName: argo-rollouts serviceaccounts "argo-rollouts" not found Object does not exists in ExistByName: argo-rollouts clusterroles.rbac.authorization.k8s.io "argo-rollouts" not found Object does not exists in ExistByName: argo-rollouts clusterrolebindings.rbac.authorization.k8s.io "argo-rollouts" not found Object does not exists in ExistByName: argo-rollouts deployments.apps "argo-rollouts" not found Object does not exists in ExistByName: argo-rollouts-metrics services "argo-rollouts-metrics" not found Object does not exists in ExistByName: argo-rollouts-notification-secret secrets "argo-rollouts-notification-secret" not found Object does not exists in ExistByName: argo-rollouts servicemonitors.monitoring.coreos.com "argo-rollouts" not found Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-admin Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-edit Object exists in ExistByName: argo-rollouts-aggregate-to-view Object exists in ExistByName: argo-rollouts-aggregate-to-view Object exists in ExistByName: argo-rollouts-aggregate-to-view Object exists in ExistByName: argo-rollouts-aggregate-to-view Object exists in ExistByName: argo-rollouts-aggregate-to-view •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available Object exists in ExistByName: argo-rollouts •HavePhase: expected: Available actual: HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available Object exists in ExistByName: argo-rollouts •HavePhase: expected: Pending actual: HavePhase: expected: Pending actual: Pending Object exists in ExistByName: argo-rollouts Object exists in ExistByName: argo-rollouts •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available •HavePhase: expected: Available actual: HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available Object exists in ExistByName: argo-rollouts-notification-secret •HavePhase: expected: Available actual: HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available Object does not exists in ExistByName: argo-rollouts-notification-secret secrets "argo-rollouts-notification-secret" not found •HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Pending HavePhase: expected: Available actual: Available Object exists in ExistByName: argo-rollouts-notification-secret Object exists in ExistByName: argo-rollouts-notification-secret • Ran 16 of 16 Specs in 636.523 seconds SUCCESS! -- 16 Passed | 0 Failed | 0 Pending | 0 Skipped --- PASS: TestClusterScoped (636.52s) PASS coverage: [no statements] ok github.com/argoproj-labs/argo-rollouts-manager/tests/e2e/cluster-scoped 638.368s coverage: [no statements] + set +e + '[' -f /tmp/e2e-operator-run.log ']' + kubectl delete rolloutmanagers --all -n test-rom-ns-1 No resources found + cd /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.GjZRVhrxcw/argo-rollouts-manager + SKIP_RUN_STEP=true + hack/run-upstream-argo-rollouts-e2e-tests.sh + set -e + trap cleanup EXIT +++ dirname -- hack/run-upstream-argo-rollouts-e2e-tests.sh ++ cd -- hack ++ pwd + SCRIPT_DIR=/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.GjZRVhrxcw/argo-rollouts-manager/hack ++ mktemp -d + TMP_DIR=/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP + cd /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP + git clone https://github.com/argoproj/argo-rollouts Cloning into 'argo-rollouts'... remote: Enumerating objects: 72824, done. remote: Counting objects: 100% (2718/2718), done. remote: Compressing objects: 100% (679/679), done. remote: Total 72824 (delta 1424), reused 2389 (delta 1171), pack-reused 70106 (from 1) Receiving objects: 100% (72824/72824), 84.14 MiB | 23.34 MiB/s, done. Resolving deltas: 100% (41050/41050), done. + cd argo-rollouts + git checkout v1.7.1 Note: switching to 'v1.7.1'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at 6a99ea990 fix: docs site version selector broken (#3590) + go mod tidy + kubectl delete ns argo-rollouts namespace "argo-rollouts" deleted + kubectl wait --timeout=5m --for=delete namespace/argo-rollouts + kubectl create ns argo-rollouts namespace/argo-rollouts created + kubectl config set-context --current --namespace=argo-rollouts Context "default/api-rosa-qe-415-i1qm-p1-openshiftapps-com:6443/cluster-admin" modified. + cd /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.GjZRVhrxcw/argo-rollouts-manager/hack/.. + '[' -z true ']' + cd /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts + cat + kubectl apply -f /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/rollout-manager.yaml rolloutmanager.argoproj.io/argo-rollout created + echo '* Waiting for Argo Rollouts Deployment to exist' * Waiting for Argo Rollouts Deployment to exist + kubectl get -n argo-rollouts deployment/argo-rollouts NAME READY UP-TO-DATE AVAILABLE AGE argo-rollouts 0/1 1 0 0s + kubectl wait --for=condition=Available --timeout=10m -n argo-rollouts deployment/argo-rollouts deployment.apps/argo-rollouts condition met + kubectl apply -f test/e2e/crds customresourcedefinition.apiextensions.k8s.io/apisixroutes.apisix.apache.org configured customresourcedefinition.apiextensions.k8s.io/wasmplugins.extensions.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/destinationrules.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/envoyfilters.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/gateways.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/proxyconfigs.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/serviceentries.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/sidecars.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/virtualservices.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/workloadentries.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/workloadgroups.networking.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/authorizationpolicies.security.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/peerauthentications.security.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/requestauthentications.security.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/telemetries.telemetry.istio.io unchanged customresourcedefinition.apiextensions.k8s.io/trafficsplits.split.smi-spec.io unchanged + oc adm policy add-scc-to-user anyuid -z argo-rollouts -n argo-rollouts clusterrole.rbac.authorization.k8s.io/system:openshift:scc:anyuid added: "argo-rollouts" + oc adm policy add-scc-to-user anyuid -z default -n argo-rollouts clusterrole.rbac.authorization.k8s.io/system:openshift:scc:anyuid added: "default" + rm -f /tmp/test-e2e.log + set +e + make test-e2e + tee /tmp/test-e2e.log ./hack/installers/install-dev-tools.sh +++ dirname ./hack/installers/install-dev-tools.sh ++ cd ./hack/installers/../.. ++ pwd + PROJECT_ROOT=/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts + DIST_PATH=/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/dist + PATH=/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/dist:/var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/dist:/Library/Frameworks/Python.framework/Versions/3.12/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/usr/local/munki:/Applications/iTerm.app/Contents/Resources/utilities + mkdir -p /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/dist + gotestsum_version=1.10.1 ++ go env GOOS + OS=darwin ++ go env GOARCH + ARCH=arm64 + export TARGET_FILE=gotestsum_1.10.1_darwin_arm64.tar.gz + TARGET_FILE=gotestsum_1.10.1_darwin_arm64.tar.gz + temp_path=/tmp/gotestsum_1.10.1_darwin_arm64.tar.gz + url=https://github.com/gotestyourself/gotestsum/releases/download/v1.10.1/gotestsum_1.10.1_darwin_arm64.tar.gz + '[' -e /tmp/gotestsum_1.10.1_darwin_arm64.tar.gz ']' + curl -sLf --retry 3 -o /tmp/gotestsum_1.10.1_darwin_arm64.tar.gz https://github.com/gotestyourself/gotestsum/releases/download/v1.10.1/gotestsum_1.10.1_darwin_arm64.tar.gz + mkdir -p /tmp/gotestsum-1.10.1 + tar -xvzf /tmp/gotestsum_1.10.1_darwin_arm64.tar.gz -C /tmp/gotestsum-1.10.1 x LICENSE x LICENSE.md x README.md x gotestsum + cp /tmp/gotestsum-1.10.1/gotestsum /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/dist/gotestsum + chmod +x /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/dist/gotestsum + gotestsum --version gotestsum version 1.10.1 /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/dist/gotestsum --rerun-fails-report=rerunreport.txt --junitfile=junit.xml --format=testname --packages="./test/e2e" --rerun-fails=5 -- -timeout 60m -count 1 --tags e2e -p 1 -parallel 1 -v --short ./test/e2e PASS test/e2e.TestAnalysisSuite/TestAnalysisWithArgs (44.89s) PASS test/e2e.TestAnalysisSuite/TestAnalysisWithSecret (34.99s) PASS test/e2e.TestAnalysisSuite/TestBackgroundAnalysisWithArgs (33.97s) PASS test/e2e.TestAnalysisSuite/TestBlueGreenAbortAndUpdate (26.04s) PASS test/e2e.TestAnalysisSuite/TestBlueGreenAnalysis (34.82s) PASS test/e2e.TestAnalysisSuite/TestBlueGreenKitchenSink (48.14s) PASS test/e2e.TestAnalysisSuite/TestBlueGreenPostPromotionFail (20.60s) PASS test/e2e.TestAnalysisSuite/TestBlueGreenPrePromotionFail (29.12s) PASS test/e2e.TestAnalysisSuite/TestCanaryBackgroundAnalysis (8.79s) PASS test/e2e.TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis (14.53s) PASS test/e2e.TestAnalysisSuite/TestCanaryInlineAnalysis (18.98s) PASS test/e2e.TestAnalysisSuite/TestCanaryInlineMultipleAnalysis (21.19s) PASS test/e2e.TestAnalysisSuite/TestMultipleAnalysis (10.83s) PASS test/e2e.TestAnalysisSuite (353.80s) === RUN TestAPISIXSuite/TestAPISIXCanarySetHeaderStep time="2024-09-16T11:23:51+01:00" level=info msg="Deleting e2e-test-name=TestAPISIXCanarySetHeaderStep" time="2024-09-16T11:23:55+01:00" level=info msg="service/rollout-apisix-canary-canary created\n" rollout=rollout-apisix-canary time="2024-09-16T11:23:56+01:00" level=info msg="service/rollout-apisix-canary-stable created\n" rollout=rollout-apisix-canary time="2024-09-16T11:23:56+01:00" level=info msg="apisixroute.apisix.apache.org/rollouts-apisix-route created\n" rollout=rollout-apisix-canary time="2024-09-16T11:23:57+01:00" level=info msg="rollout.argoproj.io/rollout-apisix-canary unchanged\n" rollout=rollout-apisix-canary time="2024-09-16T11:23:57+01:00" level=info msg="Waiting for condition: status=Healthy" rollout=rollout-apisix-canary when.go:423: rollouts.argoproj.io "rollout-apisix-canary" not found time="2024-09-16T11:23:58+01:00" level=info msg="Deleting e2e-test-name=TestAPISIXCanarySetHeaderStep" --- FAIL: TestAPISIXSuite/TestAPISIXCanarySetHeaderStep (9.37s) FAIL test/e2e.TestAPISIXSuite/TestAPISIXCanarySetHeaderStep (9.37s) PASS test/e2e.TestAPISIXSuite/TestAPISIXCanaryStep (32.69s) === RUN TestAPISIXSuite --- FAIL: TestAPISIXSuite (45.04s) FAIL test/e2e.TestAPISIXSuite (45.04s) PASS test/e2e.TestAWSSuite/TestALBExperimentStep (23.57s) PASS test/e2e.TestAWSSuite/TestALBExperimentStepMultiIngress (26.38s) PASS test/e2e.TestAWSSuite/TestALBExperimentStepNoSetWeight (25.26s) PASS test/e2e.TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (26.12s) PASS test/e2e.TestAWSSuite/TestALBMesh_PingPong_StableCanary_Update (22.91s) PASS test/e2e.TestAWSSuite/TestALBPingPongUpdate (19.68s) PASS test/e2e.TestAWSSuite/TestALBPingPongUpdateMultiIngress (22.14s) PASS test/e2e.TestAWSSuite/TestAlbHeaderRoute (16.84s) PASS test/e2e.TestAWSSuite/TestAlbHeaderRouteMultiIngress (30.90s) PASS test/e2e.TestAWSSuite (231.91s) PASS test/e2e.TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount (12.39s) PASS test/e2e.TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause (68.92s) PASS test/e2e.TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause (68.31s) PASS test/e2e.TestBlueGreenSuite/TestEphemeralMetadata (16.24s) PASS test/e2e.TestBlueGreenSuite (168.79s) PASS test/e2e.TestCanarySuite/TestCanaryDynamicStableScale (32.97s) PASS test/e2e.TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable (24.93s) PASS test/e2e.TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause (128.64s) PASS test/e2e.TestCanarySuite/TestCanaryScaleDownDelay (17.29s) PASS test/e2e.TestCanarySuite/TestCanaryScaleDownDelayWithProgressDeadline (22.31s) PASS test/e2e.TestCanarySuite/TestCanaryScaleDownOnAbort (15.65s) PASS test/e2e.TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting (15.02s) PASS test/e2e.TestCanarySuite/TestCanaryUnScaleDownOnAbort (15.70s) PASS test/e2e.TestCanarySuite/TestCanaryWithPausedRollout (106.30s) PASS test/e2e.TestCanarySuite/TestEphemeralMetadata (14.07s) PASS test/e2e.TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable (33.51s) PASS test/e2e.TestCanarySuite/TestRolloutScalingDuringUpdate (9.54s) PASS test/e2e.TestCanarySuite/TestRolloutScalingWhenPaused (10.97s) === RUN TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate time="2024-09-16T11:38:48+01:00" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate" time="2024-09-16T11:38:51+01:00" level=info msg="rollout.argoproj.io/updatescaling created\n" rollout=updatescaling time="2024-09-16T11:38:51+01:00" level=info msg="Waiting for condition: status=Healthy" rollout=updatescaling time="2024-09-16T11:38:53+01:00" level=info msg="Condition 'status=Healthy' met after 1s" rollout=updatescaling W0916 11:38:53.384680 89633 warnings.go:70] unknown field "spec.template.metadata.creationTimestamp" time="2024-09-16T11:38:53+01:00" level=info msg="Patched rollout: {\"spec\":{\"template\":{\"spec\":{\"containers\":[{\"name\":\"updatescaling\",\"resources\":{\"requests\":{\"cpu\":\"2m\",\"memory\":\"16Mi\"}}}]}}}}" rollout=updatescaling time="2024-09-16T11:38:53+01:00" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling time="2024-09-16T11:38:53+01:00" level=info msg="Condition 'status.replicas=7' met after 0s" rollout=updatescaling time="2024-09-16T11:38:54+01:00" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling time="2024-09-16T11:38:54+01:00" level=warning msg="unexpected stable (hash 54d546d75c) pod count: expected 3, saw: 2" rollout=updatescaling time="2024-09-16T11:38:54+01:00" level=error msg="Pod expectation 'stable pod count == 3' failed" rollout=updatescaling Name: updatescaling Namespace: argo-rollouts Status: ◌ Progressing Message: updated replicas are still becoming available Strategy: Canary Step: SetWeight: 100 ActualWeight: 100 Images: nginx:1.19-alpine (canary, stable) Replicas: Desired: 4 Current: 5 Updated: 4 Ready: 3 Available: 3 NAME KIND STATUS AGE INFO ⟳ updatescaling Rollout ◌ Progressing 3s ├──# revision:2 │ └──⧉ updatescaling-79b6b5f5d4 ReplicaSet ◌ Progressing 1s canary │ ├──□ updatescaling-79b6b5f5d4-57f57 Pod ◌ ContainerCreating 1s ready:0/1 │ ├──□ updatescaling-79b6b5f5d4-5gj8n Pod ✔ Running 1s ready:1/1 │ ├──□ updatescaling-79b6b5f5d4-jzkf8 Pod ✔ Running 1s ready:1/1 │ └──□ updatescaling-79b6b5f5d4-ps8nt Pod ◌ ContainerCreating 1s ready:0/1 └──# revision:1 └──⧉ updatescaling-54d546d75c ReplicaSet ✔ Healthy 3s stable ├──□ updatescaling-54d546d75c-7kflw Pod ◌ Terminating 3s ready:1/1 ├──□ updatescaling-54d546d75c-d2tv6 Pod ✔ Running 3s ready:1/1 ├──□ updatescaling-54d546d75c-fq6s5 Pod ◌ Terminating 3s ready:1/1 └──□ updatescaling-54d546d75c-l5m9g Pod ◌ Terminating 3s ready:1/1 --- apiVersion: argoproj.io/v1alpha1 kind: Rollout metadata: annotations: rollout.argoproj.io/revision: "2" creationTimestamp: "2024-09-16T10:38:51Z" generation: 2 labels: argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e e2e-test-name: TestRolloutWithMaxSurgeScalingDuringUpdate name: updatescaling namespace: argo-rollouts resourceVersion: "31077655" uid: c61b70f6-a527-4777-912f-8ff01046edde spec: replicas: 4 selector: matchLabels: app: updatescaling strategy: canary: maxSurge: 100% template: metadata: creationTimestamp: null labels: app: updatescaling spec: containers: - image: nginx:1.19-alpine name: updatescaling resources: requests: cpu: 2m memory: 16Mi status: HPAReplicas: 5 availableReplicas: 3 blueGreen: {} canary: {} conditions: - lastTransitionTime: "2024-09-16T10:38:53Z" lastUpdateTime: "2024-09-16T10:38:53Z" message: Rollout is not healthy reason: RolloutHealthy status: "False" type: Healthy - lastTransitionTime: "2024-09-16T10:38:53Z" lastUpdateTime: "2024-09-16T10:38:53Z" message: RolloutCompleted reason: RolloutCompleted status: "False" type: Completed - lastTransitionTime: "2024-09-16T10:38:51Z" lastUpdateTime: "2024-09-16T10:38:54Z" message: ReplicaSet "updatescaling-79b6b5f5d4" is progressing. reason: ReplicaSetUpdated status: "True" type: Progressing - lastTransitionTime: "2024-09-16T10:38:54Z" lastUpdateTime: "2024-09-16T10:38:54Z" message: Rollout does not have minimum availability reason: AvailableReason status: "False" type: Available currentPodHash: 79b6b5f5d4 currentStepHash: 5ffbfbbd64 message: updated replicas are still becoming available observedGeneration: "2" phase: Progressing readyReplicas: 3 replicas: 5 selector: app=updatescaling stableRS: 54d546d75c updatedReplicas: 4 2024-09-16T11:38:51+01:00 Normal RolloutAddedToInformer Rollout resource added to informer: argo-rollouts/updatescaling 2024-09-16T11:38:51+01:00 Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (54d546d75c) 2024-09-16T11:38:51+01:00 Normal RolloutUpdated Rollout updated to revision 1 2024-09-16T11:38:51+01:00 Normal NewReplicaSetCreated Created ReplicaSet updatescaling-54d546d75c (revision 1) 2024-09-16T11:38:51+01:00 Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-54d546d75c (revision 1) from 0 to 4 2024-09-16T11:38:51+01:00 Normal RolloutCompleted Rollout completed update to revision 1 (54d546d75c): Initial deploy 2024-09-16T11:38:53+01:00 Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (79b6b5f5d4) 2024-09-16T11:38:53+01:00 Normal RolloutUpdated Rollout updated to revision 2 2024-09-16T11:38:53+01:00 Normal NewReplicaSetCreated Created ReplicaSet updatescaling-79b6b5f5d4 (revision 2) 2024-09-16T11:38:53+01:00 Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 4 to 3 2024-09-16T11:38:53+01:00 Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 0 to 4 2024-09-16T11:38:53+01:00 Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 3 to 2 2024-09-16T11:38:54+01:00 Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 2 to 1 time="2024-09-16T11:38:54+01:00" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate" time="2024-09-16T11:38:57+01:00" level=info msg="Deleting e2e-test-name" --- FAIL: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (9.00s) FAIL test/e2e.TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (9.00s) PASS test/e2e.TestCanarySuite/TestCanarySetCanaryScale (17.67s) === RUN TestCanarySuite time="2024-09-16T11:31:18+01:00" level=info msg="analysistemplate.argoproj.io/sleep-job created\n" --- FAIL: TestCanarySuite (462.33s) FAIL test/e2e.TestCanarySuite (462.33s) === RUN TestExperimentSuite/TestExperimentWithDryRunMetrics time="2024-09-16T11:39:15+01:00" level=info msg="Deleting e2e-test-name=TestExperimentWithDryRunMetrics" time="2024-09-16T11:39:18+01:00" level=info msg="analysistemplate.argoproj.io/dry-run-job created\n" time="2024-09-16T11:39:19+01:00" level=info msg="experiment.argoproj.io/experiment-with-dry-run created\n" time="2024-09-16T11:39:19+01:00" level=info msg="Waiting for Experiment experiment-with-dry-run condition: phase=Successful" time="2024-09-16T11:39:50+01:00" level=info msg="Condition 'phase=Successful' met after 30s" time="2024-09-16T11:39:50+01:00" level=info msg="Sleeping 3s" time="2024-09-16T11:39:53+01:00" level=info msg="Expected Dry-Run Summary: Count=1, Successful=0, Failed=1, Error=0, Inconclusive=0" time="2024-09-16T11:39:53+01:00" level=info msg="Analysis Dry-Run Summary: Count=1, Successful=1, Failed=0, Error=0, Inconclusive=0" time="2024-09-16T11:39:53+01:00" level=error msg="Dry-Run Summary of AnalysisRun: 'experiment-with-dry-run-dry-run-job' doesn't match the expectations" Name: experiment-with-dry-run Namespace: argo-rollouts Status: ✔ Successful Images: nginx:1.19-alpine (Σ:baseline) NAME KIND STATUS AGE INFO Σ experiment-with-dry-run Experiment ✔ Successful 34s ├──⧉ experiment-with-dry-run-baseline ReplicaSet ✔ Healthy 34s delay:26s │ └──□ experiment-with-dry-run-baseline-vclfk Pod ✔ Running 34s ready:1/1 └──α experiment-with-dry-run-dry-run-job AnalysisRun ✔ Successful 33s ✔ 1 └──⊞ c0366712-17d4-41b3-bd14-2f8d7d250bb9.test-1.1 Job ✔ Successful 33s --- apiVersion: argoproj.io/v1alpha1 kind: Experiment metadata: creationTimestamp: "2024-09-16T10:39:19Z" generation: 9 labels: argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e e2e-test-name: TestExperimentWithDryRunMetrics name: experiment-with-dry-run namespace: argo-rollouts resourceVersion: "31078885" uid: 08077dd7-f77e-4f1a-83fe-4c093b69f7c5 spec: analyses: - name: dry-run-job templateName: dry-run-job analysisRunMetadata: {} dryRun: - metricName: test.* duration: 30s progressDeadlineSeconds: 30 templates: - name: baseline replicas: 1 selector: matchLabels: app: experiment-with-dry-run service: {} template: metadata: creationTimestamp: null labels: app: experiment-with-dry-run spec: containers: - image: nginx:1.19-alpine name: experiment-with-dry-run resources: requests: cpu: 1m memory: 16Mi status: analysisRuns: - analysisRun: experiment-with-dry-run-dry-run-job name: dry-run-job phase: Running availableAt: "2024-09-16T10:39:20Z" conditions: - lastTransitionTime: "2024-09-16T10:39:50Z" lastUpdateTime: "2024-09-16T10:39:50Z" message: Experiment "experiment-with-dry-run" has successfully ran and completed. reason: ExperimentCompleted status: "False" type: Progressing phase: Successful templateStatuses: - availableReplicas: 1 lastTransitionTime: "2024-09-16T10:39:50Z" name: baseline readyReplicas: 1 replicas: 1 status: Successful updatedReplicas: 1 2024-09-16T11:39:19+01:00 Normal TemplateProgressing Template 'baseline' transitioned from -> Progressing 2024-09-16T11:39:19+01:00 Normal ExperimentPending Experiment transitioned from -> Pending 2024-09-16T11:39:19+01:00 Normal ScalingReplicaSet Scaled up ReplicaSet experiment-with-dry-run-baseline from 0 to 1 2024-09-16T11:39:20+01:00 Normal TemplateRunning Template 'baseline' transitioned from Progressing -> Running 2024-09-16T11:39:20+01:00 Normal ExperimentRunning Experiment transitioned from Pending -> Running 2024-09-16T11:39:20+01:00 Normal AnalysisRunPending AnalysisRun 'dry-run-job' transitioned from -> Pending 2024-09-16T11:39:20+01:00 Normal AnalysisRunRunning AnalysisRun 'dry-run-job' transitioned from -> Running 2024-09-16T11:39:50+01:00 Normal TemplateSuccessful Template 'baseline' transitioned from Running -> Successful 2024-09-16T11:39:50+01:00 Normal ExperimentSuccessful Experiment transitioned from Running -> Successful 2024-09-16T11:39:50+01:00 Normal AnalysisRunTerminating Terminating dry-run-job (experiment-with-dry-run-dry-run-job) time="2024-09-16T11:39:53+01:00" level=info msg="Deleting e2e-test-name=TestExperimentWithDryRunMetrics" --- FAIL: TestExperimentSuite/TestExperimentWithDryRunMetrics (41.16s) FAIL test/e2e.TestExperimentSuite/TestExperimentWithDryRunMetrics (41.16s) PASS test/e2e.TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics (40.55s) PASS test/e2e.TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay (22.24s) PASS test/e2e.TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay (21.96s) PASS test/e2e.TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay (23.01s) PASS test/e2e.TestExperimentSuite/TestRolloutWithExperimentAndAnalysis (14.01s) === RUN TestExperimentSuite --- FAIL: TestExperimentSuite (154.35s) FAIL test/e2e.TestExperimentSuite (154.35s) PASS test/e2e.TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort (15.69s) PASS test/e2e.TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull (12.63s) PASS test/e2e.TestFunctionalSuite/TestBlueGreenPromoteFull (14.66s) PASS test/e2e.TestFunctionalSuite/TestBlueGreenScaleDownDelay (16.25s) PASS test/e2e.TestFunctionalSuite/TestBlueGreenScaleDownOnAbort (15.05s) PASS test/e2e.TestFunctionalSuite/TestBlueGreenToCanary (10.39s) PASS test/e2e.TestFunctionalSuite/TestBlueGreenUpdate (10.96s) PASS test/e2e.TestFunctionalSuite/TestCanaryPromoteFull (16.61s) PASS test/e2e.TestFunctionalSuite/TestCompleteRolloutRestart (26.00s) PASS test/e2e.TestFunctionalSuite/TestContainerResourceFormats (7.00s) === RUN TestFunctionalSuite/TestControllerMetrics time="2024-09-16T11:44:27+01:00" level=info msg="Deleting e2e-test-name=TestControllerMetrics" functional_test.go:1407: Error Trace: /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/test/e2e/functional_test.go:1407 Error: Received unexpected error: Get "http://localhost:8090/metrics": dial tcp [::1]:8090: connect: connection refused Test: TestFunctionalSuite/TestControllerMetrics time="2024-09-16T11:44:30+01:00" level=info msg="Deleting e2e-test-name=TestControllerMetrics" panic.go:261: test panicked: runtime error: invalid memory address or nil pointer dereference goroutine 6145 [running]: runtime/debug.Stack() /opt/homebrew/Cellar/go/1.22.1/libexec/src/runtime/debug/stack.go:24 +0x64 github.com/stretchr/testify/suite.failOnPanic(0x140009e1860, {0x107167900, 0x108d3da80}) /Users/trdoyle/go/pkg/mod/github.com/stretchr/testify@v1.9.0/suite/suite.go:89 +0x38 github.com/stretchr/testify/suite.Run.func1.1() /Users/trdoyle/go/pkg/mod/github.com/stretchr/testify@v1.9.0/suite/suite.go:188 +0x230 panic({0x107167900?, 0x108d3da80?}) /opt/homebrew/Cellar/go/1.22.1/libexec/src/runtime/panic.go:770 +0x124 github.com/argoproj/argo-rollouts/test/e2e.(*FunctionalSuite).TestControllerMetrics(0x14000a26300) /var/folders/5x/bbpqxxbn50d013cwldtj8hbm0000gn/T/tmp.TuBvoAs6FP/argo-rollouts/test/e2e/functional_test.go:1408 +0xc0 reflect.Value.call({0x1400158ab00?, 0x140001b4d58?, 0x0?}, {0x106687c72, 0x4}, {0x14001661f20, 0x1, 0x10521d864?}) /opt/homebrew/Cellar/go/1.22.1/libexec/src/reflect/value.go:596 +0x980 reflect.Value.Call({0x1400158ab00?, 0x140001b4d58?, 0x604?}, {0x14001661f20?, 0x10489f610?, 0x1084dab40?}) /opt/homebrew/Cellar/go/1.22.1/libexec/src/reflect/value.go:380 +0x94 github.com/stretchr/testify/suite.Run.func1(0x140009e1860) /Users/trdoyle/go/pkg/mod/github.com/stretchr/testify@v1.9.0/suite/suite.go:202 +0x3a0 testing.tRunner(0x140009e1860, 0x14000f22990) /opt/homebrew/Cellar/go/1.22.1/libexec/src/testing/testing.go:1689 +0xec created by testing.(*T).Run in goroutine 5315 /opt/homebrew/Cellar/go/1.22.1/libexec/src/testing/testing.go:1742 +0x318 --- FAIL: TestFunctionalSuite/TestControllerMetrics (5.21s) FAIL test/e2e.TestFunctionalSuite/TestControllerMetrics (5.21s) PASS test/e2e.TestFunctionalSuite/TestFixInvalidSpec (26.16s) PASS test/e2e.TestFunctionalSuite/TestKubectlWaitForCompleted (28.51s) PASS test/e2e.TestFunctionalSuite/TestKubectlWaitForPaused (12.22s) PASS test/e2e.TestFunctionalSuite/TestMalformedRollout (8.12s) PASS test/e2e.TestFunctionalSuite/TestMalformedRolloutEphemeralCtr (6.93s) PASS test/e2e.TestFunctionalSuite/TestNeverScaleDown (9.28s) PASS test/e2e.TestFunctionalSuite/TestRolloutAbortRetryPromote (12.47s) PASS test/e2e.TestFunctionalSuite/TestRolloutBadToBadUpdate (27.91s) PASS test/e2e.TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate (26.06s) PASS test/e2e.TestFunctionalSuite/TestRolloutBadToGoodUpdate (21.09s) PASS test/e2e.TestFunctionalSuite/TestRolloutGoodToBadUpdate (30.09s) PASS test/e2e.TestFunctionalSuite/TestRolloutPDBRestart (52.39s) PASS test/e2e.TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds (39.59s) PASS test/e2e.TestFunctionalSuite/TestRolloutPodVolumesItemsSpec (13.04s) PASS test/e2e.TestFunctionalSuite/TestRolloutRestart (22.53s) PASS test/e2e.TestFunctionalSuite/TestScaleDownOnSuccess (10.00s) PASS test/e2e.TestFunctionalSuite/TestScaleDownProgressively (8.75s) PASS test/e2e.TestFunctionalSuite/TestWorkloadRef (21.74s) PASS test/e2e.TestFunctionalSuite/TestWorkloadRefTemplate (7.14s) === RUN TestFunctionalSuite time="2024-09-16T11:42:02+01:00" level=info msg="analysistemplate.argoproj.io/sleep-job created\n" --- FAIL: TestFunctionalSuite (538.29s) FAIL test/e2e.TestFunctionalSuite (538.29s) PASS test/e2e.TestHeaderRoutingSuite/TestIstioHostHeaderRoute (19.67s) PASS test/e2e.TestHeaderRoutingSuite (22.60s) PASS test/e2e.TestIstioSuite/TestIstioAbortUpdate (12.73s) PASS test/e2e.TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods (14.33s) PASS test/e2e.TestIstioSuite/TestIstioHostSplit (28.95s) PASS test/e2e.TestIstioSuite/TestIstioHostSplitExperimentStep (27.27s) PASS test/e2e.TestIstioSuite/TestIstioHostSplitOnlyTls (16.81s) PASS test/e2e.TestIstioSuite/TestIstioPingPongUpdate (17.80s) PASS test/e2e.TestIstioSuite/TestIstioSubsetSplit (16.99s) PASS test/e2e.TestIstioSuite/TestIstioSubsetSplitExperimentStep (27.32s) PASS test/e2e.TestIstioSuite/TestIstioSubsetSplitInStableDownscaleAfterCanaryAbort (14.27s) PASS test/e2e.TestIstioSuite/TestIstioSubsetSplitSingleRoute (15.18s) PASS test/e2e.TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas (12.90s) PASS test/e2e.TestIstioSuite (207.68s) PASS test/e2e.TestMirrorRouteSuite/TestIstioHostMirrorRoute (18.94s) PASS test/e2e.TestMirrorRouteSuite (21.87s) PASS test/e2e.TestRollbackSuite/TestRollbackAnalysisOutsideWindow (34.21s) PASS test/e2e.TestRollbackSuite/TestRollbackAnalysisWithinWindow (24.88s) PASS test/e2e.TestRollbackSuite (63.81s) FAIL test/e2e DONE 111 tests, 6 skipped, 8 failures in 2427.556s