❯ oc whoami --show-console https://console-openshift-console.apps.anahas421full.qe.devcluster.openshift.com ❯ make test-e2e GOBIN=/Users/anahas/Github/forks/kueue-operator/kueue-operator/bin GO111MODULE=on go install -mod=mod github.com/onsi/ginkgo/v2/ginkgo@v2.1.4 /Users/anahas/Github/forks/kueue-operator/kueue-operator/bin/ginkgo --keep-going --flake-attempts=1 --label-filter="operator" -v ./test/e2e/... Starting kueue operator suite Running Suite: e2e suite - /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e ============================================================================================ Random Seed: 1772043705 Will run 20 of 53 specs ------------------------------ [BeforeSuite] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_suite_test.go:68 STEP: Deploying Kueue operand for all test suites @ 02/25/26 15:21:51.813 I0225 15:21:51.814163 60722 e2e_operator_test.go:1648] Creating Kueue instance I0225 15:21:52.837793 60722 e2e_operator_test.go:1671] Checking pod: kueue-controller-manager-694cb9c4d7-dxdn6, phase: Running, deletionTS: STEP: Waiting for all Kueue CRDs to be registered @ 02/25/26 15:21:52.837 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:21:57.06I0225 15:21:57.060615 60722 e2e_operator_test.go:1739] All 9 Kueue CRDs are registered and established I0225 15:21:57.481840 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-gftdh I0225 15:21:57.670215 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:22:01.034367 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-dgtrk I0225 15:22:01.218389 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:22:04.578547 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-4wz5m I0225 15:22:04.773906 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes [BeforeSuite] PASSED [12.970 seconds] ------------------------------ SSSSSSSSSSSSSSSS ------------------------------ Kueue Operator when installs operator pods should be ready [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:90 I0225 15:22:05.271980 60722 e2e_operator_test.go:102] Checking pod: openshift-kueue-operator-66fcdbb7c5-dqk2d, phase: Running, deletionTS: • [0.497 seconds] ------------------------------ Kueue Operator when installs kueue pods should be ready [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:110 • [0.186 seconds]I0225 15:22:05.458286 60722 e2e_operator_test.go:122] Checking pod: kueue-controller-manager-694cb9c4d7-dxdn6, phase: Running, deletionTS: ------------------------------ Kueue Operator when installs should set ReadyReplicas in operator status and handle degraded condition [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:137 • [0.352 seconds] ------------------------------ Kueue Operator when installs kueue operator deployment should contain priority class [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:173 • [0.183 seconds] ------------------------------ Kueue Operator when installs kueue deployment should contain priority class and have no resource limits set [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:187 • [0.177 seconds] ------------------------------ Kueue Operator when installs Verifying that no v1alpha Kueue CRDs are installed [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:205 • [1.918 seconds] ------------------------------ Kueue Operator when installs verify webhook readiness [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:239 • [0.681 seconds] ------------------------------ Kueue Operator when installs verify that deny-all network policy is present [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:309 • [0.560 seconds] ------------------------------ Kueue Operator when installs verify kueue-config-map is updated with operators configuration [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:361 STEP: check if JobSet is present @ 02/25/26 15:22:09.331 STEP: check if LeaderWorkerSet is present @ 02/25/26 15:22:09.501 • [0.334 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should suspend jobs only in labeled namespaces when labelPolicy=None [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:486 STEP: Creating LocalQueue test-queue in namespace kueue-managed-test @ 02/25/26 15:22:10.166 STEP: Feching Kueue Instance @ 02/25/26 15:22:12.377 STEP: Updating Kueue config @ 02/25/26 15:22:12.71 STEP: Waiting for kueue-controller-manager resource version to change from 57743 @ 02/25/26 15:22:12.889 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:22:23.54 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:22:33.894 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:22:33.894 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:22:34.266 I0225 15:22:34.653878 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-47rh2 I0225 15:22:34.841512 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:22:38.215579 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-mx462 I0225 15:22:38.393655 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:22:41.741070 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-tst45 STEP: creating job in labeled namespace @ 02/25/26 15:22:41.918 I0225 15:22:41.918902 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: creating job in unlabeled namespace @ 02/25/26 15:22:52.619 STEP: Feching Kueue Instance @ 02/25/26 15:22:52.958 STEP: Updating Kueue config @ 02/25/26 15:22:53.456 STEP: Waiting for kueue-controller-manager resource version to change from 60995 @ 02/25/26 15:22:53.635 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:23:04.307 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:23:14.631 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:23:14.631 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:23:14.951 I0225 15:23:15.309683 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-bgtwt I0225 15:23:15.477597 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:23:18.833914 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-x2qf2 I0225 15:23:19.013343 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:23:22.366279 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-wps2d I0225 15:23:22.542215 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Destroying job test-job-p4wbm @ 02/25/26 15:23:22.542 STEP: Destroying job test-job-v8lvm @ 02/25/26 15:23:22.877 • [73.564 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should manage jobs only in labeled namespaces [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:533 STEP: creating job in labeled namespace @ 02/25/26 15:23:23.703 STEP: verifying workload created in namespace kueue-managed-test and uid 39d881bc-8421-4722-89dd-a929ef0e277a @ 02/25/26 15:23:23.898 STEP: creating job in labeled namespace not managed by Kueue @ 02/25/26 15:23:24.222 STEP: creating job in unlabeled namespace @ 02/25/26 15:23:24.572 STEP: Destroying job test-job-xxvvm @ 02/25/26 15:23:24.918 STEP: Destroying job test-job-59k7n @ 02/25/26 15:23:25.257 STEP: Destroying job test-job-c6hq8 @ 02/25/26 15:23:25.597 • [2.711 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should manage pods only in labeled namespaces [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:573 STEP: creating pod in labeled namespace @ 02/25/26 15:23:26.271 STEP: verifying workload created in namespace kueue-managed-test and uid 90dc9e89-979c-41f1-8948-2abb19e9f033 @ 02/25/26 15:23:26.471 STEP: creating pod in labeled namespace not managed by Kueue @ 02/25/26 15:23:26.807 STEP: creating pod in unlabeled namespace @ 02/25/26 15:23:37.968 STEP: Destroying Object test-pod-vcbnj @ 02/25/26 15:23:48.486 STEP: Destroying Object test-pod-jqm4h @ 02/25/26 15:24:21.14 STEP: Destroying Object test-pod-x2xkk @ 02/25/26 15:24:52.693 • [118.484 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should manage deployments only in labeled namespaces [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:613 STEP: creating deployment in labeled namespace @ 02/25/26 15:25:24.906 STEP: verifying workload created in namespace kueue-managed-test and uid 080dc9b6-92f5-4844-98c1-86a8b8e5a3fc @ 02/25/26 15:25:25.285 STEP: verifying deployment pods are available @ 02/25/26 15:25:25.625 STEP: creating deployment in labeled namespace not managed by Kueue @ 02/25/26 15:25:35.958 STEP: creating deployment in unlabeled namespace @ 02/25/26 15:25:46.492 STEP: Destroying Object test-deploy-d7knl @ 02/25/26 15:25:57.023 STEP: Destroying Object test-deploy-wqxqn @ 02/25/26 15:25:57.542 STEP: Destroying Object test-deploy-h727r @ 02/25/26 15:25:58.035 • [34.124 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should manage statefulsets only in labeled namespaces [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:669 STEP: creating statefulset in labeled namespace @ 02/25/26 15:25:59.041 STEP: verifying workload created in namespace kueue-managed-test and uid 2339a598-e8be-49b4-a629-0e200d484f41 @ 02/25/26 15:25:59.411 STEP: verifying statefulset pods are running @ 02/25/26 15:25:59.951 STEP: creating statefulset in labeled namespace not managed by Kueue @ 02/25/26 15:26:10.312 STEP: creating statefulset in unlabeled namespace @ 02/25/26 15:26:20.833 STEP: Destroying Object test-ss-6brgz @ 02/25/26 15:26:31.344 STEP: Destroying Object test-ss-pjhmm @ 02/25/26 15:26:31.868 STEP: Destroying Workload statefulset--d7705 @ 02/25/26 15:26:32.365 STEP: Destroying Object test-ss-5dvvh @ 02/25/26 15:26:32.712 • [34.675 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should suspend jobsets only in labeled namespaces when labelPolicy=None [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:728 STEP: Updating Kueue configuration with labelPolicy=None @ 02/25/26 15:26:33.217 STEP: Feching Kueue Instance @ 02/25/26 15:26:33.377 STEP: Updating Kueue config @ 02/25/26 15:26:33.904 STEP: Waiting for kueue-controller-manager resource version to change from 61427 @ 02/25/26 15:26:34.073 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:26:44.762 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:26:55.092 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:26:55.092 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:26:55.473 I0225 15:26:55.860149 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-q5cfx I0225 15:26:56.029778 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:26:59.391814 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-45b89 I0225 15:26:59.558535 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:27:02.924899 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-b78ww I0225 15:27:03.107278 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: creating jobset in unlabeled namespace @ 02/25/26 15:27:03.107 STEP: verifying jobset did start in unlabeled namespace @ 02/25/26 15:27:03.309 STEP: creating jobset in labeled namespace @ 02/25/26 15:27:03.481 STEP: verifying workload is created @ 02/25/26 15:27:03.663 STEP: verifying jobset did not start in labeled namespace @ 02/25/26 15:27:03.827 STEP: Feching Kueue Instance @ 02/25/26 15:27:04 STEP: Updating Kueue config @ 02/25/26 15:27:04.536 STEP: Waiting for kueue-controller-manager resource version to change from 63073 @ 02/25/26 15:27:04.716 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:27:15.679 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:27:26.044 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:27:26.044 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:27:26.722 I0225 15:27:27.090910 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-kj9db I0225 15:27:27.266848 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:27:30.639876 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-7phcq I0225 15:27:30.814807 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:27:34.170803 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-kt7f6 STEP: Destroying Object test-jobset-4rn95 @ 02/25/26 15:27:34.334 I0225 15:27:34.334781 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Destroying Object test-jobset-p5d9q @ 02/25/26 15:27:34.822 • [62.110 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should manage LeaderWorkerSet without queue name in labeled namespace when labelPolicy=None [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:784 STEP: Feching Kueue Instance @ 02/25/26 15:27:35.488 STEP: Updating Kueue config @ 02/25/26 15:27:35.979 STEP: Waiting for kueue-controller-manager resource version to change from 63467 @ 02/25/26 15:27:36.163 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:27:47.161 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:27:57.651 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:27:57.651 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:27:58.059 I0225 15:27:58.465754 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-cmgmn I0225 15:27:58.635883 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:28:02.016901 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-c8ms8 I0225 15:28:02.196827 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:28:05.552857 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-8l5zq I0225 15:28:05.741098 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: creating LeaderWorkerSet without queue name in labeled namespace @ 02/25/26 15:28:05.741 STEP: verifying workload is created for LeaderWorkerSet without queue name @ 02/25/26 15:28:05.952 STEP: verifying LeaderWorkerSet pods are created in managed namespace @ 02/25/26 15:28:16.324 STEP: verifying LeaderWorkerSet pods are in SchedulingGated state @ 02/25/26 15:28:16.504 STEP: Feching Kueue Instance @ 02/25/26 15:28:16.861 STEP: Updating Kueue config @ 02/25/26 15:28:17.346 STEP: Waiting for kueue-controller-manager resource version to change from 63816 @ 02/25/26 15:28:17.532 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:28:28.583 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:28:38.903 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:28:38.904 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:28:39.256 I0225 15:28:39.633224 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-xn99m I0225 15:28:39.809099 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:28:43.176355 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-jkfxz I0225 15:28:43.347124 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:28:46.718917 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-46tsq I0225 15:28:46.898834 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Destroying Object test-lws-ftptq @ 02/25/26 15:28:46.898 • [72.095 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should not manage LeaderWorkerSet without queue name in unlabeled namespace when labelPolicy=None [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:856 STEP: Feching Kueue Instance @ 02/25/26 15:28:47.588 STEP: Updating Kueue config @ 02/25/26 15:28:48.099 STEP: Waiting for kueue-controller-manager resource version to change from 64271 @ 02/25/26 15:28:48.28 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:28:59.292 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:29:09.612 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:29:09.612 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:29:10.012 I0225 15:29:10.401644 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-r5n57 I0225 15:29:10.588274 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:29:13.944497 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-ffhlq I0225 15:29:14.124496 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:29:17.489487 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-d5pdb I0225 15:29:17.669794 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: creating LeaderWorkerSet without queue name in unlabeled namespace @ 02/25/26 15:29:17.669 STEP: verifying no workload is created for LeaderWorkerSet in unlabeled namespace @ 02/25/26 15:29:17.86 STEP: verifying LeaderWorkerSet pods are running in unlabeled namespace @ 02/25/26 15:32:17.855 STEP: Feching Kueue Instance @ 02/25/26 15:32:18.02 STEP: Updating Kueue config @ 02/25/26 15:32:18.365 STEP: Waiting for kueue-controller-manager resource version to change from 64604 @ 02/25/26 15:32:18.535 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:32:29.227 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:32:39.553 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:32:39.553 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:32:39.918 I0225 15:32:40.289634 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-5lfkr I0225 15:32:40.464225 60722 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:32:43.842801 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-k4jrn I0225 15:32:44.031899 60722 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:32:47.411026 60722 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-rtkhv I0225 15:32:47.570466 60722 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Destroying Object test-lws-ddnjf @ 02/25/26 15:32:47.57 • [240.681 seconds] ------------------------------ Kueue Operator when enable webhook via opt-in namespaces should expose metrics endpoint with TLS [operator] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:914 STEP: creating workloads @ 02/25/26 15:32:48.089 STEP: Creating curl test pod @ 02/25/26 15:32:48.468 STEP: Creating Pod openshift-kueue-operator/curl-metrics-test @ 02/25/26 15:32:48.468 STEP: Destroying Pod openshift-kueue-operator/curl-metrics-test @ 02/25/26 15:33:12.056 STEP: Destroying LocalQueue kueue-managed-test/test-queue @ 02/25/26 15:33:43.584 STEP: Deleting namespace kueue-managed-test @ 02/25/26 15:33:44.105 STEP: Deleting namespace kueue-unmanaged-test @ 02/25/26 15:33:44.437 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:33:54.932 STEP: Destroying ResourceFlavor default @ 02/25/26 15:33:55.452 • [67.874 seconds] ------------------------------ Kueue Operator when cleaning up Kueue resources should delete Kueue instance and verify cleanup [operator, disruptive] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:992 STEP: create a resourceFlavor @ 02/25/26 15:33:55.961 I0225 15:33:55.961380 60722 e2e_operator_test.go:997] Creating Kueue Custom Resources to test they are NOT deleted when Kueue CR is deleted STEP: create clusterQueue @ 02/25/26 15:33:56.141 STEP: Creating namespace @ 02/25/26 15:33:56.321 STEP: create a LocalQueue in the test namespace @ 02/25/26 15:33:56.484 STEP: Creating LocalQueue test-localqueue in namespace kueue-namespace-5bttx @ 02/25/26 15:33:56.484 STEP: Creating Job kueue-namespace-5bttx/test-job @ 02/25/26 15:33:56.652 STEP: wait for workload to be created for job @ 02/25/26 15:33:56.881 I0225 15:33:57.049717 60722 e2e_operator_test.go:1068] Found workload job-test-job-78dd4 for job test-job STEP: create a LeaderWorkerSet in the test namespace @ 02/25/26 15:33:57.049 STEP: wait for workload to be created for LeaderWorkerSet @ 02/25/26 15:33:57.257 STEP: create a JobSet in the test namespace @ 02/25/26 15:33:57.437 STEP: wait for workload to be created for JobSet @ 02/25/26 15:33:57.636 STEP: verify the Kueue instance exists and delete it @ 02/25/26 15:33:57.8 STEP: verify that Kueue Custom Resources are NOT deleted when Kueue CR is deleted @ 02/25/26 15:34:18.656 I0225 15:34:18.830743 60722 e2e_operator_test.go:1145] Found 3 ClusterQueues still existing after Kueue CR deletion I0225 15:34:19.008876 60722 e2e_operator_test.go:1154] Found 3 ResourceFlavors still existing after Kueue CR deletion I0225 15:34:19.188906 60722 e2e_operator_test.go:1163] Found 1 LocalQueues still existing after Kueue CR deletion I0225 15:34:19.369152 60722 e2e_operator_test.go:1172] Found 3 Workloads still existing after Kueue CR deletion I0225 15:34:19.536957 60722 e2e_operator_test.go:1178] Workload job-test-job-78dd4 for job still exists after Kueue CR deletion I0225 15:34:19.718717 60722 e2e_operator_test.go:1184] Workload leaderworkerset-test-lws-6lx67-0-93e24 for LeaderWorkerSet still exists after Kueue CR deletion I0225 15:34:19.888741 60722 e2e_operator_test.go:1190] Workload jobset-test-jobset-82rbc-97379 for JobSet still exists after Kueue CR deletion I0225 15:34:20.410174 60722 e2e_operator_test.go:1196] Verifying removal of Cluster Roles I0225 15:34:20.592065 60722 e2e_operator_test.go:1211] Verifying removal of Cluster Role Bindings I0225 15:34:20.781036 60722 e2e_operator_test.go:1219] Verifying removal of Mutating Webhooks I0225 15:34:21.142887 60722 e2e_operator_test.go:1227] Verifying removal of Validating Webhooks I0225 15:34:21.142911 60722 e2e_operator_test.go:1242] Verifying removal of certificates instances in namespace openshift-kueue-operator I0225 15:34:21.317919 60722 e2e_operator_test.go:1242] Verifying removal of issuers instances in namespace openshift-kueue-operator I0225 15:34:21.485295 60722 e2e_operator_test.go:1254] Verifying removal of ConfigMap: kueue-manager-config I0225 15:34:21.649477 60722 e2e_operator_test.go:1262] Verifying removal of Secret: kueue-webhook-server-cert I0225 15:34:21.824104 60722 e2e_operator_test.go:1262] Verifying removal of Secret: metrics-server-cert I0225 15:34:21.984552 60722 e2e_operator_test.go:1269] Verifying removal of ServiceAccount: kueue-controller-manager I0225 15:34:22.155147 60722 e2e_operator_test.go:1275] Verifying removal of all NetworkPolicies in namespace: openshift-kueue-operator I0225 15:34:22.336229 60722 e2e_operator_test.go:1288] Verifying removal of all Services in namespace: openshift-kueue-operator STEP: Destroying Object test-jobset-82rbc @ 02/25/26 15:34:23.037 STEP: Destroying Object test-lws-6lx67 @ 02/25/26 15:34:23.573 STEP: Destroying Job kueue-namespace-5bttx/test-job @ 02/25/26 15:34:24.107 I0225 15:34:24.486699 60722 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" STEP: Destroying LocalQueue kueue-namespace-5bttx/test-localqueue @ 02/25/26 15:34:24.677 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:34:25.216 STEP: Destroying ResourceFlavor default @ 02/25/26 15:34:25.749 • [30.328 seconds] ------------------------------ Kueue Operator when cleaning up Kueue resources should redeploy Kueue instance and verify pod is ready [operator, disruptive] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:1320 I0225 15:34:26.288726 60722 e2e_operator_test.go:1323] Redeploying Kueue instance I0225 15:34:58.240275 60722 e2e_operator_test.go:1343] Checking pod: kueue-controller-manager-566b9f9445-cdqrb, phase: Running, deletionTS: I0225 15:34:58.240643 60722 e2e_operator_test.go:1343] Checking pod: kueue-controller-manager-566b9f9445-crws8, phase: Running, deletionTS: I0225 15:34:58.240712 60722 e2e_operator_test.go:1343] Checking pod: kueue-controller-manager-678b79ddcc-qmjt9, phase: Running, deletionTS: I0225 15:35:08.752533 60722 e2e_operator_test.go:1343] Checking pod: kueue-controller-manager-566b9f9445-cdqrb, phase: Running, deletionTS: • [42.466 seconds] ------------------------------ SSSSSSSSSSSSSSSSS Ran 20 of 53 Specs in 796.980 seconds SUCCESS! -- 20 Passed | 0 Failed | 0 Pending | 33 Skipped You're using deprecated Ginkgo functionality: ============================================= --ginkgo.slow-spec-threshold is deprecated --slow-spec-threshold has been deprecated and will be removed in a future version of Ginkgo. This feature has proved to be more noisy than useful. You can use --poll-progress-after, instead, to get more actionable feedback about potentially slow specs and understand where they might be getting stuck. To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=2.27.2 PASS Ginkgo ran 1 suite in 13m23.16136s Test Suite Passed ❯ make test-e2e GOBIN=/Users/anahas/Github/forks/kueue-operator/kueue-operator/bin GO111MODULE=on go install -mod=mod github.com/onsi/ginkgo/v2/ginkgo@v2.1.4 /Users/anahas/Github/forks/kueue-operator/kueue-operator/bin/ginkgo --keep-going --flake-attempts=1 --label-filter="!operator && !disruptive" -v ./test/e2e/... Starting kueue operator suite Running Suite: e2e suite - /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e ============================================================================================ Random Seed: 1772044849 Will run 33 of 53 specs ------------------------------ [BeforeSuite] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_suite_test.go:68 STEP: Deploying Kueue operand for all test suites @ 02/25/26 15:40:56.09 I0225 15:40:56.090405 64690 e2e_operator_test.go:1648] Creating Kueue instance STEP: Waiting for all Kueue CRDs to be registered @ 02/25/26 15:40:57.191 I0225 15:40:57.191795 64690 e2e_operator_test.go:1671] Checking pod: kueue-controller-manager-566b9f9445-cdqrb, phase: Running, deletionTS: STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:41:01.928 I0225 15:41:01.928965 64690 e2e_operator_test.go:1739] All 9 Kueue CRDs are registered and established I0225 15:41:02.285190 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-kbfsr I0225 15:41:02.456506 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:41:05.827031 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-t2h56 I0225 15:41:06.008011 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:41:09.378700 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-h7gvk I0225 15:41:09.543824 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes [BeforeSuite] PASSED [13.458 seconds] ------------------------------ Kueue Metrics Metrics Infrastructure should have metrics service created [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:156 STEP: Ensuring monitoring namespace exists @ 02/25/26 15:41:09.544 STEP: Copying metrics certificate secret to monitoring namespace @ 02/25/26 15:41:09.705 STEP: Creating curl pod in monitoring namespace @ 02/25/26 15:41:10.248 STEP: Waiting for curl pod to be ready @ 02/25/26 15:41:10.445 • [11.435 seconds] ------------------------------ Kueue Metrics Metrics Infrastructure should have metrics TLS secret created [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:165 • [0.184 seconds] ------------------------------ Kueue Metrics Metrics Infrastructure should have ServiceMonitor created [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:174 • [0.913 seconds] ------------------------------ Kueue Metrics Metrics Infrastructure should have metrics network policy with correct namespace selectors [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:187 • [0.182 seconds] ------------------------------ Kueue Metrics Metrics Endpoint should return valid metrics over HTTPS [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:223 STEP: Executing curl command in monitoring pod @ 02/25/26 15:41:22.259 STEP: Verifying metrics format @ 02/25/26 15:41:24.373 Metrics output (first 500 chars): # HELP certwatcher_read_certificate_errors_total Total number of certificate read errors # TYPE certwatcher_read_certificate_errors_total counter certwatcher_read_certificate_errors_total 0 # HELP certwatcher_read_certificate_total Total number of certificate reads # TYPE certwatcher_read_certificate_total counter certwatcher_read_certificate_total 80 # HELP controller_runtime_active_workers Number of currently used workers per controller # TYPE controller_runtime_active_workers gauge controller • [2.115 seconds] ------------------------------ Kueue Metrics Metrics Endpoint should expose kueue-specific metrics [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:247 STEP: Executing curl command in monitoring pod @ 02/25/26 15:41:24.374 STEP: Checking for kueue build info metric @ 02/25/26 15:41:25.948 STEP: Checking for controller-runtime metrics @ 02/25/26 15:41:25.949 • [1.575 seconds] ------------------------------ Kueue Metrics Cross-namespace Access should allow metrics scraping from monitoring namespace [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:271 STEP: Verifying monitoring pod can reach metrics from operator namespace @ 02/25/26 15:41:25.949 • [1.531 seconds] ------------------------------ Kueue Metrics Cross-namespace Access should block metrics scraping from non-monitoring namespace [metrics] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_metrics_test.go:283 STEP: Creating a test namespace without monitoring labels @ 02/25/26 15:41:27.48 STEP: Copying metrics certificate secret to test namespace @ 02/25/26 15:41:27.647 STEP: Creating curl pod in test namespace @ 02/25/26 15:41:27.979 STEP: Waiting for test pod to be ready @ 02/25/26 15:41:28.15 STEP: Verifying test pod CANNOT reach metrics (should timeout or be forbidden) @ 02/25/26 15:41:38.56 STEP: Cleaning up test namespace @ 02/25/26 15:41:39.639 • [12.676 seconds] ------------------------------ Preemption when Preemption is Fair Sharing should preempt workloads [preemption] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_preemption_test.go:59 STEP: Saving initial Kueue configuration @ 02/25/26 15:41:40.155 STEP: Updating Kueue configuration to use FairSharing preemption @ 02/25/26 15:41:40.323 STEP: Feching Kueue Instance @ 02/25/26 15:41:40.323 STEP: Updating Kueue config @ 02/25/26 15:41:40.657 STEP: Waiting for kueue-controller-manager resource version to change from 67988 @ 02/25/26 15:41:40.835 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:41:51.512 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:42:01.838 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:42:01.838 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:42:02.19 I0225 15:42:02.568438 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-vv2r2 I0225 15:42:02.738419 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:42:06.099016 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-nvk84 I0225 15:42:06.263963 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:42:09.614923 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-wwfcr I0225 15:42:09.778415 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Creating Resource Flavor @ 02/25/26 15:42:09.778 STEP: Creating ClusterQueue, Namespace and LocalQueue for A @ 02/25/26 15:42:09.986 STEP: Creating LocalQueue local-queue-a in namespace preemption-a-rx885 @ 02/25/26 15:42:10.345 STEP: Creating ClusterQueue, Namespace and LocalQueue for B @ 02/25/26 15:42:10.52 STEP: Creating LocalQueue local-queue-b in namespace preemption-b-kjvsl @ 02/25/26 15:42:10.871 STEP: Creating a job on A that borrows resources from the cohort @ 02/25/26 15:42:11.048 STEP: Verifying borrowing job workload is admitted @ 02/25/26 15:42:11.241 STEP: Verifying clusterQueueA borrowed 250m CPU @ 02/25/26 15:42:31.798 STEP: Creating a job on B that will reclaim quota from A @ 02/25/26 15:42:31.967 STEP: Verifying reclaim job workload is admitted @ 02/25/26 15:42:32.154 STEP: Verifying borrowing job on A was preempted @ 02/25/26 15:42:42.485 STEP: Waiting for reclaim job to finish @ 02/25/26 15:42:42.656 STEP: Verifying borrowing job on A is re-admitted after reclaim job finishes @ 02/25/26 15:43:23.517 STEP: Restoring initial Kueue configuration @ 02/25/26 15:43:23.698 STEP: Feching Kueue Instance @ 02/25/26 15:43:23.698 STEP: Updating Kueue config @ 02/25/26 15:43:24.214 STEP: Waiting for kueue-controller-manager resource version to change from 70819 @ 02/25/26 15:43:24.397 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:43:35.086 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:43:45.443 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:43:45.443 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:43:45.823 I0225 15:43:46.230329 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-txwrb I0225 15:43:46.417052 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:43:50.466084 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-6jdl7 I0225 15:43:50.665957 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:43:54.087064 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-mnqkc I0225 15:43:54.280114 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Deleting Job reclaim-job in namespace preemption-b-kjvsl @ 02/25/26 15:43:54.28 STEP: Deleting Job borrowing-job in namespace preemption-a-rx885 @ 02/25/26 15:43:54.652 STEP: Destroying LocalQueue preemption-b-kjvsl/local-queue-b @ 02/25/26 15:43:55.004 STEP: Deleting namespace preemption-b-kjvsl @ 02/25/26 15:43:55.557 STEP: Destroying ClusterQueue cluster-queue-5thjc @ 02/25/26 15:43:55.887 STEP: Destroying LocalQueue preemption-a-rx885/local-queue-a @ 02/25/26 15:43:56.448 STEP: Deleting namespace preemption-a-rx885 @ 02/25/26 15:43:57.016 STEP: Destroying ClusterQueue cluster-queue-5g7rw @ 02/25/26 15:44:27.879 STEP: Destroying ResourceFlavor resource-flavor-vxqqr @ 02/25/26 15:44:28.394 • [168.766 seconds] ------------------------------ Scheduling Gate when workloads are submitted to a non-existent LocalQueue should verify Kueue is configured with only Deployment, StatefulSet, and LeaderWorkerSet integrations [scheduling-gate] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_scheduling_gate_test.go:130 STEP: Updating Kueue configuration to only include Deployment, StatefulSet, and LeaderWorkerSet @ 02/25/26 15:44:28.915 STEP: Feching Kueue Instance @ 02/25/26 15:44:28.915 STEP: Updating Kueue config @ 02/25/26 15:44:29.406 STEP: Waiting for kueue-controller-manager resource version to change from 71768 @ 02/25/26 15:44:29.594 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:44:40.287 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:44:50.614 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:44:50.615 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:44:50.965 I0225 15:44:51.371538 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-8x8jf I0225 15:44:51.536596 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:44:54.895171 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-9kznr I0225 15:44:55.071906 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:44:58.442343 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-87tl4 I0225 15:44:58.602708 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Creating namespace scheduling-gate-test with managed label @ 02/25/26 15:44:58.602 I0225 15:44:59.135576 64690 e2e_scheduling_gate_test.go:92] Setup complete - no LocalQueue created in namespace scheduling-gate-test STEP: Verifying kueue-manager-config ConfigMap contains only expected integrations @ 02/25/26 15:44:59.135 • [30.382 seconds] ------------------------------ Scheduling Gate when workloads are submitted to a non-existent LocalQueue should keep Deployment pods scheduling gated when submitted to non-existent queue [scheduling-gate] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_scheduling_gate_test.go:150 STEP: Creating deployment with queue label pointing to non-existent queue @ 02/25/26 15:44:59.295 STEP: Waiting for deployment pods to be created @ 02/25/26 15:44:59.467 STEP: Verifying deployment pods have scheduling gates @ 02/25/26 15:44:59.643 I0225 15:44:59.809046 64690 e2e_scheduling_gate_test.go:197] Deployment pod test-deploy-rnc5m-6578975d-lvm7p has scheduling gate as expected STEP: Verifying pods remain scheduling gated (not scheduled) @ 02/25/26 15:44:59.809 STEP: Destroying Object test-deploy-rnc5m @ 02/25/26 15:45:29.808 • [31.014 seconds] ------------------------------ Scheduling Gate when workloads are submitted to a non-existent LocalQueue should keep StatefulSet pods scheduling gated when submitted to non-existent queue [scheduling-gate] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_scheduling_gate_test.go:217 STEP: Creating statefulset with queue label pointing to non-existent queue @ 02/25/26 15:45:30.308 STEP: Waiting for statefulset pods to be created @ 02/25/26 15:45:30.512 STEP: Verifying statefulset pods have scheduling gates @ 02/25/26 15:45:30.69 STEP: Verifying pods remain scheduling gated (not scheduled) @ 02/25/26 15:45:30.864 I0225 15:45:30.864295 64690 e2e_scheduling_gate_test.go:264] StatefulSet pod test-ss-r5zhw-0 has scheduling gate as expected STEP: Destroying Object test-ss-r5zhw @ 02/25/26 15:46:00.864 • [31.053 seconds] ------------------------------ Scheduling Gate when workloads are submitted to a non-existent LocalQueue should keep LeaderWorkerSet pods scheduling gated when submitted to non-existent queue [scheduling-gate] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_scheduling_gate_test.go:284 STEP: Creating LeaderWorkerSet with queue label pointing to non-existent queue @ 02/25/26 15:46:01.36 STEP: Waiting for LeaderWorkerSet pods to be created @ 02/25/26 15:46:01.563 STEP: Verifying LeaderWorkerSet pods have scheduling gates @ 02/25/26 15:46:01.735 I0225 15:46:01.905200 64690 e2e_scheduling_gate_test.go:334] LeaderWorkerSet pod test-lws-jzm58-0 has scheduling gate as expected I0225 15:46:02.077596 64690 e2e_scheduling_gate_test.go:334] LeaderWorkerSet pod test-lws-jzm58-0-1 has scheduling gate as expected STEP: Verifying pods remain scheduling gated (not scheduled) @ 02/25/26 15:46:02.077 STEP: Destroying Object test-lws-jzm58 @ 02/25/26 15:46:32.078 STEP: Cleaning up test resources @ 02/25/26 15:46:32.613 STEP: Deleting namespace scheduling-gate-test @ 02/25/26 15:46:32.613 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:46:32.965 STEP: Destroying ResourceFlavor default @ 02/25/26 15:46:33.493 STEP: Restoring default Kueue configuration @ 02/25/26 15:46:34.031 STEP: Feching Kueue Instance @ 02/25/26 15:46:34.031 STEP: Updating Kueue config @ 02/25/26 15:46:34.535 STEP: Waiting for kueue-controller-manager resource version to change from 72411 @ 02/25/26 15:46:34.73 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:46:45.438 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:46:55.767 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:46:55.768 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:46:56.13 I0225 15:46:56.530408 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-g7jxc I0225 15:46:56.710010 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:47:00.070201 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-jm9s4 I0225 15:47:00.262880 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:47:03.661995 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-82bg8 I0225 15:47:03.851482 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes • [62.493 seconds] ------------------------------ LocalQueueDefaulting when labelPolicy=None and LocalQueue default in a managed namespace should label and admit Pod and Job [local-queue-default] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_local_queue_defaulting_test.go:78 STEP: Feching Kueue Instance @ 02/25/26 15:47:04.024 STEP: Updating Kueue config @ 02/25/26 15:47:04.561 STEP: Waiting for kueue-controller-manager resource version to change from 73517 @ 02/25/26 15:47:04.747 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:47:15.442 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:47:25.767 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:47:25.768 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:47:26.121 I0225 15:47:26.485481 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-gfvzn I0225 15:47:26.657869 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:47:30.017487 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-wd6fq I0225 15:47:30.187589 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:47:33.542462 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-mgjx2 I0225 15:47:33.723755 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Created namespace e2e-kueue-hswj6 @ 02/25/26 15:47:34.262 STEP: Creating LocalQueue default in namespace e2e-kueue-hswj6 @ 02/25/26 15:47:34.262 STEP: creating job without queue name @ 02/25/26 15:47:34.448 STEP: namespace with labels: e2e-kueue-hswj6 @ 02/25/26 15:47:34.448 STEP: verifying workload created in namespace e2e-kueue-hswj6 and uid 38c0cbdb-0bce-4c63-a4ae-35f06c94d425 @ 02/25/26 15:47:34.662 STEP: creating pod without queue name @ 02/25/26 15:47:35.042 STEP: verifying workload created in namespace e2e-kueue-hswj6 and uid 27f7de8f-5a22-4c94-9e07-23dfce34528f @ 02/25/26 15:47:35.25 STEP: Destroying LocalQueue e2e-kueue-hswj6/default @ 02/25/26 15:47:35.622 STEP: Deleting namespace e2e-kueue-hswj6 @ 02/25/26 15:47:36.182 • [73.358 seconds] ------------------------------ LocalQueueDefaulting when labelPolicy=None and LocalQueue default in a managed namespace should label and admit LeaderWorkerSet [local-queue-default] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_local_queue_defaulting_test.go:95 STEP: Created namespace e2e-kueue-gt4mh @ 02/25/26 15:48:18.073 STEP: Creating LocalQueue default in namespace e2e-kueue-gt4mh @ 02/25/26 15:48:18.073 STEP: creating LeaderWorkerSet without queue name @ 02/25/26 15:48:18.254 STEP: verifying LeaderWorkerSet has queue label added @ 02/25/26 15:48:18.453 STEP: verifying workload is created for LeaderWorkerSet @ 02/25/26 15:48:18.622 STEP: verifying workload created in namespace e2e-kueue-gt4mh and uid 0fe3720b-cc90-46b2-8185-026d06e6911c @ 02/25/26 15:48:18.623 STEP: Destroying Object test-lws-7mgv7 @ 02/25/26 15:48:19.133 STEP: Destroying LocalQueue e2e-kueue-gt4mh/default @ 02/25/26 15:48:19.65 STEP: Deleting namespace e2e-kueue-gt4mh @ 02/25/26 15:48:20.178 • [44.479 seconds] ------------------------------ LocalQueueDefaulting when labelPolicy=None and LocalQueue default in a managed namespace should allow other local queues in same namespace without interfering [local-queue-default] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_local_queue_defaulting_test.go:119 STEP: Created namespace e2e-kueue-brwfq @ 02/25/26 15:49:01.871 STEP: Creating LocalQueue default in namespace e2e-kueue-brwfq @ 02/25/26 15:49:01.871 STEP: creating job without queue name @ 02/25/26 15:49:02.052 STEP: verifying workload created in namespace e2e-kueue-brwfq and uid 468d1574-b5dc-45ff-8464-ee89ff038884 @ 02/25/26 15:49:02.232 STEP: creating pod without queue name @ 02/25/26 15:49:02.574 STEP: verifying workload created in namespace e2e-kueue-brwfq and uid 17c99400-6ffe-41d7-9dd7-7a72c2f33cf0 @ 02/25/26 15:49:02.781 STEP: Creating LocalQueue test-queue-2 in namespace e2e-kueue-brwfq @ 02/25/26 15:49:03.113 STEP: creating job in other local queue @ 02/25/26 15:49:03.288 STEP: verifying workload created in namespace e2e-kueue-brwfq and uid 17c99400-6ffe-41d7-9dd7-7a72c2f33cf0 @ 02/25/26 15:49:03.459 STEP: creating pod in other local queue @ 02/25/26 15:49:03.803 STEP: verifying workload created in namespace e2e-kueue-brwfq and uid 2f910aa7-1b77-4176-a7b2-1a14c539496c @ 02/25/26 15:49:03.993 STEP: Destroying LocalQueue e2e-kueue-brwfq/test-queue-2 @ 02/25/26 15:49:04.34 STEP: Destroying LocalQueue e2e-kueue-brwfq/default @ 02/25/26 15:49:04.884 STEP: Deleting namespace e2e-kueue-brwfq @ 02/25/26 15:49:05.411 • [45.448 seconds] ------------------------------ LocalQueueDefaulting when labelPolicy=None and LocalQueue default in a managed namespace should allow to label pod and job with default localqueue after they're created [local-queue-default] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_local_queue_defaulting_test.go:161 STEP: Created namespace e2e-kueue-dvzs4 @ 02/25/26 15:49:47.296 STEP: Creating LocalQueue default in namespace e2e-kueue-dvzs4 @ 02/25/26 15:49:47.296 STEP: Creating a new job without localQueue @ 02/25/26 15:49:47.469 STEP: Creating a new pod without localQueue @ 02/25/26 15:49:47.993 STEP: Creating localQueue Default @ 02/25/26 15:49:48.324 STEP: Creating LocalQueue default in namespace e2e-kueue-dvzs4 @ 02/25/26 15:49:48.324 STEP: verifying workload created in namespace e2e-kueue-dvzs4 and uid 21c2afa9-03a6-43e4-aa68-3a52bcbbf179 @ 02/25/26 15:49:48.84 STEP: Checking that Job and Pod were not automatically labeled @ 02/25/26 15:49:49.185 STEP: Adding localQueue Default label to Pod scheduled: test-pod-hp2jl @ 02/25/26 15:49:49.529 STEP: verifying workload created in namespace e2e-kueue-dvzs4 and uid b82dc30d-fbba-4d00-ab4c-3a944027f0c9 @ 02/25/26 15:49:50.053 STEP: Adding localQueue Default label to Job suspended: test-job-nq6n4 @ 02/25/26 15:49:50.41 STEP: verifying workload created in namespace e2e-kueue-dvzs4 and uid e35438e1-9555-4184-93ec-0a48a25f3358 @ 02/25/26 15:49:50.949 STEP: Destroying LocalQueue e2e-kueue-dvzs4/default @ 02/25/26 15:49:51.307 STEP: Deleting namespace e2e-kueue-dvzs4 @ 02/25/26 15:49:51.848 STEP: deleting cluster queue @ 02/25/26 15:50:33.332 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:50:33.333 STEP: deleting resource flavor @ 02/25/26 15:50:39.031 STEP: Destroying ResourceFlavor default @ 02/25/26 15:50:39.031 STEP: Feching Kueue Instance @ 02/25/26 15:50:39.564 STEP: Updating Kueue config @ 02/25/26 15:50:40.083 STEP: Waiting for kueue-controller-manager resource version to change from 73875 @ 02/25/26 15:50:40.264 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 15:50:50.982 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 15:51:01.317 STEP: Waiting for webhook configurations to exist @ 02/25/26 15:51:01.317 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 15:51:01.656 I0225 15:51:02.017350 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-m942k I0225 15:51:02.184280 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 15:51:05.544966 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-zfjbn I0225 15:51:05.724411 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 15:51:09.092454 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-48lnn I0225 15:51:09.263932 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes • [82.136 seconds] ------------------------------ LocalQueueDefaulting when labelPolicy is not defined and default LocalQueue is in a managed namespace should label and admit Job [local-queue-default] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_local_queue_defaulting_test.go:248 STEP: Created namespace e2e-kueue-qtwdj @ 02/25/26 15:51:09.784 STEP: Creating LocalQueue default in namespace e2e-kueue-qtwdj @ 02/25/26 15:51:09.784 STEP: Creating job without queue name @ 02/25/26 15:51:09.968 STEP: verifying workload created in namespace e2e-kueue-qtwdj and uid ac820c01-4d58-4740-b099-f26dcb04dd60 @ 02/25/26 15:51:40.849 STEP: Destroying LocalQueue e2e-kueue-qtwdj/default @ 02/25/26 15:51:41.212 STEP: Deleting namespace e2e-kueue-qtwdj @ 02/25/26 15:51:41.771 STEP: deleting cluster queue @ 02/25/26 15:52:22.884 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:52:22.884 STEP: deleting resource flavor @ 02/25/26 15:52:28.576 STEP: Destroying ResourceFlavor default @ 02/25/26 15:52:28.577 • [79.843 seconds] ------------------------------ LocalQueueDefaulting when labelPolicy is not defined and default LocalQueue is in a managed namespace should label and admit JobSet [local-queue-default] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_local_queue_defaulting_test.go:260 STEP: Created namespace e2e-kueue-8swl5 @ 02/25/26 15:52:29.628 STEP: Creating LocalQueue default in namespace e2e-kueue-8swl5 @ 02/25/26 15:52:29.628 STEP: Creating JobSet without queue name @ 02/25/26 15:52:29.8 STEP: verifying jobset did start in labeled namespace @ 02/25/26 15:52:29.994 STEP: verifying workload created in namespace e2e-kueue-8swl5 and uid 701a9622-74ef-4c96-bfc7-1006a9278a83 @ 02/25/26 15:52:30.173 STEP: Destroying Object test-jobset-ftlzv @ 02/25/26 15:52:30.509 STEP: Destroying LocalQueue e2e-kueue-8swl5/default @ 02/25/26 15:52:31.024 STEP: Deleting namespace e2e-kueue-8swl5 @ 02/25/26 15:52:31.536 STEP: deleting cluster queue @ 02/25/26 15:52:42.076 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:52:42.076 STEP: deleting resource flavor @ 02/25/26 15:52:42.614 STEP: Destroying ResourceFlavor default @ 02/25/26 15:52:42.614 • [14.071 seconds] ------------------------------ LocalQueueDefaulting when labelPolicy is not defined and default LocalQueue is in an unmanaged namespace should label and admit Pod [local-queue-default] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_local_queue_defaulting_test.go:292 STEP: Created namespace e2e-kueue-7nt6w @ 02/25/26 15:52:43.729 STEP: Creating LocalQueue default in namespace e2e-kueue-7nt6w @ 02/25/26 15:52:43.729 STEP: creating pod without queue name @ 02/25/26 15:52:43.916 STEP: Destroying LocalQueue e2e-kueue-7nt6w/default @ 02/25/26 15:52:54.621 STEP: Deleting namespace e2e-kueue-7nt6w @ 02/25/26 15:52:55.173 STEP: deleting cluster queue @ 02/25/26 15:53:40.612 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:53:40.613 STEP: deleting resource flavor @ 02/25/26 15:53:41.151 STEP: Destroying ResourceFlavor default @ 02/25/26 15:53:41.151 • [58.507 seconds] ------------------------------ VisibilityOnDemand when kueue.openshift.io/allow-nominal-concurrency-shares-update annotation is set to true should allow modification of the nominal concurrency shares to 0 [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:103 STEP: Creating LocalQueue test-queue in namespace e2e-kueue-visibility-on-demand-mcqzr @ 02/25/26 15:53:42.043 STEP: Modifying the PriorityLevelConfiguration with nominal concurrency shares set to 0 @ 02/25/26 15:53:42.608 STEP: Ensure the value of nominal concurrency shares is changed to 0 @ 02/25/26 15:53:42.963 STEP: Try to access the pending workload @ 02/25/26 15:53:43.147 • [178.316 seconds] ------------------------------ VisibilityOnDemand when kueue.openshift.io/allow-nominal-concurrency-shares-update annotation is set to true should allow modification of the nominal concurrency shares to 5 [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:117 STEP: Modifying the PriorityLevelConfiguration with nominal concurrency shares set to 5 @ 02/25/26 15:56:39.99 STEP: Try to access the pending workload @ 02/25/26 15:56:40.388 STEP: Check is able to access the pending workload @ 02/25/26 15:56:40.558 • [0.733 seconds] ------------------------------ VisibilityOnDemand when kueue.openshift.io/allow-nominal-concurrency-shares-update annotation is set to true should not allow modification of the nominal concurrency shares to 1 [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:130 STEP: Modifying the PriorityLevelConfiguration with nominal concurrency shares set to 1 @ 02/25/26 15:56:40.723 STEP: Wait to verify the value of nominal concurrency shares is changed back to the default @ 02/25/26 15:56:41.075 • [10.723 seconds] ------------------------------ VisibilityOnDemand when kueue.openshift.io/allow-nominal-concurrency-shares-update annotation is set to true should not allow modification of the nominal concurrency shares to 6 [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:142 STEP: Modifying the PriorityLevelConfiguration with nominal concurrency shares set to 6 @ 02/25/26 15:56:51.446 STEP: Wait to verify the value of nominal concurrency shares is changed back to the default @ 02/25/26 15:56:51.792 • [0.506 seconds] ------------------------------ VisibilityOnDemand when kueue.openshift.io/allow-nominal-concurrency-shares-update annotation is set to true should not allow modification of the nominal concurrency shares if it's not admin [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:155 STEP: Creating Kubernetes client with impersonation for non-admin service account @ 02/25/26 15:56:51.953 STEP: Attempting to modify PriorityLevelConfiguration with nominal concurrency shares set to 4 @ 02/25/26 15:56:51.962 STEP: Destroying LocalQueue e2e-kueue-visibility-on-demand-mcqzr/test-queue @ 02/25/26 15:56:52.118 STEP: Deleting namespace e2e-kueue-visibility-on-demand-mcqzr @ 02/25/26 15:56:52.64 STEP: Destroying ClusterQueue test-clusterqueue @ 02/25/26 15:56:52.966 STEP: Destroying ResourceFlavor default @ 02/25/26 15:56:53.52 • [2.074 seconds] ------------------------------ VisibilityOnDemand when PendingWorkloads list should be checked for a ClusterQueue and LocalQueue Should allow admin to access ClusterQueues, deny user access, and order pending workloads by priority [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:177 STEP: Creating Cluster Resources @ 02/25/26 15:56:54.027 STEP: Creating Namespaces and LocalQueues @ 02/25/26 15:56:54.55 STEP: Creating LocalQueue local-queue-a in namespace namespace-a-lp59f @ 02/25/26 15:56:54.726 STEP: Creating LocalQueue local-queue-b in namespace namespace-b-6xhwl @ 02/25/26 15:56:55.099 STEP: Creating Priority Classes @ 02/25/26 15:56:55.286 STEP: Creating RBAC kueue-batch-admin-role for Visibility API @ 02/25/26 15:56:55.841 STEP: Creating RBAC kueue-batch-user-role for Visibility API @ 02/25/26 15:56:56.206 STEP: Creating custom visibility client for ClusterQueue user @ 02/25/26 15:56:56.626 STEP: Creating testing data @ 02/25/26 15:56:56.642 STEP: verifying workload created in namespace namespace-a-lp59f and uid 471b3176-c4ef-41a5-a20a-1d18066aea57 @ 02/25/26 15:56:56.817 STEP: verifying workload created in namespace namespace-b-6xhwl and uid 001f0f53-2e30-47a0-9c10-378d3c16f919 @ 02/25/26 15:56:58.437 STEP: Checking the pending workloads for cluster queue cluster-queue-cqp8f @ 02/25/26 15:57:30.005 STEP: Verifying number of pending workloads and their priority ordering @ 02/25/26 15:57:36.084 STEP: Checking the pending workloads for cluster queue cluster-queue-tzr6g @ 02/25/26 15:57:36.085 STEP: Verifying number of pending workloads @ 02/25/26 15:57:36.441 STEP: All workloads should have been created @ 02/25/26 15:57:36.441 STEP: verifying workload created in namespace namespace-a-lp59f and uid 6e975bb7-9009-46e9-a987-63c1ac124a77 @ 02/25/26 15:57:36.441 STEP: verifying workload created in namespace namespace-a-lp59f and uid f953e729-6d31-4204-b3e5-0d7a86b6bdd6 @ 02/25/26 15:57:46.973 STEP: verifying workload created in namespace namespace-a-lp59f and uid ba374409-c5da-4d83-8a44-7ffbd57b1fa9 @ 02/25/26 15:57:47.335 STEP: verifying workload created in namespace namespace-b-6xhwl and uid e8031b5a-5560-4357-bf74-d585f4bb7246 @ 02/25/26 15:58:28.379 STEP: Verifying pending workloads lists are empty @ 02/25/26 15:58:28.74 STEP: Verifying a unauthorized user cannot access the pending workloads @ 02/25/26 15:58:36.296 STEP: Verifying user with kueue-batch-user-role cannot access ClusterQueue pending workloads @ 02/25/26 15:58:36.463 STEP: Deleting Job job-high-b in namespace namespace-b-6xhwl @ 02/25/26 15:58:36.636 STEP: Deleting Job job-blocker-b in namespace namespace-b-6xhwl @ 02/25/26 15:58:36.968 STEP: Deleting Job job-low-a in namespace namespace-a-lp59f @ 02/25/26 15:58:37.3 STEP: Deleting Job job-medium-a in namespace namespace-a-lp59f @ 02/25/26 15:58:37.655 STEP: Deleting Job job-high-a in namespace namespace-a-lp59f @ 02/25/26 15:58:37.991 STEP: Deleting Job job-blocker in namespace namespace-a-lp59f @ 02/25/26 15:58:38.319 STEP: Deleting ClusterRoleBinding kueue-cluster-role-binding-4bs88 @ 02/25/26 15:58:38.659 STEP: Deleting ClusterRoleBinding kueue-cluster-role-binding-52t2k @ 02/25/26 15:58:38.995 STEP: Deleting PriorityClass priority-class-bdwrl @ 02/25/26 15:58:39.327 STEP: Deleting PriorityClass priority-class-l97hz @ 02/25/26 15:58:39.67 STEP: Deleting PriorityClass priority-class-jhncv @ 02/25/26 15:58:40.019 STEP: Destroying LocalQueue namespace-b-6xhwl/local-queue-b @ 02/25/26 15:58:40.368 STEP: Deleting namespace namespace-b-6xhwl @ 02/25/26 15:58:40.88 STEP: Destroying LocalQueue namespace-a-lp59f/local-queue-a @ 02/25/26 15:59:11.759 STEP: Deleting namespace namespace-a-lp59f @ 02/25/26 15:59:12.354 STEP: Destroying ClusterQueue cluster-queue-tzr6g @ 02/25/26 15:59:12.695 STEP: Destroying ClusterQueue cluster-queue-cqp8f @ 02/25/26 15:59:13.211 STEP: Destroying ResourceFlavor resource-flavor-bfmx8 @ 02/25/26 15:59:13.739 • [140.225 seconds] ------------------------------ VisibilityOnDemand when PendingWorkloads list should be checked for a ClusterQueue and LocalQueue Should allow access to LocalQueues in bound namespaces and deny access to unbound namespaces [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:373 STEP: Creating Cluster Resources @ 02/25/26 15:59:14.249 STEP: Creating namespace-a and LocalQueue-a @ 02/25/26 15:59:14.586 STEP: Creating LocalQueue local-queue-a in namespace namespace-a-ld49t @ 02/25/26 15:59:14.765 STEP: Creating namespace-b and LocalQueue-b @ 02/25/26 15:59:14.957 STEP: Creating LocalQueue local-queue-b in namespace namespace-b-m2kfg @ 02/25/26 15:59:15.13 STEP: Creating RBAC kueue-batch-admin-role for Visibility API @ 02/25/26 15:59:15.321 STEP: Creating custom visibility client for ClusterQueue user @ 02/25/26 15:59:16.048 STEP: Creating Priority Classes @ 02/25/26 15:59:16.053 STEP: Creating testing data @ 02/25/26 15:59:16.441 STEP: verifying workload created in namespace namespace-a-ld49t and uid e5f21781-87b0-4687-ac15-c048da337097 @ 02/25/26 15:59:16.624 STEP: verifying workload created in namespace namespace-b-m2kfg and uid c1bb6b83-bae9-4d2a-b324-ffecd84b3ebc @ 02/25/26 15:59:17.32 STEP: Waiting for job-high-a workload to be created @ 02/25/26 16:00:09.079 I0225 16:00:09.243165 64690 warnings.go:110] "Warning: This version is deprecated. Use v1beta2 instead." STEP: Waiting for job-low-b workload to be created @ 02/25/26 16:00:09.246 I0225 16:00:09.406158 64690 warnings.go:110] "Warning: This version is deprecated. Use v1beta2 instead." STEP: Checking the pending workloads for local queue local-queue-a in namespace namespace-a-ld49t @ 02/25/26 16:00:09.406 STEP: Verifying pending workloads for LocalQueue A @ 02/25/26 16:00:09.746 STEP: Checking the pending workloads for local queue local-queue-b in namespace namespace-b-m2kfg @ 02/25/26 16:00:09.746 STEP: Verifying pending workloads for LocalQueue B @ 02/25/26 16:00:10.09 STEP: Check if not allowed users does not have access to LocalQueueA @ 02/25/26 16:00:10.09 STEP: Check if not allowed users does not have access to LocalQueueB @ 02/25/26 16:00:10.27 STEP: All workloads should have been created @ 02/25/26 16:00:10.434 STEP: verifying workload created in namespace namespace-a-ld49t and uid 7fa0cf91-3794-4bf9-8e64-6cc8c694d909 @ 02/25/26 16:00:10.435 STEP: verifying workload created in namespace namespace-b-m2kfg and uid 55c723c7-900d-463a-9a12-9dab38914cd4 @ 02/25/26 16:00:51.444 STEP: Verifying pending workloads lists are empty @ 02/25/26 16:00:51.816 STEP: Deleting Job job-low-b in namespace namespace-b-m2kfg @ 02/25/26 16:00:52.161 STEP: Deleting Job job-blocker-b in namespace namespace-b-m2kfg @ 02/25/26 16:00:52.5 STEP: Deleting Job job-high-a in namespace namespace-a-ld49t @ 02/25/26 16:00:52.845 STEP: Deleting Job job-blocker in namespace namespace-a-ld49t @ 02/25/26 16:00:53.17 STEP: Deleting PriorityClass priority-class-ccvwp @ 02/25/26 16:00:53.509 STEP: Deleting PriorityClass priority-class-m79jz @ 02/25/26 16:00:53.859 STEP: Deleting RoleBinding kueue-role-binding-skwwn in namespace namespace-b-m2kfg @ 02/25/26 16:00:54.212 STEP: Deleting RoleBinding kueue-role-binding-9pd9t in namespace namespace-a-ld49t @ 02/25/26 16:00:54.576 STEP: Destroying LocalQueue namespace-b-m2kfg/local-queue-b @ 02/25/26 16:00:54.944 STEP: Deleting namespace namespace-b-m2kfg @ 02/25/26 16:00:55.479 STEP: Destroying LocalQueue namespace-a-ld49t/local-queue-a @ 02/25/26 16:01:26.362 STEP: Deleting namespace namespace-a-ld49t @ 02/25/26 16:01:26.887 STEP: Destroying ClusterQueue cluster-queue-tqv4w @ 02/25/26 16:01:27.225 STEP: Destroying ResourceFlavor resource-flavor-b8xnz @ 02/25/26 16:01:27.74 • [134.035 seconds] ------------------------------ VisibilityOnDemand when PendingWorkloads Endpoints should be checked Should use the correct PriorityLevelConfiguration and FlowSchema for ClusterQueue and LocalQueue [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:583 STEP: Creating Cluster Resources @ 02/25/26 16:01:28.279 STEP: Creating Namespaces and LocalQueues @ 02/25/26 16:01:28.636 STEP: Creating LocalQueue local-queue in namespace namespace-j9gpz @ 02/25/26 16:01:28.815 STEP: Creating RBAC kueue-batch-admin-role for Visibility API @ 02/25/26 16:01:29 STEP: Creating custom visibility client for ClusterQueue user @ 02/25/26 16:01:29.18 STEP: Getting the PriorityLevelConfiguration and FlowSchema @ 02/25/26 16:01:29.183 STEP: Setting up HTTP header capture @ 02/25/26 16:01:29.513 STEP: Getting the pending workloads for the ClusterQueue API response @ 02/25/26 16:01:29.513 STEP: Extracting response headers from API call @ 02/25/26 16:01:29.677 STEP: Checking that response headers match expected PriorityLevelConfiguration and FlowSchema UIDs for ClusterQueue @ 02/25/26 16:01:29.677 STEP: Getting the pending workloads for the LocalQueue API response @ 02/25/26 16:01:29.677 STEP: Extracting response headers from API call @ 02/25/26 16:01:29.841 STEP: Checking that response headers match expected PriorityLevelConfiguration and FlowSchema UIDs for LocalQueue @ 02/25/26 16:01:29.841 STEP: Deleting ClusterRoleBinding kueue-cluster-role-binding-hmmdb @ 02/25/26 16:01:29.841 STEP: Destroying LocalQueue namespace-j9gpz/local-queue @ 02/25/26 16:01:30.165 STEP: Deleting namespace namespace-j9gpz @ 02/25/26 16:01:30.653 STEP: Destroying ClusterQueue cluster-queue-rktj6 @ 02/25/26 16:01:31.002 STEP: Destroying ResourceFlavor resource-flavor-vjj27 @ 02/25/26 16:01:31.513 • [3.715 seconds] ------------------------------ VisibilityOnDemand when PendingWorkloads list should be checked for LWS workloads Should show pending LWS workloads ordered by priority and admit them sequentially based on resource availability [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:685 STEP: Creating Cluster Resources @ 02/25/26 16:01:31.994 STEP: Creating Namespaces and LocalQueues @ 02/25/26 16:01:32.322 STEP: Creating LocalQueue local-queue-a in namespace namespace-a-2vcd2 @ 02/25/26 16:01:32.489 STEP: Creating LocalQueue local-queue-b in namespace namespace-b-djnqb @ 02/25/26 16:01:32.822 STEP: Creating Priority Classes @ 02/25/26 16:01:32.982 STEP: Creating RBAC kueue-batch-admin-role for Visibility API @ 02/25/26 16:01:33.498 STEP: Creating RBAC kueue-batch-user-role for Visibility API @ 02/25/26 16:01:33.817 STEP: Creating custom visibility client for ClusterQueue access @ 02/25/26 16:01:34.515 STEP: Creating custom visibility client for LocalQueue A access @ 02/25/26 16:01:34.516 STEP: Creating custom visibility client for LocalQueue B access @ 02/25/26 16:01:34.518 STEP: Creating blocker LWS in namespace A @ 02/25/26 16:01:34.519 STEP: verifying workload created in namespace namespace-a-2vcd2 and uid 0dc95532-1db9-4490-a960-6a2dcc39db72 @ 02/25/26 16:01:34.706 STEP: Waiting for blocker LWS pods to be created @ 02/25/26 16:01:35.202 STEP: Creating pending LWS workloads after blocker pods are ready @ 02/25/26 16:01:35.53 STEP: Verifying all pending workloads are created @ 02/25/26 16:01:36.066 STEP: verifying workload is created in namespace namespace-b-djnqb @ 02/25/26 16:01:36.066 STEP: verifying workload is created in namespace namespace-a-2vcd2 @ 02/25/26 16:01:36.239 STEP: verifying workload is created in namespace namespace-a-2vcd2 @ 02/25/26 16:01:36.411 STEP: Checking the pending workloads for cluster queue cluster-queue-swftb @ 02/25/26 16:01:36.613 STEP: Verifying number of pending workloads and their priority ordering for ClusterQueue @ 02/25/26 16:01:36.802 STEP: Checking the pending workloads for local queue local-queue-a in namespace namespace-a-2vcd2 @ 02/25/26 16:01:36.802 STEP: Verifying pending workloads for LocalQueue A @ 02/25/26 16:01:36.965 STEP: Checking the pending workloads for local queue local-queue-b in namespace namespace-b-djnqb @ 02/25/26 16:01:36.966 STEP: Verifying pending workloads for LocalQueue B @ 02/25/26 16:01:37.129 STEP: Deleting blocker LWS to free resources @ 02/25/26 16:01:37.129 STEP: Waiting for blocker LWS deletion and resource release @ 02/25/26 16:01:37.298 STEP: Waiting for blocker LWS pods to be deleted @ 02/25/26 16:01:37.461 STEP: Verifying high priority workload is admitted @ 02/25/26 16:02:41.3 STEP: verifying workload created in namespace namespace-b-djnqb and uid 357740ea-7179-4938-8cf1-1e76f7ba1fb4 @ 02/25/26 16:02:41.3 STEP: Verifying high priority LWS pods are running after admission @ 02/25/26 16:02:41.813 STEP: Verifying medium priority workload is admitted @ 02/25/26 16:02:52.319 STEP: verifying workload created in namespace namespace-a-2vcd2 and uid dba90c06-2202-4105-a747-767f7bb20dff @ 02/25/26 16:02:52.319 STEP: Verifying medium priority LWS pods are running after admission @ 02/25/26 16:02:52.826 STEP: Verifying low priority LWS is still pending @ 02/25/26 16:02:52.988 STEP: Deleting medium priority LWS to free resources for low priority @ 02/25/26 16:02:53.158 STEP: Waiting for medium priority LWS deletion @ 02/25/26 16:02:53.329 STEP: Waiting for medium priority LWS pods to be deleted @ 02/25/26 16:02:53.486 STEP: Verifying low priority workload is admitted @ 02/25/26 16:03:56.408 STEP: verifying workload created in namespace namespace-a-2vcd2 and uid cad6606f-12be-4274-aac7-053b7e2e77ab @ 02/25/26 16:03:56.409 STEP: Verifying low priority LWS pods are running after admission @ 02/25/26 16:03:56.948 STEP: Verifying pending workloads list is empty @ 02/25/26 16:03:57.255 STEP: Deleting RoleBinding kueue-role-binding-7tcwn in namespace namespace-b-djnqb @ 02/25/26 16:03:57.432 STEP: Deleting RoleBinding kueue-role-binding-8d992 in namespace namespace-a-2vcd2 @ 02/25/26 16:03:57.754 STEP: Deleting ClusterRoleBinding kueue-cluster-role-binding-plwqw @ 02/25/26 16:03:58.117 STEP: Deleting PriorityClass priority-class-z2pn6 @ 02/25/26 16:03:58.456 STEP: Deleting PriorityClass priority-class-9nbrx @ 02/25/26 16:03:58.783 STEP: Deleting PriorityClass priority-class-n57rc @ 02/25/26 16:03:59.136 STEP: Destroying LocalQueue namespace-b-djnqb/local-queue-b @ 02/25/26 16:03:59.488 STEP: Deleting namespace namespace-b-djnqb @ 02/25/26 16:04:00.019 STEP: Destroying LocalQueue namespace-a-2vcd2/local-queue-a @ 02/25/26 16:04:41.504 STEP: Deleting namespace namespace-a-2vcd2 @ 02/25/26 16:04:42.009 STEP: Destroying ClusterQueue cluster-queue-swftb @ 02/25/26 16:05:23.583 STEP: Destroying ResourceFlavor resource-flavor-rbrwk @ 02/25/26 16:05:29.276 • [237.828 seconds] ------------------------------ VisibilityOnDemand when JobSet is suspended Should show on pending workloads list for local queue and cluster queue [visibility-on-demand] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_visibility_on_demand_test.go:1020 STEP: Creating Cluster Resources @ 02/25/26 16:05:29.815 STEP: Creating Namespaces and LocalQueues @ 02/25/26 16:05:30.198 STEP: Creating LocalQueue local-queue in namespace test-namespace-kbhdr @ 02/25/26 16:05:30.388 STEP: Creating RBAC kueue-batch-admin-role for Visibility API @ 02/25/26 16:05:30.577 STEP: Creating RBAC kueue-batch-user-role for Visibility API @ 02/25/26 16:05:30.904 STEP: Creating custom visibility client for ClusterQueue access @ 02/25/26 16:05:31.252 STEP: Creating custom visibility client for LocalQueue access @ 02/25/26 16:05:31.256 STEP: Creating custom jobset @ 02/25/26 16:05:31.27 STEP: Verifying all pending workloads are created @ 02/25/26 16:05:31.472 STEP: verifying workload is created in namespace test-namespace-kbhdr @ 02/25/26 16:05:31.472 STEP: Checking the pending workloads for local queue local-queue in namespace test-namespace-kbhdr @ 02/25/26 16:05:31.632 STEP: Verifying pending workloads for LocalQueue @ 02/25/26 16:05:31.808 STEP: Checking the pending workloads for cluster queue cluster-queue-wjr92 @ 02/25/26 16:05:31.808 STEP: Verifying pending workloads for ClusterQueue @ 02/25/26 16:05:31.978 STEP: Destroying Object test-jobset-rrz6p @ 02/25/26 16:05:31.978 STEP: Deleting RoleBinding kueue-role-binding-xrlsb in namespace test-namespace-kbhdr @ 02/25/26 16:05:32.504 STEP: Deleting ClusterRoleBinding kueue-cluster-role-binding-dfl92 @ 02/25/26 16:05:32.828 STEP: Destroying LocalQueue test-namespace-kbhdr/local-queue @ 02/25/26 16:05:33.193 STEP: Deleting namespace test-namespace-kbhdr @ 02/25/26 16:05:33.728 STEP: Destroying ClusterQueue cluster-queue-wjr92 @ 02/25/26 16:05:34.074 STEP: Destroying ResourceFlavor resource-flavor-f5rmt @ 02/25/26 16:05:34.62 • [5.317 seconds] ------------------------------ SSSSSSSSSSSSSSSSSSSS ------------------------------ Gangscheduling when Policy is ByWorkload and Admission is Sequential should apply all-or-nothing admission for workloads [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:81 STEP: Saving initial Kueue configuration @ 02/25/26 16:05:35.134 STEP: Configuring Kueue with gangScheduling: policy=ByWorkload, admission=Sequential @ 02/25/26 16:05:35.289 STEP: Feching Kueue Instance @ 02/25/26 16:05:35.289 STEP: Updating Kueue config @ 02/25/26 16:05:35.777 STEP: Waiting for kueue-controller-manager resource version to change from 78713 @ 02/25/26 16:05:35.956 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 16:05:46.63 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 16:05:57.018 STEP: Waiting for webhook configurations to exist @ 02/25/26 16:05:57.018 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 16:05:57.422 I0225 16:05:57.777942 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-fg9nt I0225 16:05:57.945220 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 16:06:01.309548 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-q9k4c I0225 16:06:01.472586 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 16:06:04.829309 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-6k96b I0225 16:06:05.004773 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Waiting for Kueue configuration to be applied @ 02/25/26 16:06:05.004 STEP: Creating Cluster Resources @ 02/25/26 16:06:05.166 STEP: Creating Namespaces and LocalQueues @ 02/25/26 16:06:05.517 STEP: Creating LocalQueue local-queue in namespace gangscheduling-6zsw2 @ 02/25/26 16:06:05.677 STEP: Admitting a Job that consumes partial quota @ 02/25/26 16:06:05.862 STEP: Verifying first job workload is created and admitted @ 02/25/26 16:06:06.053 STEP: verifying workload created in namespace gangscheduling-6zsw2 and uid 2a01ba62-dc15-4ca0-808e-0ff356a9146c @ 02/25/26 16:06:06.053 [FAILED] in [It] - /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:1637 @ 02/25/26 16:09:06.211 STEP: Restoring initial Kueue configuration @ 02/25/26 16:09:06.212 STEP: Feching Kueue Instance @ 02/25/26 16:09:06.212 STEP: Updating Kueue config @ 02/25/26 16:09:06.695 STEP: Waiting for kueue-controller-manager resource version to change from 83743 @ 02/25/26 16:09:06.878 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 16:09:17.562 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 16:09:27.907 STEP: Waiting for webhook configurations to exist @ 02/25/26 16:09:27.907 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 16:09:28.264 I0225 16:09:28.657972 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-4kvd6 I0225 16:09:28.845985 64690 e2e_operator_test.go:1494] Webhook success 1/3 I0225 16:09:32.206719 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-msc4f I0225 16:09:32.370100 64690 e2e_operator_test.go:1494] Webhook success 2/3 I0225 16:09:35.726414 64690 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-4ttmk I0225 16:09:35.890377 64690 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes I0225 16:09:36.055989 64690 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" STEP: Destroying LocalQueue gangscheduling-6zsw2/local-queue @ 02/25/26 16:09:36.056 STEP: Deleting namespace gangscheduling-6zsw2 @ 02/25/26 16:09:36.57 STEP: Destroying ClusterQueue cluster-queue-h57pp @ 02/25/26 16:09:47.054 STEP: Destroying ResourceFlavor resource-flavor-blpvn @ 02/25/26 16:09:52.741 • [FAILED] [258.130 seconds] Gangscheduling when Policy is ByWorkload and Admission is Sequential [It] should apply all-or-nothing admission for workloads [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:81 [FAILED] Timed out after 180.001s. Expected success, but got an error: <*errors.errorString | 0x140004ce760>: workload gangscheduling-6zsw2/job-job-1-94e4b not admitted or finished { s: "workload gangscheduling-6zsw2/job-job-1-94e4b not admitted or finished", } In [It] at: /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:1637 @ 02/25/26 16:09:06.211 ------------------------------ S [SKIPPED] [0.000 seconds] Gangscheduling when Policy is ByWorkload and Admission is Sequential [It] should admit workloads sequentially even when quota is available [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:157 [SKIPPED] Spec skipped because an earlier spec in an ordered container failed In [It] at: /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:157 @ 02/25/26 16:09:53.253 ------------------------------ S [SKIPPED] [0.000 seconds] Gangscheduling when Policy is ByWorkload and Admission is Parallel [It] should admit workloads in parallel without waiting for pods to be ready [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:273 [SKIPPED] Spec skipped because an earlier spec in an ordered container failed In [It] at: /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:273 @ 02/25/26 16:09:53.253 ------------------------------ Summarizing 1 Failure: [FAIL] Gangscheduling when Policy is ByWorkload and Admission is Sequential [It] should apply all-or-nothing admission for workloads [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_operator_test.go:1637 Ran 31 of 53 Specs in 1737.235 seconds FAIL! -- 30 Passed | 1 Failed | 0 Pending | 22 Skipped You're using deprecated Ginkgo functionality: ============================================= --ginkgo.slow-spec-threshold is deprecated --slow-spec-threshold has been deprecated and will be removed in a future version of Ginkgo. This feature has proved to be more noisy than useful. You can use --poll-progress-after, instead, to get more actionable feedback about potentially slow specs and understand where they might be getting stuck. To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=2.27.2 --- FAIL: TestE2E (1737.24s) FAIL Ginkgo ran 1 suite in 29m4.085506208s Test Suite Failed make: *** [test-e2e] Error 1 ~/Gi/f/kueue-operator/kueue-operator │ disruptive-flake *29 !2 ?2 2 х │ 29m 7s