❯ ./bin/ginkgo --keep-going --flake-attempts=1 --label-filter="gangscheduling" -v ./test/e2e/... Starting kueue operator suite Running Suite: e2e suite - /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e ============================================================================================ Random Seed: 1772047356 Will run 3 of 53 specs ------------------------------ [BeforeSuite] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_suite_test.go:68 STEP: Deploying Kueue operand for all test suites @ 02/25/26 16:22:42.691 I0225 16:22:42.691629 70766 e2e_operator_test.go:1648] Creating Kueue instance I0225 16:23:14.711715 70766 e2e_operator_test.go:1671] Checking pod: kueue-controller-manager-55cf4f949f-crmqf, phase: Running, deletionTS: I0225 16:23:14.711944 70766 e2e_operator_test.go:1671] Checking pod: kueue-controller-manager-55cf4f949f-l5t68, phase: Running, deletionTS: I0225 16:23:14.711970 70766 e2e_operator_test.go:1671] Checking pod: kueue-controller-manager-857495c88b-z95r7, phase: Running, deletionTS: STEP: Waiting for all Kueue CRDs to be registered @ 02/25/26 16:23:25.215 I0225 16:23:25.214849 70766 e2e_operator_test.go:1671] Checking pod: kueue-controller-manager-55cf4f949f-crmqf, phase: Running, deletionTS: STEP: Waiting for webhook to handle requests successfully @ 02/25/26 16:23:30.042 I0225 16:23:30.042944 70766 e2e_operator_test.go:1739] All 9 Kueue CRDs are registered and established I0225 16:23:30.398406 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-zzqbq I0225 16:23:30.580574 70766 e2e_operator_test.go:1494] Webhook success 1/3 I0225 16:23:33.925007 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-4z7hz I0225 16:23:34.092361 70766 e2e_operator_test.go:1494] Webhook success 2/3 I0225 16:23:37.457760 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-tq97q I0225 16:23:37.625124 70766 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes [BeforeSuite] PASSED [54.942 seconds] ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ Gangscheduling when Policy is ByWorkload and Admission is Sequential should apply all-or-nothing admission for workloads [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:81 STEP: Saving initial Kueue configuration @ 02/25/26 16:23:37.625 STEP: Configuring Kueue with gangScheduling: policy=ByWorkload, admission=Sequential @ 02/25/26 16:23:37.784 STEP: Feching Kueue Instance @ 02/25/26 16:23:37.784 STEP: Updating Kueue config @ 02/25/26 16:23:38.268 STEP: Waiting for kueue-controller-manager resource version to change from 92347 @ 02/25/26 16:23:38.439 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 16:23:49.095 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 16:23:59.534 STEP: Waiting for webhook configurations to exist @ 02/25/26 16:23:59.534 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 16:23:59.873 I0225 16:24:00.267109 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-dgb5k I0225 16:24:00.432235 70766 e2e_operator_test.go:1494] Webhook success 1/3 I0225 16:24:03.792216 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-zbrvd I0225 16:24:03.974058 70766 e2e_operator_test.go:1494] Webhook success 2/3 I0225 16:24:07.344247 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-96nwt I0225 16:24:07.515241 70766 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Waiting for Kueue configuration to be applied @ 02/25/26 16:24:07.515 STEP: Creating Cluster Resources @ 02/25/26 16:24:07.687 STEP: Creating Namespaces and LocalQueues @ 02/25/26 16:24:08.032 STEP: Creating LocalQueue local-queue in namespace gangscheduling-2smws @ 02/25/26 16:24:08.214 STEP: Admitting a Job that consumes partial quota @ 02/25/26 16:24:08.395 STEP: Verifying first job workload is created and admitted @ 02/25/26 16:24:08.59 STEP: verifying workload created in namespace gangscheduling-2smws and uid 5baae37b-adc8-456c-a921-18eb2e132a18 @ 02/25/26 16:24:08.59 STEP: Creating a gang job (parallelism=2) that exceeds remaining quota @ 02/25/26 16:26:12.937 STEP: Verifying the gang job workload is created but NOT admitted (not enough quota for all pods) @ 02/25/26 16:26:13.127 STEP: verifying workload is created in namespace gangscheduling-2smws @ 02/25/26 16:26:13.127 STEP: Waiting for first job to complete and free up quota @ 02/25/26 16:26:18.296 STEP: Verifying the second gang job is now admitted after quota is freed (all pods admitted together) @ 02/25/26 16:26:48.94 STEP: verifying workload created in namespace gangscheduling-2smws and uid 33ecb0da-c712-47ab-b830-4d9917972c2d @ 02/25/26 16:26:48.94 I0225 16:26:49.484453 70766 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" I0225 16:26:49.660032 70766 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" STEP: Destroying LocalQueue gangscheduling-2smws/local-queue @ 02/25/26 16:26:49.66 STEP: Deleting namespace gangscheduling-2smws @ 02/25/26 16:26:50.183 STEP: Destroying ClusterQueue cluster-queue-lg9th @ 02/25/26 16:27:11.555 STEP: Destroying ResourceFlavor resource-flavor-2hz5x @ 02/25/26 16:27:22.463 • [225.360 seconds] ------------------------------ Gangscheduling when Policy is ByWorkload and Admission is Sequential should admit workloads sequentially even when quota is available [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:157 STEP: Creating Cluster Resources with enough quota for multiple jobs @ 02/25/26 16:27:22.977 STEP: Creating Namespace and LocalQueue @ 02/25/26 16:27:23.329 STEP: Creating LocalQueue local-queue in namespace sequential-qn75t @ 02/25/26 16:27:23.51 STEP: Creating the first gang job (parallelism=2) with delayed pod readiness @ 02/25/26 16:27:23.683 STEP: Verifying first gang job workload is admitted @ 02/25/26 16:27:23.877 STEP: verifying workload created in namespace sequential-qn75t and uid fa75e0ff-3042-425c-bee3-8118d796d3ce @ 02/25/26 16:27:23.877 STEP: Creating the second gang job (parallelism=2) while first gang job pods are not yet ready @ 02/25/26 16:27:24.231 STEP: Verifying second gang job is NOT admitted because sequential admission waits for first gang job pods to be ready @ 02/25/26 16:27:24.416 STEP: verifying workload is created in namespace sequential-qn75t @ 02/25/26 16:27:24.416 STEP: Waiting for first gang job pods to complete @ 02/25/26 16:27:29.588 STEP: Verifying second gang job is now admitted after first gang job pods became ready @ 02/25/26 16:28:00.262 STEP: verifying workload created in namespace sequential-qn75t and uid 127ec62d-6883-43d9-a34a-61de50eef989 @ 02/25/26 16:28:00.262 STEP: Restoring initial Kueue configuration @ 02/25/26 16:28:00.612 STEP: Feching Kueue Instance @ 02/25/26 16:28:00.612 STEP: Updating Kueue config @ 02/25/26 16:28:01.134 STEP: Waiting for kueue-controller-manager resource version to change from 92694 @ 02/25/26 16:28:01.309 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 16:28:12.664 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 16:28:23.012 STEP: Waiting for webhook configurations to exist @ 02/25/26 16:28:23.012 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 16:28:23.366 I0225 16:28:23.769855 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-qtblt I0225 16:28:23.945773 70766 e2e_operator_test.go:1494] Webhook success 1/3 I0225 16:28:27.299437 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-rzjvx I0225 16:28:27.467532 70766 e2e_operator_test.go:1494] Webhook success 2/3 I0225 16:28:30.835163 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-4vrj9 I0225 16:28:31.011181 70766 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes I0225 16:28:31.178565 70766 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" I0225 16:28:31.343195 70766 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" STEP: Destroying LocalQueue sequential-qn75t/local-queue @ 02/25/26 16:28:31.343 STEP: Deleting namespace sequential-qn75t @ 02/25/26 16:28:31.843 STEP: Destroying ClusterQueue cluster-queue-s4vt9 @ 02/25/26 16:28:42.486 STEP: Destroying ResourceFlavor resource-flavor-vtdvc @ 02/25/26 16:28:43.013 • [80.535 seconds] ------------------------------ Gangscheduling when Policy is ByWorkload and Admission is Parallel should admit workloads in parallel without waiting for pods to be ready [gangscheduling] /Users/anahas/Github/forks/kueue-operator/kueue-operator/test/e2e/e2e_gangscheduling_test.go:273 STEP: Saving initial Kueue configuration @ 02/25/26 16:28:43.51 STEP: Configuring Kueue with gangScheduling: policy=ByWorkload, admission=Parallel @ 02/25/26 16:28:43.675 STEP: Feching Kueue Instance @ 02/25/26 16:28:43.675 STEP: Updating Kueue config @ 02/25/26 16:28:44.194 STEP: Waiting for kueue-controller-manager resource version to change from 94683 @ 02/25/26 16:28:44.381 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 16:28:55.083 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 16:29:05.428 STEP: Waiting for webhook configurations to exist @ 02/25/26 16:29:05.429 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 16:29:05.77 I0225 16:29:06.146228 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-jg766 I0225 16:29:06.336200 70766 e2e_operator_test.go:1494] Webhook success 1/3 I0225 16:29:09.717997 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-vf7t5 I0225 16:29:09.913788 70766 e2e_operator_test.go:1494] Webhook success 2/3 I0225 16:29:13.263411 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-d2h78 I0225 16:29:13.435374 70766 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes STEP: Waiting for Kueue configuration to be applied @ 02/25/26 16:29:13.435 STEP: Creating Cluster Resources with enough quota for multiple jobs @ 02/25/26 16:29:13.615 STEP: Creating Namespace and LocalQueue @ 02/25/26 16:29:13.951 STEP: Creating LocalQueue local-queue in namespace parallel-ccmxh @ 02/25/26 16:29:14.114 STEP: Creating the first gang job (parallelism=2) with delayed pod readiness @ 02/25/26 16:29:14.283 STEP: Verifying first gang job workload is admitted @ 02/25/26 16:29:14.471 STEP: verifying workload created in namespace parallel-ccmxh and uid 1826ed64-32bc-4e74-8821-2b3ee9c47814 @ 02/25/26 16:29:14.471 STEP: Creating the second gang job (parallelism=2) while first gang job pods are not yet ready @ 02/25/26 16:29:14.801 STEP: Verifying second gang job is admitted immediately despite first gang job pods not being ready (parallel admission) @ 02/25/26 16:29:14.979 STEP: verifying workload created in namespace parallel-ccmxh and uid 408eb449-5725-4b27-9224-013f837fc50c @ 02/25/26 16:29:14.979 STEP: Verifying both gang jobs are admitted together without waiting for pod readiness @ 02/25/26 16:29:15.315 STEP: Restoring initial Kueue configuration @ 02/25/26 16:29:15.485 STEP: Feching Kueue Instance @ 02/25/26 16:29:15.486 STEP: Updating Kueue config @ 02/25/26 16:29:15.817 STEP: Waiting for kueue-controller-manager resource version to change from 95193 @ 02/25/26 16:29:15.987 STEP: Checking if deployment replicas: 3 matches amount of ready replicas: 1 @ 02/25/26 16:29:26.644 STEP: Checking if deployment replicas: 2 matches amount of ready replicas: 2 @ 02/25/26 16:29:36.978 STEP: Waiting for webhook configurations to exist @ 02/25/26 16:29:36.978 STEP: Waiting for webhook to handle requests successfully @ 02/25/26 16:29:37.334 I0225 16:29:37.724513 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-6zrcg I0225 16:29:37.892353 70766 e2e_operator_test.go:1494] Webhook success 1/3 I0225 16:29:41.248362 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-682zw I0225 16:29:41.416022 70766 e2e_operator_test.go:1494] Webhook success 2/3 I0225 16:29:44.769518 70766 e2e_operator_test.go:1482] Webhook test successful, cleaning up test job: webhook-test-wkj9d I0225 16:29:44.948931 70766 e2e_operator_test.go:1491] Webhook stable after 3 consecutive successes I0225 16:29:45.113465 70766 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" I0225 16:29:45.300312 70766 warnings.go:110] "Warning: child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning" STEP: Destroying LocalQueue parallel-ccmxh/local-queue @ 02/25/26 16:29:45.3 STEP: Deleting namespace parallel-ccmxh @ 02/25/26 16:29:45.807 STEP: Destroying ClusterQueue cluster-queue-78974 @ 02/25/26 16:29:56.481 STEP: Destroying ResourceFlavor resource-flavor-b8jh4 @ 02/25/26 16:29:57.031 • [74.192 seconds] ------------------------------ SSSSSSSSSSSSSSSSSSSSSSS Ran 3 of 53 Specs in 435.032 seconds SUCCESS! -- 3 Passed | 0 Failed | 0 Pending | 50 Skipped PASS You're using deprecated Ginkgo functionality: ============================================= --ginkgo.slow-spec-threshold is deprecated --slow-spec-threshold has been deprecated and will be removed in a future version of Ginkgo. This feature has proved to be more noisy than useful. You can use --poll-progress-after, instead, to get more actionable feedback about potentially slow specs and understand where they might be getting stuck. To silence deprecations that can be silenced set the following environment variable: ACK_GINKGO_DEPRECATIONS=2.27.2 Ginkgo ran 1 suite in 7m21.602570084s Test Suite Passed