-
Bug
-
Resolution: Done
-
Blocker
-
None
-
None
-
None
-
Quality / Stability / Reliability
-
1
-
False
-
-
False
-
-
-
Tracing Sprint # 272 - Release
Description of the problem:
All target allocator related tests are failing with the latest OpenTelemetry operator built off the upstream main branch. Following errors are observed in operator logs.
{"level":"ERROR","timestamp":"2025-06-03T08:32:04.809294147Z","logger":"controllers.TargetAllocator","message":"failed to configure desired","targetallocator":{"name":"stateful","namespace":"chainsaw-above-killdeer"},"object_name":"stateful-targetallocator","object_kind":"&TypeMeta{Kind:,APIVersion:,}","error":"services \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>","stacktrace":"github.com/open-telemetry/opentelemetry-operator/internal/controllers.reconcileDesiredObjects\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/common.go:174\ngithub.com/open-telemetry/opentelemetry-operator/internal/controllers.(*TargetAllocatorReconciler).Reconcile\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/targetallocator_controller.go:180\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"ERROR","timestamp":"2025-06-03T08:32:04.811325061Z","logger":"controllers.TargetAllocator","message":"failed to configure desired","targetallocator":{"name":"stateful","namespace":"chainsaw-above-killdeer"},"object_name":"stateful-targetallocator","object_kind":"&TypeMeta{Kind:,APIVersion:,}","error":"poddisruptionbudgets.policy \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>","stacktrace":"github.com/open-telemetry/opentelemetry-operator/internal/controllers.reconcileDesiredObjects\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/common.go:174\ngithub.com/open-telemetry/opentelemetry-operator/internal/controllers.(*TargetAllocatorReconciler).Reconcile\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/targetallocator_controller.go:180\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"ERROR","timestamp":"2025-06-03T08:32:04.811403453Z","message":"Reconciler error","controller":"targetallocator","controllerGroup":"opentelemetry.io","controllerKind":"TargetAllocator","TargetAllocator":{"name":"stateful","namespace":"chainsaw-above-killdeer"},"namespace":"chainsaw-above-killdeer","name":"stateful","reconcileID":"10e9c9e9-9351-4e38-8506-b279fa181811","error":"failed to create objects for stateful: configmaps \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>\ndeployments.apps \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>\nservices \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>\npoddisruptionbudgets.policy \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"}
Failing tests:
— FAIL: chainsaw/smoke-deletion (378.65s)
— FAIL: chainsaw/smoke-targetallocator (374.72s)
— FAIL: chainsaw/prometheus-config-validation (377.10s)
— FAIL: chainsaw/targetallocator-prometheuscr (380.76s)
— FAIL: chainsaw/targetallocator-namespace (466.33s)
— FAIL: chainsaw/targetallocator-kubernetessd (378.22s)
— FAIL: chainsaw/create-sm-prometheus-exporters (400.49s)
— FAIL: chainsaw/target-allocator (370.75s)
— FAIL: chainsaw/targetallocator-features (735.00s)
— FAIL: chainsaw/must-gather (375.41s)
Steps to reproduce the issue:
*Install the OpenTelemetry Operator OpenShift bundle built off the latest upstream branch.
*Run any of the Target Allocator tests.
chainsaw test tests/e2e/smoke-targetallocator
*Check that the resource is not created and the operator logs has errors creating the TargetAllocator resource.
forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on
Additional notes:
The TargetAllocator CRD is now enabled in the operator and a targetallocator CR is now created.