Uploaded image for project: 'Distributed Tracing'
  1. Distributed Tracing
  2. TRACING-5419

[Upstream] OpenTelemetry Operator fails to create TargetAllocator.

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • None
    • None
    • None
    • Tracing Sprint # 272 - Release

      Description of the problem:

      All target allocator related tests are failing with the latest OpenTelemetry operator built off the upstream main branch. Following errors are observed in operator logs.

      {"level":"ERROR","timestamp":"2025-06-03T08:32:04.809294147Z","logger":"controllers.TargetAllocator","message":"failed to configure desired","targetallocator":{"name":"stateful","namespace":"chainsaw-above-killdeer"},"object_name":"stateful-targetallocator","object_kind":"&TypeMeta{Kind:,APIVersion:,}","error":"services \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>","stacktrace":"github.com/open-telemetry/opentelemetry-operator/internal/controllers.reconcileDesiredObjects\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/common.go:174\ngithub.com/open-telemetry/opentelemetry-operator/internal/controllers.(*TargetAllocatorReconciler).Reconcile\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/targetallocator_controller.go:180\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"}
      {"level":"ERROR","timestamp":"2025-06-03T08:32:04.811325061Z","logger":"controllers.TargetAllocator","message":"failed to configure desired","targetallocator":{"name":"stateful","namespace":"chainsaw-above-killdeer"},"object_name":"stateful-targetallocator","object_kind":"&TypeMeta{Kind:,APIVersion:,}","error":"poddisruptionbudgets.policy \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>","stacktrace":"github.com/open-telemetry/opentelemetry-operator/internal/controllers.reconcileDesiredObjects\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/common.go:174\ngithub.com/open-telemetry/opentelemetry-operator/internal/controllers.(*TargetAllocatorReconciler).Reconcile\n\t/Users/ikanse/opentelemetry-operator/internal/controllers/targetallocator_controller.go:180\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"}
      {"level":"ERROR","timestamp":"2025-06-03T08:32:04.811403453Z","message":"Reconciler error","controller":"targetallocator","controllerGroup":"opentelemetry.io","controllerKind":"TargetAllocator","TargetAllocator":{"name":"stateful","namespace":"chainsaw-above-killdeer"},"namespace":"chainsaw-above-killdeer","name":"stateful","reconcileID":"10e9c9e9-9351-4e38-8506-b279fa181811","error":"failed to create objects for stateful: configmaps \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>\ndeployments.apps \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>\nservices \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>\npoddisruptionbudgets.policy \"stateful-targetallocator\" is forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on: , <nil>","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/Users/ikanse/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"}
      

      Failing tests:

          — FAIL: chainsaw/smoke-deletion (378.65s)

          — FAIL: chainsaw/smoke-targetallocator (374.72s)

          — FAIL: chainsaw/prometheus-config-validation (377.10s)

          — FAIL: chainsaw/targetallocator-prometheuscr (380.76s)

          — FAIL: chainsaw/targetallocator-namespace (466.33s)

          — FAIL: chainsaw/targetallocator-kubernetessd (378.22s)

          — FAIL: chainsaw/create-sm-prometheus-exporters (400.49s)

          — FAIL: chainsaw/target-allocator (370.75s)

          — FAIL: chainsaw/targetallocator-features (735.00s)

          — FAIL: chainsaw/must-gather (375.41s)

      Steps to reproduce the issue:

      *Install the OpenTelemetry Operator OpenShift bundle built off the latest upstream branch.

      *Run any of the Target Allocator tests. 

      chainsaw test tests/e2e/smoke-targetallocator

      *Check that the resource is not created and the operator logs has errors creating the TargetAllocator resource.  

      forbidden: cannot set blockOwnerDeletion if an ownerReference refers to a resource you can't set finalizers on

      Additional notes:

      The TargetAllocator CRD is now enabled in the operator and a targetallocator CR is now created. 

              ploffay@redhat.com Pavol Loffay
              rhn-support-ikanse Ishwar Kanse
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: