Uploaded image for project: 'FlightPath'
  1. FlightPath
  2. FLPATH-2195

[go operator] Day 2 disable serverless operator has projects stuck terminating

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Moderate

      Description of the problem:

      Disabling the serverless operator in the Orchestrator CR after it had been enabled and properly deployed causes some projects to get stuck terminating.

       

      oc get projects | grep -v Active
      NAME                                               DISPLAY NAME   STATUS
      knative-eventing                                                  Terminating
      knative-serving                                                   Terminating
      sonataflow-infra                                                  Terminating
       

      sonataflow-infra project is stuck due to:

        - lastTransitionTime: "2025-03-21T19:21:55Z"
          message: 'Failed to delete all resource types, 1 remaining: Internal error occurred:
            failed calling webhook "validation.webhook.kafka.eventing.knative.dev": failed
            to call webhook: Post "https://kafka-webhook-eventing.knative-eventing.svc:443/resource-validation?timeout=2s":
            service "kafka-webhook-eventing" not found'
          reason: ContentDeletionFailed
          status: "True"
          type: NamespaceDeletionContentFailure 

      knative-eventing

      oc get project knative-eventing -o yaml
      
        - lastTransitionTime: "2025-03-21T19:21:56Z"
          message: 'Some resources are remaining: knativeeventings.operator.knative.dev
            has 1 resource instances'
          reason: SomeResourcesRemain
          status: "True"
          type: NamespaceContentRemaining
        - lastTransitionTime: "2025-03-21T19:21:56Z"
          message: 'Some content in the namespace has finalizers remaining: knative-eventing-openshift
            in 1 resource instances, knativeeventings.operator.knative.dev in 1 resource
            instances'
          reason: SomeFinalizersRemain
          status: "True"
          type: NamespaceFinalizersRemaining
        phase: Terminating
       

      knative-serving

      oc get project knative-serving -o yaml
      
        - lastTransitionTime: "2025-03-21T19:21:56Z"
          message: 'Failed to delete all resource types, 1 remaining: Internal error occurred:
            failed calling webhook "validation.webhook.serving.knative.dev": failed to call
            webhook: Post "https://webhook.knative-serving.svc:443/resource-validation?timeout=10s":
            service "webhook" not found'
          reason: ContentDeletionFailed
          status: "True"
          type: NamespaceDeletionContentFailure
        - lastTransitionTime: "2025-03-21T19:21:56Z"
          message: 'Some resources are remaining: knativeservings.operator.knative.dev has
            1 resource instances'
          reason: SomeResourcesRemain
          status: "True"
          type: NamespaceContentRemaining
        - lastTransitionTime: "2025-03-21T19:21:56Z"
          message: 'Some content in the namespace has finalizers remaining: knative-serving-openshift
            in 1 resource instances, knativeservings.operator.knative.dev in 1 resource
            instances'
          reason: SomeFinalizersRemain
          status: "True"
          type: NamespaceFinalizersRemaining
        phase: Terminating
       

      How reproducible: 100%

      Steps to reproduce:

      1. Deploy go based operator 1.5 latest with serverless and serverless logic operators

      2. Change orchestrator cr to disable the serverless operators

      Actual results:

      Namespaces stuck terminating

      Expected results:

      serverless/serverless logic removed cleanly

              jubah@redhat.com Jennifer Ubah
              chadcrum Chad Crum
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: