Form Initiator: dtambat@redhat.com

Customer Name: Informationstechnikzentrum Bund

Business Impact:

Customer confirmed major business impact from the unresolved bug:
Scope: 5 clusters (3 production), used by 50+ DevOps teams and 300+ developers/engineers, indirectly affecting ~8000 employees.
Impacts:
Significant time/money loss due to manual cleanup; resource/quota exhaustion causes random team disruptions.
Cluster stability risk: excess pods from undeletable runs risk node/cluster outages (past incidents cited).
Reputational risk: long-standing unresolved bug, repeated manual workarounds, and loss of confidence in OpenShift.
Operational pain: constant manual cleanup, demotivation, wasted resources.
Business functions at risk: All development and production workloads across the organization.
Urgency (Sept 5th deadline): Not tied to an event but reflects urgent need; every day increases dissatisfaction and organizational risk.
Expectation: A clear, concrete fix plan and urgent hotfix by or before Sept 5th.

Escalation Ticket: https://access.redhat.com/watchlist/internal/watchlist/87289

Description:

After Upgrading openshift-pipelines from 1.17.2 to 1.18.1 clients seeing a lot of warning messages in the pipelinerun-controller.

Example:
PipelineRun 1: "Failed to update finalizers for "apd-vu-ocp-versions-pipeline-9553s2": admission webhook "validation.webhook.pipeline.tekton.dev" denied the request: validation failed: invalid value: Once the PipelineRun is complete, no updates are allowed: spec"

The finalizers are not getting removed from the pipelinerun and although there is workaround [1]

[1] Add the label "webhooks.knative.dev/exclude: 'true'" to namespace and remove finalizer from pipelineRun.

As per clients update they constantly need to manually cleanup the cluster. Which is highly demotivating and a waste of money and Resources.