-
Bug
-
Resolution: Done
-
Undefined
-
1.5.0
-
None
-
Serverless Sprint 181
After deleting KnativeServing.operator.knative.dev from knative-serving, the deletion is (sometimes) stuck
The knative-openshift-ingress logs shows:
"level":"info","ts":1583849975.271852,"logger":"fallback","caller":"common/reconciler.go:168","msg":"Created OpenShift Route \"route-6406eac7-25b8-45a8-a5f2-f77b82e93c8d-653636353630\" in namespace \"knative-serving-ingress\""}
{"level":"info","ts":1583849975.2718828,"logger":"fallback","caller":"common/reconciler.go:77","msg":"Ingress successfully synced"}
W0310 14:29:36.689100 1 reflector.go:270] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: watch of *v1.Route ended with: The resourceVersion for the provided watch is too old.
W0310 14:39:37.808858 1 reflector.go:270] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: watch of *v1.Route ended with: The resourceVersion for the provided watch is too old.
{"level":"info","ts":1583851249.3401232,"logger":"fallback","caller":"common/reconciler.go:129","msg":"Deleting OpenShift Route for host helloworld-go.foobar.apps.maschmid1.openshift-aws.rhocf-dev.net"}
{"level":"info","ts":1583851249.3545096,"logger":"fallback","caller":"common/reconciler.go:133","msg":"Deleted OpenShift Route \"route-6406eac7-25b8-45a8-a5f2-f77b82e93c8d-653636353630\" in namespace \"knative-serving-ingress\""}
{"level":"info","ts":1583851249.3545437,"logger":"fallback","caller":"common/reconciler.go:212","msg":"Removing finalizer for ingress %qhelloworld-go"}
E0310 14:40:52.716546 1 reflector.go:251] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to watch *v1alpha1.Ingress: the server could not find the requested resource (get ingresses.networking.internal.knative.dev)
E0310 14:40:53.718313 1 reflector.go:134] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to list *v1alpha1.Ingress: the server could not find the requested resource (get ingresses.networking.internal.knative.dev)
E0310 14:40:54.719983 1 reflector.go:134] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to list *v1alpha1.Ingress: the server could not find the requested resource (get ingresses.networking.internal.knative.dev)
E0310 14:40:55.721571 1 reflector.go:134] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to list *v1alpha1.Ingress: the server could not find the requested resource (get ingresses.networking.internal.knative.dev)
E0310 14:40:56.722945 1 reflector.go:134] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to list *v1alpha1.Ingress: the server could not find the requested resource (get ingresses.networking.internal.knative.dev)
E0310 14:40:57.724448 1 reflector.go:134] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to list *v1alpha1.Ingress: the server could not find the requested resource (get ingresses.networking.internal.knative.dev)
E0310 14:40:58.725883 1 reflector.go:134] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to list *v1alpha1.Ingress: the server could not find the requested resource (get ingresses.networking.internal.knative.dev)
...
Which suggests a race between the CRDs being deleted and the knative-openshift-ingress removing finalizers.
The KnativeServing is still having the knative-serving-openshift finalizer (after running oc delete on it, which hangs)
apiVersion: operator.knative.dev/v1alpha1 kind: KnativeServing metadata: creationTimestamp: "2020-03-10T13:04:11Z" deletionGracePeriodSeconds: 0 deletionTimestamp: "2020-03-10T14:40:48Z" finalizers: - knative-serving-openshift generation: 2 name: knative-serving namespace: knative-serving resourceVersion: "235000" selfLink: /apis/operator.knative.dev/v1alpha1/namespaces/knative-serving/knativeservings/knative-serving uid: 27697a15-813f-45a1-9e27-fffea33f71eb spec: cluster-local-gateway: {} config: deployment: queueSidecarImage: image-registry.openshift-image-registry.svc:5000/openshift-serverless-1-tech-preview/serving-queue-rhel8@sha256:63d3b837aacbec5967063be5eada4ab65b733f0dba088a6f9c518c5c1b409c9a domain: apps.maschmid1.openshift-aws.rhocf-dev.net: "" network: ingress.class: kourier.ingress.networking.knative.dev istio.sidecar.includeOutboundIPRanges: 172.30.0.0/16 controller-custom-certs: name: config-service-ca type: ConfigMap knative-ingress-gateway: {} registry: override: 3scale-kourier-control: markusthoemmes/3scale-kourier:fixeroo 3scale-kourier-gateway: image-registry.openshift-image-registry.svc:5000/openshift-service-mesh/proxyv2-rhel8@sha256:be1e61060e5663bc628147a1a56e16dd1fdba7a0f200eda75c6d997c18e15306 activator: image-registry.openshift-image-registry.svc:5000/openshift-serverless-1-tech-preview/serving-activator-rhel8@sha256:b0c7030f235ec828a975ecc990e34ae2dc3bf88188c1f243f5568bd1a749c0e9 autoscaler: image-registry.openshift-image-registry.svc:5000/openshift-serverless-1-tech-preview/serving-autoscaler-rhel8@sha256:2a3dade388c15f6c839b4e746e2ae80bc4a22c727a01d5c2d3f06609b234c08f autoscaler-hpa: image-registry.openshift-image-registry.svc:5000/openshift-serverless-1-tech-preview/serving-autoscaler-hpa-rhel8@sha256:98a68724567a8f6737223d5edccfd4021312649338c63742b6ccf1c08c89aabc controller: image-registry.openshift-image-registry.svc:5000/openshift-serverless-1-tech-preview/serving-controller-rhel8@sha256:e655d181bb8b50114f133c86cea6aaf1d1f6e00b848aaa6b94e0efdba2642959 queue-proxy: image-registry.openshift-image-registry.svc:5000/openshift-serverless-1-tech-preview/serving-queue-rhel8@sha256:63d3b837aacbec5967063be5eada4ab65b733f0dba088a6f9c518c5c1b409c9a webhook: image-registry.openshift-image-registry.svc:5000/openshift-serverless-1-tech-preview/serving-webhook-rhel8@sha256:a3dd1619be816b6cc673ed4e3a610ae6832a1216841258356ce36687c90fb7f1 status: conditions: - lastTransitionTime: "2020-03-10T13:04:25Z" status: "True" type: DependenciesInstalled - lastTransitionTime: "2020-03-10T13:04:47Z" status: "True" type: DeploymentsAvailable - lastTransitionTime: "2020-03-10T13:04:37Z" status: "True" type: InstallSucceeded - lastTransitionTime: "2020-03-10T13:04:47Z" status: "True" type: Ready version: 0.12.1
