-
Bug
-
Resolution: Done
-
Major
-
1.4.0
-
None
-
Serverless Sprint 181
As reported by Lance on #serverless-dev
a knative service never becomes ready
apiVersion: serving.knative.dev/v1 kind: Service metadata: creationTimestamp: "2020-02-26T17:25:58Z" generation: 1 name: funca namespace: default resourceVersion: "77619" selfLink: /apis/serving.knative.dev/v1/namespaces/default/services/funca uid: 818d9d8d-7c8a-43a9-bbe5-f33fd002e1a8 spec: template: metadata: annotations: client.knative.dev/user-image: docker.io/lanceball/funca:v1 creationTimestamp: null name: funca-dfbnl-1 spec: containers: - image: docker.io/lanceball/funca:v1 name: "" ports: - containerPort: 8080 resources: {} status: conditions: - lastTransitionTime: "2020-02-26T17:26:01Z" status: Unknown type: ConfigurationsReady - lastTransitionTime: "2020-02-26T17:26:01Z" message: Configuration "funca" is waiting for a Revision to become ready. reason: RevisionMissing status: Unknown type: Ready - lastTransitionTime: "2020-02-26T17:26:01Z" message: Configuration "funca" is waiting for a Revision to become ready. reason: RevisionMissing status: Unknown type: RoutesReady latestCreatedRevisionName: funca-dfbnl-1 observedGeneration: 1 url: http://funca.default.apps.lball.rhmw-runtimes.net
The suspicous thing is the timing, as the ksvc was created just before the controller started, so we may have a race there:
2020/02/26 17:25:59 Registering 5 clients
2020/02/26 17:25:59 Registering 3 informer factories
2020/02/26 17:25:59 Registering 13 informers
2020/02/26 17:25:59 Registering 7 controllers
{"level":"info","ts":"2020-02-26T17:25:59.467Z","caller":"logging/config.go:108","msg":"Successfully created the logger."}
{"level":"info","ts":"2020-02-26T17:25:59.467Z","caller":"logging/config.go:109","msg":"Logging level set to info"}
{"level":"info","ts":"2020-02-26T17:25:59.467Z","caller":"logging/config.go:76","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
{"level":"info","ts":"2020-02-26T17:25:59.471Z","logger":"controller.configuration-controller","caller":"configuration/controller.go:49","msg":"Setting up event handlers","knative.dev/controller":"configuration-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.472Z","logger":"controller.labeler-controller","caller":"labeler/controller.go:54","msg":"Setting up event handlers","knative.dev/controller":"labeler-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.493Z","logger":"controller.revision-controller","caller":"revision/controller.go:84","msg":"Setting up event handlers","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.493Z","logger":"controller.route-controller","caller":"route/controller.go:81","msg":"Setting up event handlers","knative.dev/controller":"route-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.493Z","logger":"controller.route-controller","caller":"route/controller.go:118","msg":"Setting up ConfigMap receivers","knative.dev/controller":"route-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.493Z","logger":"controller.serverlessservice-controller","caller":"serverlessservice/controller.go:59","msg":"Setting up event handlers","knative.dev/controller":"serverlessservice-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.494Z","logger":"controller.service-controller","caller":"service/controller.go:58","msg":"Setting up event handlers","knative.dev/controller":"service-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.496Z","logger":"controller.revision-gc-controller","caller":"gc/controller.go:54","msg":"Setting up event handlers","knative.dev/controller":"revision-gc-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.496Z","logger":"controller.revision-gc-controller","caller":"gc/controller.go:67","msg":"Setting up ConfigMap receivers with resync func","knative.dev/controller":"revision-gc-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.496Z","logger":"controller.revision-gc-controller","caller":"gc/controller.go:76","msg":"Setting up ConfigMap receivers","knative.dev/controller":"revision-gc-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.496Z","logger":"controller","caller":"profiling/server.go:60","msg":"Profiling enabled: false"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.revision-controller.config-store","caller":"configmap/store.go:157","msg":"revision config \"config-logging\" config was added or updated: &logging.Config{LoggingConfig:\"{\\n \\\"level\\\": \\\"info\\\",\\n \\\"development\\\": false,\\n \\\"outputPaths\\\": [\\\"stdout\\\"],\\n \\\"errorOutputPaths\\\": [\\\"stderr\\\"],\\n \\\"encoding\\\": \\\"json\\\",\\n \\\"encoderConfig\\\": {\\n \\\"timeKey\\\": \\\"ts\\\",\\n \\\"levelKey\\\": \\\"level\\\",\\n \\\"nameKey\\\": \\\"logger\\\",\\n \\\"callerKey\\\": \\\"caller\\\",\\n \\\"messageKey\\\": \\\"msg\\\",\\n \\\"stacktraceKey\\\": \\\"stacktrace\\\",\\n \\\"lineEnding\\\": \\\"\\\",\\n \\\"levelEncoder\\\": \\\"\\\",\\n \\\"timeEncoder\\\": \\\"iso8601\\\",\\n \\\"durationEncoder\\\": \\\"\\\",\\n \\\"callerEncoder\\\": \\\"\\\"\\n }\\n}\", LoggingLevel:map[string]zapcore.Level{\"activator\":0, \"autoscaler\":0, \"controller\":0, \"queueproxy\":0, \"webhook\":0}}","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.route-controller.config-store","caller":"configmap/store.go:157","msg":"route config \"config-domain\" config was added or updated: &config.Domain{Domains:map[string]*config.LabelSelector{\"apps.lball.rhmw-runtimes.net\":(*config.LabelSelector)(0xc0000107a8)}}","knative.dev/controller":"route-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.revision-controller.config-store","caller":"configmap/store.go:157","msg":"revision config \"config-network\" config was added or updated: &network.Config{IstioOutboundIPRanges:\"172.30.0.0/16\", DefaultIngressClass:\"istio.ingress.networking.knative.dev\", DomainTemplate:\"{{.Name}}.{{.Namespace}}.{{.Domain}}\", TagTemplate:\"{{.Tag}}-{{.Name}}\", AutoTLS:false, HTTPProtocol:\"enabled\", DefaultCertificateClass:\"cert-manager.certificate.networking.internal.knative.dev\"}","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.route-controller.config-store","caller":"configmap/store.go:157","msg":"route config \"config-network\" config was added or updated: &network.Config{IstioOutboundIPRanges:\"172.30.0.0/16\", DefaultIngressClass:\"istio.ingress.networking.knative.dev\", DomainTemplate:\"{{.Name}}.{{.Namespace}}.{{.Domain}}\", TagTemplate:\"{{.Tag}}-{{.Name}}\", AutoTLS:false, HTTPProtocol:\"enabled\", DefaultCertificateClass:\"cert-manager.certificate.networking.internal.knative.dev\"}","knative.dev/controller":"route-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.revision-controller.config-store","caller":"configmap/store.go:157","msg":"revision config \"config-deployment\" config was added or updated: &deployment.Config{QueueSidecarImage:\"registry.redhat.io/openshift-serverless-1-tech-preview/serving-queue-rhel8@sha256:f9ea8bd70789e67ff00cc134cd966fda8d9e7a764926551d650acc71776db73c\", RegistriesSkippingTagResolving:sets.String{\"dev.local\":sets.Empty{}, \"ko.local\":sets.Empty{}}}","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.revision-controller.config-store","caller":"configmap/store.go:157","msg":"revision config \"config-tracing\" config was added or updated: &config.Config{Backend:\"none\", ZipkinEndpoint:\"\", StackdriverProjectID:\"\", Debug:false, SampleRate:0.1}","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.revision-controller.config-store","caller":"configmap/store.go:157","msg":"revision config \"config-defaults\" config was added or updated: &config.Defaults{RevisionTimeoutSeconds:300, MaxRevisionTimeoutSeconds:600, UserContainerNameTemplate:\"user-container\", ContainerConcurrency:0, RevisionCPURequest:(*resource.Quantity)(0xc0006735c0), RevisionCPULimit:(*resource.Quantity)(0xc000673640), RevisionMemoryRequest:(*resource.Quantity)(0xc000673600), RevisionMemoryLimit:(*resource.Quantity)(0xc000673680)}","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.revision-controller.config-store","caller":"configmap/store.go:157","msg":"revision config \"config-observability\" config was added or updated: &metrics.ObservabilityConfig{EnableVarLogCollection:false, LoggingURLTemplate:\"http://localhost:8001/api/v1/namespaces/knative-monitoring/services/kibana-logging/proxy/app/kibana#/discover?_a=(query:(match:(kubernetes.labels.knative-dev%2FrevisionUID:(query:'${REVISION_UID}',type:phrase))))\", RequestLogTemplate:\"\", EnableProbeRequestLog:false, RequestMetricsBackend:\"prometheus\", EnableProfiling:false}","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller","caller":"metrics/exporter.go:99","msg":"Flushing the existing exporter before setting up the new exporter."}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller","caller":"metrics/prometheus_exporter.go:37","msg":"Created Opencensus Prometheus exporter with config: &{knative.dev/internal/serving controller prometheus 5000000000 <nil> 9090 false { false}}. Start the server for Prometheus exporter."}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller","caller":"metrics/exporter.go:108","msg":"Successfully updated the metrics exporter; old config: <nil>; new config &{knative.dev/internal/serving controller prometheus 5000000000 <nil> 9090 false { false}}"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.route-controller.config-store","caller":"configmap/store.go:157","msg":"route config \"config-gc\" config was added or updated: &gc.Config{StaleRevisionCreateDelay:86400000000000, StaleRevisionTimeout:54000000000000, StaleRevisionMinimumGenerations:1, StaleRevisionLastpinnedDebounce:18000000000000}","knative.dev/controller":"route-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.524Z","logger":"controller.revision-gc-controller.config-store","caller":"configmap/store.go:157","msg":"configuration config \"config-gc\" config was added or updated: &gc.Config{StaleRevisionCreateDelay:86400000000000, StaleRevisionTimeout:54000000000000, StaleRevisionMinimumGenerations:1, StaleRevisionLastpinnedDebounce:18000000000000}","knative.dev/controller":"revision-gc-controller"}
{"level":"info","ts":"2020-02-26T17:25:59.612Z","logger":"controller","caller":"sharedmain/main.go:189","msg":"Starting informers."}
{"level":"info","ts":"2020-02-26T17:25:59.668Z","logger":"controller.serverlessservice-controller","caller":"serverlessservice/controller.go:80","msg":"Doing a global resync due to activator endpoint changes","knative.dev/controller":"serverlessservice-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller","caller":"sharedmain/main.go:195","msg":"Starting controllers..."}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.revision-gc-controller","caller":"controller/controller.go:305","msg":"Starting controller and workers","knative.dev/controller":"revision-gc-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.revision-gc-controller","caller":"controller/controller.go:315","msg":"Started workers","knative.dev/controller":"revision-gc-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.configuration-controller","caller":"controller/controller.go:305","msg":"Starting controller and workers","knative.dev/controller":"configuration-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.configuration-controller","caller":"controller/controller.go:315","msg":"Started workers","knative.dev/controller":"configuration-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.labeler-controller","caller":"controller/controller.go:305","msg":"Starting controller and workers","knative.dev/controller":"labeler-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.labeler-controller","caller":"controller/controller.go:315","msg":"Started workers","knative.dev/controller":"labeler-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.revision-controller","caller":"controller/controller.go:305","msg":"Starting controller and workers","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.revision-controller","caller":"controller/controller.go:315","msg":"Started workers","knative.dev/controller":"revision-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.route-controller","caller":"controller/controller.go:305","msg":"Starting controller and workers","knative.dev/controller":"route-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.route-controller","caller":"controller/controller.go:315","msg":"Started workers","knative.dev/controller":"route-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.serverlessservice-controller","caller":"controller/controller.go:305","msg":"Starting controller and workers","knative.dev/controller":"serverlessservice-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.serverlessservice-controller","caller":"controller/controller.go:315","msg":"Started workers","knative.dev/controller":"serverlessservice-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.service-controller","caller":"controller/controller.go:305","msg":"Starting controller and workers","knative.dev/controller":"service-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.639Z","logger":"controller.service-controller","caller":"controller/controller.go:315","msg":"Started workers","knative.dev/controller":"service-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.808Z","logger":"controller.service-controller.event-broadcaster","caller":"record/event.go:258","msg":"Event(v1.ObjectReference{Kind:\"Service\", Namespace:\"default\", Name:\"funca\", UID:\"818d9d8d-7c8a-43a9-bbe5-f33fd002e1a8\", APIVersion:\"serving.knative.dev/v1alpha1\", ResourceVersion:\"77544\", FieldPath:\"\"}): type: 'Normal' reason: 'Created' Created Configuration \"funca\"","knative.dev/controller":"service-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.826Z","logger":"controller.revision-gc-controller","caller":"controller/controller.go:370","msg":"Reconcile succeeded. Time taken: 91.409µs.","knative.dev/controller":"revision-gc-controller","knative.dev/traceid":"b6533bc5-58c6-4e01-af41-cd10928323e0","knative.dev/key":"default/funca"}
{"level":"info","ts":"2020-02-26T17:26:01.847Z","logger":"controller.service-controller.event-broadcaster","caller":"record/event.go:258","msg":"Event(v1.ObjectReference{Kind:\"Service\", Namespace:\"default\", Name:\"funca\", UID:\"818d9d8d-7c8a-43a9-bbe5-f33fd002e1a8\", APIVersion:\"serving.knative.dev/v1alpha1\", ResourceVersion:\"77544\", FieldPath:\"\"}): type: 'Normal' reason: 'Updated' Updated Service \"funca\"","knative.dev/controller":"service-controller"}
{"level":"info","ts":"2020-02-26T17:26:01.860Z","logger":"controller.revision-gc-controller","caller":"controller/controller.go:370","msg":"Reconcile succeeded. Time taken: 73.427µs.","knative.dev/controller":"revision-gc-controller","knative.dev/traceid":"fab76427-b7e4-4045-87c2-a37c537f6775","knative.dev/key":"default/funca"}
{"level":"info","ts":"2020-02-26T17:26:01.861Z","logger":"controller.configuration-controller","caller":"configuration/configuration.go:339","msg":"Created Revision: &v1alpha1.Revision{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"funca-dfbnl-1\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"/apis/serving.knative.dev/v1alpha1/namespaces/default/revisions/funca-dfbnl-1\", UID:\"f384f05d-6aa2-47e8-8542-f334a3663516\", ResourceVersion:\"77607\", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63718334761, loc:(*time.Location)(0x2c07a40)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{\"serving.knative.dev/configuration\":\"funca\", \"serving.knative.dev/configurationGeneration\":\"1\", \"serving.knative.dev/service\":\"funca\"}, Annotations:map[string]string{\"client.knative.dev/user-image\":\"docker.io/lanceball/funca:v1\"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:\"serving.knative.dev/v1alpha1\", Kind:\"Configuration\", Name:\"funca\", UID:\"1ba5a5a8-04f1-4ccd-9dca-734f18a6c0e4\", Controller:(*bool)(0xc001332570), BlockOwnerDeletion:(*bool)(0xc00133256f)}}, Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1alpha1.RevisionSpec{RevisionSpec:v1.RevisionSpec{PodSpec:v1.PodSpec{Volumes:[]v1.Volume(nil), InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:\"user-container\", Image:\"docker.io/lanceball/funca:v1\", Command:[]string(nil), Args:[]string(nil), WorkingDir:\"\", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:\"\", HostPort:0, ContainerPort:8080, Protocol:\"\", HostIP:\"\"}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount(nil), VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(0xc00133a9f0), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:\"\", TerminationMessagePolicy:\"\", ImagePullPolicy:\"\", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, RestartPolicy:\"\", TerminationGracePeriodSeconds:(*int64)(nil), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:\"\", NodeSelector:map[string]string(nil), ServiceAccountName:\"\", DeprecatedServiceAccount:\"\", AutomountServiceAccountToken:(*bool)(nil), NodeName:\"\", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(nil), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:\"\", Subdomain:\"\", Affinity:(*v1.Affinity)(nil), SchedulerName:\"\", Tolerations:[]v1.Toleration(nil), HostAliases:[]v1.HostAlias(nil), PriorityClassName:\"\", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil)}, ContainerConcurrency:(*int64)(0xc0013325b0), TimeoutSeconds:(*int64)(0xc001332620)}, DeprecatedGeneration:0, DeprecatedServingState:\"\", DeprecatedConcurrencyModel:\"\", DeprecatedBuildName:\"\", DeprecatedBuildRef:(*v1.ObjectReference)(nil), DeprecatedContainer:(*v1.Container)(nil)}, Status:v1alpha1.RevisionStatus{Status:v1.Status{ObservedGeneration:0, Conditions:v1.Conditions(nil)}, ServiceName:\"\", LogURL:\"\", ImageDigest:\"\"}}","knative.dev/controller":"configuration-controller","knative.dev/traceid":"68bf6fab-2083-4a46-977f-41b3d48f5840","knative.dev/key":"default/funca"}
{"level":"info","ts":"2020-02-26T17:26:01.861Z","logger":"controller.configuration-controller","caller":"configuration/configuration.go:169","msg":"Revision \"funca-dfbnl-1\" of configuration is not ready","knative.dev/controller":"configuration-controller","knative.dev/traceid":"68bf6fab-2083-4a46-977f-41b3d48f5840","knative.dev/key":"default/funca"}
{"level":"error","ts":"2020-02-26T17:26:01.866Z","logger":"controller.service-controller","caller":"controller/controller.go:376","msg":"Reconcile error","knative.dev/controller":"service-controller","error":"the server rejected our request due to an error in our request","stacktrace":"knative.dev/serving/vendor/knative.dev/pkg/controller.(*Impl).handleErr\n\t/opt/app-root/src/go/src/knative.dev/serving/vendor/knative.dev/pkg/controller/controller.go:376\nknative.dev/serving/vendor/knative.dev/pkg/controller.(*Impl).processNextWorkItem\n\t/opt/app-root/src/go/src/knative.dev/serving/vendor/knative.dev/pkg/controller/controller.go:362\nknative.dev/serving/vendor/knative.dev/pkg/controller.(*Impl).Run.func2\n\t/opt/app-root/src/go/src/knative.dev/serving/vendor/knative.dev/pkg/controller/controller.go:310"}
{"level":"info","ts":"2020-02-26T17:26:01.866Z","logger":"controller.service-controller","caller":"controller/controller.go:363","msg":"Reconcile failed. Time taken: 226.523486ms.","knative.dev/controller":"service-controller","knative.dev/traceid":"704f4ad3-5f5d-4526-921d-cbbf43a8738a","knative.dev/key":"default/funca"}
{"level":"info","ts":"2020-02-26T17:26:01.869Z","logger":"controller.revision-controller","caller":"revision/revision.go:84","msg":"Running reconcile Revision","knative.dev/controller":"revision-controller","knative.dev/traceid":"8e292182-2a06-4ffc-ad1e-a4ac54e72e94","knative.dev/key":"default/funca-dfbnl-1"}
{"level":"info","ts":"2020-02-26T17:26:01.870Z","logger":"controller.configuration-controller.event-broadcaster","caller":"record/event.go:258","msg":"Event(v1.ObjectReference{Kind:\"Configuration\", Namespace:\"default\", Name:\"funca\", UID:\"1ba5a5a8-04f1-4ccd-9dca-734f18a6c0e4\", APIVersion:\"serving.knative.dev/v1alpha1\", ResourceVersion:\"77602\", FieldPath:\"\"}): type: 'Normal' reason: 'Created' Created Revision \"funca-dfbnl-1\"","knative.dev/controller":"configuration-controller"}
{"level":"error","ts":"2020-02-26T17:26:01.885Z","logger":"controller.service-controller","caller":"controller/controller.go:376","msg":"Reconcile error","knative.dev/controller":"service-controller","error":"the server rejected our request due to an error in our request","stacktrace":"knative.dev/serving/vendor/knative.dev/pkg/controller.(*Impl).handleErr\n\t/opt/app-root/src/go/src/knative.dev/serving/vendor/knative.dev/pkg/controller/controller.go:376\nknative.dev/serving/vendor/knative.dev/pkg/controller.(*Impl).processNextWorkItem\n\t/opt/app-root/src/go/src/knative.dev/serving/vendor/knative.dev/pkg/controller/controller.go:362\nknative.dev/serving/vendor/knative.dev/pkg/controller.(*Impl).Run.func2\n\t/opt/app-root/src/go/src/knative.dev/serving/vendor/knative.dev/pkg/controller/controller.go:310"}
{"level":"info","ts":"2020-02-26T17:26:01.885Z","logger":"controller.service-controller","caller":"controller/controller.go:363","msg":"Reconcile failed. Time taken: 19.129172ms.","knative.dev/controller":"service-controller","knative.dev/traceid":"1d7c3c20-d47c-482b-88dd-72c4c82d9af7","knative.dev/key":"default/funca"}