When a Revision is supposed to scale down it will wait another 5 minutes before the actual pod is terminated. The 5 minutes come from the defaultTimeoutSeconds settings (https://github.com/knative/serving/blob/release-0.3/pkg/apis/serving/v1alpha1/revision_defaults.go#L21)

This behaviour is fixed on master branch but appears on release-0.3 branch.