Uploaded image for project: 'Knative Serving'
  1. Knative Serving
  2. SRVKS-666

KnativeServing CR reports Ready status too early

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Undefined Undefined
    • 1.12.0
    • 1.8.0
    • None
    • Serverless Sprint 193

      This KnativeServing test failed on Azure:

      knative_serving_test.go:66: Failed to verify default HA settings: unexpected number of replicas: 1, expected: 2
      --- FAIL: TestKnativeServing (71.83s)
       --- PASS: TestKnativeServing/create_subscription_and_wait_for_CSV_to_succeed (20.66s)
       --- PASS: TestKnativeServing/deploy_knativeserving_cr_and_wait_for_it_to_be_ready (50.60s)
       --- FAIL: TestKnativeServing/verify_correct_deployment_shape (0.56s)
        

      [logs|https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-knative-serverless-operator-master-4.5-azure-e2e-azure-ocp-45-continuous/1299859411719688192 ]

      It appears there's a race condition between knative-operator and knative-openshift components. The sequence of events goes like this:

      • knative-operator logs "DeploymentsAvailable","status":"True"" at 00:51:36:
        {"level":"info","ts":"2020-08-30T00:51:36.290Z","logger":"knative-operator","caller":"knativeserving/knativeserving.go:112","msg":"Reconcile stages complete","knative.dev/traceid":"1a799a89-224f-46b3-bc1d-48546c869ae2","knative.dev/key":"knative-serving/knative-serving","status":{"observedGeneration":1,"conditions":[{"type":"DependenciesInstalled","status":"True","lastTransitionTime":"2020-08-30T00:51:02Z"},{"type":"DeploymentsAvailable","status":"True","lastTransitionTime":"2020-08-30T00:51:35Z"},{"type":"InstallSucceeded","status":"True","lastTransitionTime":"2020-08-30T00:51:02Z"},{"type":"Ready","status":"True","lastTransitionTime":"2020-08-30T00:51:35Z"}],"version":"0.15.2"}} 

        logs

      • test fails at 00:51:39.643 (it runs after KnativeServing reports Ready status)
      • knative-operator logs "Dependency installing: Kourier" at 00:51:43: 
        {"level":"info","ts":"2020-08-30T00:51:43.019Z","logger":"knative-operator","caller":"knativeserving/knativeserving.go:93","msg":"Reconciling KnativeServing","knative.dev/traceid":"284a0018-6c78-4a82-832d-56b72a9a58e6","knative.dev/key":"knative-serving/knative-serving","status":{"observedGeneration":1,"conditions":[{"type":"DependenciesInstalled","status":"False","lastTransitionTime":"2020-08-30T00:51:40Z","reason":"Installing","message":"Dependency installing: Kourier"},{"type":"DeploymentsAvailable","status":"True","lastTransitionTime":"2020-08-30T00:51:35Z"}, 

        logs

      • knative-openshift logs Kourier ready at 00:51:48.399Z: 
        {"level":"info","ts":"2020-08-30T00:51:48.399Z","logger":"knative.openshift.kourier","msg":"Kourier is ready"} 

        logs

       

       

       

              markusthoemmes Markus Thömmes (Inactive)
              mgencur Martin Gencur
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: