Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-40797

[CNV network tier-2 gating] Debug failure of test_flat_overlay_basic_ping

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • CNV v4.16.0, CNV v4.15.2
    • CNV Network
    • 0.42
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • ---
    • ---
    • CNV-net-QE-252, CNV-net-QE-253
    • No

      test_flat_overlay_basic_ping test fails on all latest gating run in 4.15 and 4.16.
      The failure is always in

      00:42:48    File "/cnv-tests/tests/network/flat_overlay/conftest.py", line 131, in vma_flat_overlay
      00:42:48      yield from create_flat_overlay_vm(
      00:42:48    File "/cnv-tests/tests/network/flat_overlay/utils.py", line 36, in create_flat_overlay_vm
      00:42:48      running_vm(vm=vm, wait_for_cloud_init=True)
      00:42:48    File "/cnv-tests/utilities/virt.py", line 1849, in running_vm
      00:42:48      wait_for_running_vm(
      00:42:48    File "/cnv-tests/utilities/virt.py", line 1776, in wait_for_running_vm
      00:42:48      vm.vmi.wait_until_running(timeout=wait_until_running_timeout)
      00:42:48    File "/cnv-tests/.venv/lib/python3.9/site-packages/ocp_resources/virtual_machine_instance.py", line 125, in wait_until_running
      00:42:48      self.logger.debug(virt_pod.log(container="compute"))
      ...
      00:42:48      raise ApiException(http_resp=r)
      00:42:48  kubernetes.client.exceptions.ApiException: (400)
      00:42:48  Reason: Bad Request
      00:42:48  HTTP response headers: HTTPHeaderDict({'Audit-Id': '3c5c4598-d2cf-44c9-bb23-b5b937f9c9a9', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Date': 'Sat, 13 Apr 2024 21:42:44 GMT', 'Content-Length': '235'})
      00:42:48  HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"container \"compute\" in pod \"virt-launcher-vma-flat-l2-1713044324-3318698-vcxzp\" is waiting to start: PodInitializing","reason":"BadRequest","code":400}
      

      I managed to reproduce the failure, and now debugging it.

              ysegev@redhat.com Yossi Segev
              ysegev@redhat.com Yossi Segev
              Nir Rozen Nir Rozen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: