Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-10977

python-whitebox-tempest failure test_validate_dvr_connectivity_live_migration_different_networks

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • rhos-18.0.4
    • None
    • neutron-operator
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • ?
    • ?
    • ?
    • ?
    • None
    • Moderate

      The test "test_validate_dvr_connectivity_live_migration_different_networks" seems flaky as it may fail quite regularly due to VM not being able to migrate. 

      This shouldn't be a problem regarding computes nodes being full as it's executed on single-thread tempest pod.

      This failure can be observe on:

      • Oct-25 "component-network-edpm-update-rhel9-rhoso18.0-crc" run [0]
      • Oct-23 on same job [1] 
      • Oct-22 on same job [2]

      It failed on 3 out of the 4 runs.

      This problem was discussed on slack with Gibi [3]. And it seems like VM was spawned on `compute-0`and was migrated to `compute-0`.

      All of the shown errors, the problem was the same, spawned on compute-0, migrated to compute-0. Looking closer to a test that did pass, it can be observed that the VM was spawned on compute-1 [4]:

              Body: b'{"server": {"id": "fe84bbc8-feb8-4ab6-aa24-5cabfd3ffae2", "name": "tempest-server-test-1736475892", "status": "ACTIVE", "tenant_id": "01f8724fbb3d45458f629de13693d999", "user_id": "094bfd917d0642c2b728f78d21fe6b29", "metadata": {}, "hostId": "3fd02a4c18348bfc3b3014adb57ae07e8226c0854f67a490f3476c3a", "image": {"id": "095466f7-1d53-4d26-a199-0715af634576", "links": [{"rel": "bookmark", "href": "https://nova-public-openstack.apps-crc.testing/images/095466f7-1d53-4d26-a199-0715af634576"}]}, "flavor": {"vcpus": 1, "ram": 128, "disk": 1, "ephemeral": 0, "swap": 0, "original_name": "m1.nano", "extra_specs": {"hw_rng:allowed": "True"}}, "created": "2024-10-24T04:32:41Z", "updated": "2024-10-24T04:32:46Z", "addresses": {"tempest-test-network--1066492869": [{"version": 4, "addr": "10.100.0.46", "OS-EXT-IPS:type": "fixed", "OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:7a:6f:04"}]}, "accessIPv4": "", "accessIPv6": "", "links": [{"rel": "self", "href": "https://nova-public-openstack.apps-crc.testing/v2.1/servers/fe84bbc8-feb8-4ab6-aa24-5cabfd3ffae2"}, {"rel": "bookmark", "href": "https://nova-public-openstack.apps-crc.testing/servers/fe84bbc8-feb8-4ab6-aa24-5cabfd3ffae2"}], "OS-DCF:diskConfig": "MANUAL", "progress": 0, "OS-EXT-AZ:availability_zone": "nova", "config_drive": "True", "key_name": "tempest-keypair-test-1586789850", "OS-SRV-USG:launched_at": "2024-10-24T04:32:47.000000", "OS-SRV-USG:terminated_at": null, "security_groups": [{"name": "tempest-secgroup-196995688"}], "OS-EXT-SRV-ATTR:host": "compute-1.ctlplane.example.com", "OS-EXT-SRV-ATTR:instance_name": "instance-00000110", "OS-EXT-SRV-ATTR:hypervisor_hostname": "compute-1.ctlplane.example.com", "OS-EXT-SRV-ATTR:reservation_id": "r-32rni0dz", "OS-EXT-SRV-ATTR:launch_index": 0, "OS-EXT-SRV-ATTR:hostname": "tempest-server-test-1736475892", "OS-EXT-SRV-ATTR:kernel_id": "", "OS-EXT-SRV-ATTR:ramdisk_id": "", "OS-EXT-SRV-ATTR:root_device_name": "/dev/vda", "OS-EXT-SRV-ATTR:user_data": null, "OS-EXT-STS:task_state": null, "OS-EXT-STS:vm_state": "active", "OS-EXT-STS:power_state": 1, "os-extended-volumes:volumes_attached": [], "host_status": "UP", "locked": false, "locked_reason": null, "description": null, "tags": [], "trusted_image_certificates": null, "server_groups": []}}' _log_request_full /var/lib/tempest/external-plugins/.venv/lib64/python3.9/site-packages/tempest/lib/common/rest_client.py:484
       

      "OS-EXT-SRV-ATTR:hypervisor_hostname": "compute-1.ctlplane.example.com".

       

      [0] https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-network/gitlab.cee.redhat.com/ci-framework/ci-framework-jobs/main/component-network-edpm-update-rhel9-rhoso18.0-crc/5806270/controller/ci-framework-data/tests/test_operator/tempest-tests-single-thread-testing-workflow-step-1/stestr_results.html

      [1] https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-network/gitlab.cee.redhat.com/ci-framework/ci-framework-jobs/main/component-network-edpm-update-rhel9-rhoso18.0-crc/9a42bc3/controller/ci-framework-data/tests/test_operator/tempest-tests-single-thread-testing-workflow-step-1/stestr_results.html

      [2] https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-network/gitlab.cee.redhat.com/ci-framework/ci-framework-jobs/main/component-network-edpm-update-rhel9-rhoso18.0-crc/472e0d8/controller/ci-framework-data/tests/test_operator/tempest-tests-single-thread-testing-workflow-step-1/stestr_results.html

      [3] https://redhat-internal.slack.com/archives/C04FMFMFFRC/p1729682242965209 

      [4] https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-network/gitlab.cee.redhat.com/ci-framework/ci-framework-jobs/main/component-network-edpm-update-rhel9-rhoso18.0-crc/4291c79/controller/ci-framework-data/tests/test_operator/tempest-tests-single-thread-testing-workflow-step-1/tempest.log 
      PS: is assigned to neutron-operator as I don't see anything tempest related

              averdagu@redhat.com Arnau Verdaguer Puigdollers
              averdagu@redhat.com Arnau Verdaguer Puigdollers
              rhos-dfg-networking-squad-neutron
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: