-
Task
-
Resolution: Done
-
Undefined
-
None
-
None
-
Quality / Stability / Reliability
-
0.42
-
False
-
-
False
-
None
-
-
None
Issue:
In recent 4.18 runs, the test test_create_vm_on_node_without_hpp_pod_and_after_update has been failing consistently.
Environment / Scope:
• The failure could not be reproduced in the PSI environment.
• It only occurs in runs on IBM infrastructure in this lane.
Symptoms:
• The failures appear to be related to a timeout.
Next Steps / Considerations:
• Investigate to confirm if the timeout is caused by slower performance on the IBM cluster.
• If so, decide whether to increase the test timeout or run the test on a faster cluster.
https://jenkins-csb-cnvqe-main.dno.corp.redhat.com/job/test-pytest-cnv-4.18-storage-hppcsiblock/
Failure:
01:29:17 2025-12-11T23:29:17.143867 ocp_resources VirtualMachineInstance INFO Wait for VirtualMachineInstance vm-5717-1765495755-9602263 status to be Running*01:29:17* 2025-12-11T23:29:17.144113 timeout_sampler INFO Waiting for 300 seconds [0:05:00], retry every 1 seconds. (Function: kubernetes.dynamic.client.get Kwargs: {'field_selector': 'metadata.name==vm-5717-1765495755-9602263', 'namespace': 'hpp-test-hpp-node-placement'})01:29:17 2025-12-11T23:29:17.214083 ocp_resources VirtualMachineInstance INFO Status of VirtualMachineInstance vm-5717-1765495755-9602263 is Scheduling*01:34:23* 2025-12-11T23:34:17.376224 ocp_resources VirtualMachineInstance ERROR Status of VirtualMachineInstance vm-5717-1765495755-9602263 is Scheduling*01:34:23* F*01:34:23* TEST: test_create_vm_on_node_without_hpp_pod_and_after_updatehostpath-csi-pvc-block#-updated_hpp_with_node_placement0-cirros_vm_for_node_placement_tests0 STATUS: FAILED*01:34:23* 01:34:23 01:34:23 _ test_create_vm_on_node_without_hpp_pod_and_after_updatehostpath-csi-pvc-block#-updated_hpp_with_node_placement0-cirros_vm_for_node_placement_tests0 01:34:23 Traceback (most recent call last):01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/runner.py", line 344, in from_call*01:34:23* result: TResult | None = func()01:34:23 ^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/runner.py", line 246, in <lambda>01:34:23 lambda: runtest_hook(item=item, *kwds), when=when, reraise=reraise*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_hooks.py", line 512, in __call01:34:23 return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_manager.py", line 120, in _hookexec*01:34:23* return self._inner_hookexec(hook_name, methods, kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 167, in _multicall*01:34:23* raise exception*01:34:23* File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 139, in _multicall*01:34:23* teardown.throw(exception)01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call*01:34:23* return (yield)01:34:23 ^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 139, in _multicall*01:34:23* teardown.throw(exception)01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/skipping.py", line 263, in pytest_runtest_call*01:34:23* return (yield)01:34:23 ^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 121, in _multicall*01:34:23* res = hook_impl.function(args)*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/runner.py", line 178, in pytest_runtest_call*01:34:23* item.runtest()01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/python.py", line 1671, in runtest*01:34:23* self.ihook.pytest_pyfunc_call(pyfuncitem=self)01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_hooks.py", line 512, in __call01:34:23 return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_manager.py", line 120, in _hookexec*01:34:23* return self._inner_hookexec(hook_name, methods, kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 167, in _multicall*01:34:23* raise exception*01:34:23* File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 121, in _multicall*01:34:23* res = hook_impl.function(args)*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/python.py", line 157, in pytest_pyfunc_call*01:34:23* result = testfunction(*testargs)*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/tests/storage/hpp/test_hpp_node_placement.py", line 95, in test_create_vm_on_node_without_hpp_pod_and_after_update*01:34:23* cirros_vm_for_node_placement_tests.vmi.wait_for_status(01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/ocp_resources/resource.py", line 823, in wait_for_status*01:34:23* for sample in samples:01:34:23 ^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/timeout_sampler/init.py", line 179, in __iter01:34:23 raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)01:34:23 timeout_sampler.TimeoutExpiredError: Timed Out: 300*01:34:23* Function: kubernetes.dynamic.client.get Kwargs: {'field_selector': 'metadata.name==vm-5717-1765495755-9602263', 'namespace': 'hpp-test-hpp-node-placement'}01:34:23 Last exception: N/A.01:34:23 2025-12-11 23:34:17,387 INFO sqlalchemy.engine.Engine BEGIN (implicit)01:34:23 Traceback (most recent call last):01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/runner.py", line 344, in from_call*01:34:23* result: TResult | None = func()01:34:23 ^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/runner.py", line 246, in <lambda>01:34:23 lambda: runtest_hook(item=item, *kwds), when=when, reraise=reraise*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_hooks.py", line 512, in __call01:34:23 return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_manager.py", line 120, in _hookexec*01:34:23* return self._inner_hookexec(hook_name, methods, kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 167, in _multicall*01:34:23* raise exception*01:34:23* File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 139, in _multicall*01:34:23* teardown.throw(exception)01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/capture.py", line 900, in pytest_runtest_call*01:34:23* return (yield)01:34:23 ^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 139, in _multicall*01:34:23* teardown.throw(exception)01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/skipping.py", line 263, in pytest_runtest_call*01:34:23* return (yield)01:34:23 ^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 121, in _multicall*01:34:23* res = hook_impl.function(args)*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/runner.py", line 178, in pytest_runtest_call*01:34:23* item.runtest()01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/python.py", line 1671, in runtest*01:34:23* self.ihook.pytest_pyfunc_call(pyfuncitem=self)01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_hooks.py", line 512, in __call01:34:23 return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_manager.py", line 120, in _hookexec*01:34:23* return self._inner_hookexec(hook_name, methods, kwargs, firstresult)01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 167, in _multicall*01:34:23* raise exception*01:34:23* File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 121, in _multicall*01:34:23* res = hook_impl.function(args)*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/_pytest/python.py", line 157, in pytest_pyfunc_call*01:34:23* result = testfunction(*testargs)*01:34:23 ^^^^^^^^^^^^^^^^^^^^^^^^01:34:23 File "/openshift-virtualization-tests/tests/storage/hpp/test_hpp_node_placement.py", line 95, in test_create_vm_on_node_without_hpp_pod_and_after_update*01:34:23* cirros_vm_for_node_placement_tests.vmi.wait_for_status(01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/ocp_resources/resource.py", line 823, in wait_for_status*01:34:23* for sample in samples:01:34:23 ^^^^^^^01:34:23 File "/openshift-virtualization-tests/.venv/lib/python3.12/site-packages/timeout_sampler/init.py", line 179, in __iter_01:34:23 raise TimeoutExpiredError(self._get_exception_log(exp=last_exp), last_exp=last_exp)01:34:23 timeout_sampler.TimeoutExpiredError: Timed Out: 300*01:34:23* Function: kubernetes.dynamic.client.get Kwargs: {'field_selector': 'metadata.name==vm-5717-1765495755-9602263', 'namespace': 'hpp-test-hpp-node-placement'}01:34:23 Last exception: N/A.01:34:23 2025-12-11 23:34:17,388 INFO sqlalchemy.engine.Engine PRAGMA main.table_info("CnvTestTable")