-
Bug
-
Resolution: Unresolved
-
Undefined
-
None
-
None
-
None
-
False
-
-
False
-
?
-
None
-
-
-
Moderate
I am not sure whether this is a bug or misconfiguration.
This component job failed [1] because the tempest pod was unable to upload an image to glance [2]:
++ openstack image show 11111111-1111-1111-1111-111111111111 -f value -c status Current status: importing. Waiting for image to become active...
According to the glance logs [3], swift failed uploading the image:
2024-12-28 02:38:24.871 24 WARNING glance.async_.taskflow_executor [-] Task 'api_image_import-default_backend-ImportToStore-a8dd8ec7-d6a4-48f3-b4e5-76d94a7bbc68' (9946d8f6-70b5-49a7-b0f2-b94381351bb1) transitioned into state 'FAILURE' from state 'RUNNING' 6 predecessors (most recent first): Flow 'api_image_import-default_backend' |__Flow 'api_image_import' |__Atom 'api_image_import-ConfigureStaging-a8dd8ec7-d6a4-48f3-b4e5-76d94a7bbc68' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {}, 'provides': 'file:///var/lib/glance/os_glance_staging_store/11111111-1111-1111-1111-111111111111'} |__Atom 'api_image_import-ImageLock-a8dd8ec7-d6a4-48f3-b4e5-76d94a7bbc68' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {}, 'provides': None} |__Atom 'api_image_import_retry' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {}, 'provides': [(None, {})]} |__Flow 'api_image_import': glance_store.exceptions.BackendException: Failed to add object to Swift. Got error from Swift: put_object('glance', '11111111-1111-1111-1111-111111111111-00001', ...) failure and no ability to reset contents for reupload..
Swift proxy logs show that the request failed due to 10 seconds timeout [4]:
proxy-server: ERROR with Object server swift-storage-0.swift-storage.openstack.svc:6200/pv re: Trying to get final status of PUT to /v1/AUTH_e2fb08c0346b4ae7b1b0d55112dfde71/glance/11111111-1111-1111-1111-111111111111-00001: Timeout (10.0s) (txn: txf799e20d762d40818e573-00676f648f) (client_ip: 10.217.0.204) proxy-server: Object PUT returning 503 for [503] (txn: txf799e20d762d40818e573-00676f648f) (client_ip: 10.217.0.204)
But swift object-server logs show that uploading the image succeeded after 16.8 seconds [5]:
object-server: 10.217.0.189 - - [28/Dec/2024:02:38:24 +0000] "PUT /pv/361/AUTH_e2fb08c0346b4ae7b1b0d55112dfde71/glance/11111111-1111-1111-1111-111111111111-00001" 201 - "PUT http://swift-internal.openstack.svc:8080/v1/AUTH_e2fb08c0346b4ae7b1b0d55112dfde71/glance/11111111-1111-1111-1111-111111111111-00001" "txf799e20d762d40818e573-00676f648f" "proxy-server 25" 16.8393 "-" 16 0