-
Bug
-
Resolution: Done
-
Major
-
None
-
None
-
7
-
False
-
-
False
-
?
-
?
-
?
-
?
-
None
-
-
-
Important
The issue was discovered when adding telemetry testing to adoption CI. As part of telemetry tempest tests a stack is created. This works when adopting from standalone, but always fails on adoption from multinode.
heat-engine logs from one of the failed jobs:
https://sf.hosted.upshift.rdu2.redhat.com/logs/79/779/708a73666a8761d8a7e31c9b182a93a4ecf52f8a/check-gitlab-cee/periodic-internal-adoption-multinode-to-crc-ceph-telemetry/98195fb/controller/ci-framework-data/logs/openstack-k8s-operators-openstack-must-gather/namespaces/openstack/pods/heat-engine-657d564b66-vgx8w/logs/heat-engine.log
The traceback:
2024-10-23 01:02:28.732 20 INFO heat.engine.resource [None req-60683d51-3a4a-4e63-b107-a5dcfad37136 tempest-PrometheusGabbiTest-22296581-project-member - - - - -] CREATE: AutoScalingPolicy "web_server_scaleup_policy" Stack "tempest-telemetry-1155478404" [3d82e187-aa30-4757-85cb-14f6a5ba27b8] 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource Traceback (most recent call last): 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/clients/os/keystone/heat_keystoneclient.py", line 148, in domain_admin_auth 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource auth.get_token(self.session) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/keystoneauth1/identity/base.py", line 88, in get_token 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource return self.get_access(session).auth_token 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/keystoneauth1/identity/base.py", line 134, in get_access 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource self.auth_ref = self.get_auth_ref(session) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource return self._plugin.get_auth_ref(session, **kwargs) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource resp = session.post(token_url, json=body, headers=headers, 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 1149, in post 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource return self.request(url, 'POST', **kwargs) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/keystoneauth1/session.py", line 986, in request 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource raise exceptions.from_response(resp, method, url) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-cb0825a7-6162-40d8-9ec2-7923ff0795a8) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource During handling of the above exception, another exception occurred: 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource Traceback (most recent call last): 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/resource.py", line 922, in _action_recorder 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource yield 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/resource.py", line 1034, in _do_action 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource yield from self.action_handler_task(action, args=handler_args) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/resource.py", line 976, in action_handler_task 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource handler_data = handler(*args) 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/resources/openstack/heat/scaling_policy.py", line 127, in handle_create 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource super(AutoScalingPolicy, self).handle_create() 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/resources/stack_user.py", line 30, in handle_create 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource self._create_user() 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/resources/stack_user.py", line 39, in _create_user 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource project_id = self.keystone().create_stack_domain_project( 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/clients/os/keystone/heat_keystoneclient.py", line 447, in create_stack_domain_project 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource domain_project = self.domain_admin_client.projects.create( 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/clients/os/keystone/heat_keystoneclient.py", line 162, in domain_admin_client 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource auth=self.domain_admin_auth, 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource File "/usr/lib/python3.9/site-packages/heat/engine/clients/os/keystone/heat_keystoneclient.py", line 151, in domain_admin_auth 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource raise exception.AuthorizationFailure() 2024-10-23 01:02:28.732 20 ERROR heat.engine.resource heat.common.exception.AuthorizationFailure: Authorization failed.
