-
Bug
-
Resolution: Unresolved
-
Minor
-
None
-
rhos-18.0.1
-
None
-
13
-
True
-
-
False
-
?
-
?
-
?
-
?
-
None
-
-
-
PIDONE 18.0.4
-
Moderate
We have a 250 node RHOSO cluster running GA on 3 node masters/worker OCP cluster.
Recently we have scaled default replicas of rabbitmq-cell1-server from 1 to 3, but scaling down replicas from openstack controlplane CR does not have any effect. We have forcefully changed replicas back to 1 in the statefulset which reduced replicas to 1, bug again containers in the remaining replica pod does not come up.
error logs from the pod:
2024-09-18 04:51:45.598431+00:00 [info] <0.245.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> Feature flag `quorum_queue`: migration function crashed: {error,
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> {timeout_waiting_for_tables,
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> ['rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack',
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> 'rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack',
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack'],
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> [rabbit_durable_queue]}}
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> [{rabbit_table,wait,3,[
,{line,121}]},
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0>
,{line,77}]},
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0>
,{line,1602}]},
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0>
,{line,2269}]},
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0> {maps,fold_1,3,[
,{line,410}]},
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0>
,{line,2267}]},
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0>
,{line,2082}]},
2024-09-18 04:52:15.599243+00:00 [error] <0.245.0>
,{line,644}]}]
2024-09-18 04:52:15.599560+00:00 [info] <0.245.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2024-09-18 04:52:45.600333+00:00 [warning] <0.245.0> Error while waiting for Mnesia tables: