Failovers in 2-way Federated HA Broker Pairs Result in Phantom or Missing Consumers

Configure a shared-store ha broker pair using the attached configuration. Configure 20 queues for each broker Configure a second shared-store ha broker pair separated from the first pair over a network with the same queue configuration as the first pair Configure an upstream queue federation on each broker in the 2 pairs Start up the master and backup brokers in each pair. Start 1 (ha) consumer for each queue on each end of the federated cluster, for a total of 40 consumers (20 on each end) Stop and restart the primary broker at each end of the cluster in turn, checking the consumer count on the live brokers at each end after each failover. Eventually you see a state where one of the live brokers is reporting extra consumers or missing consumers. This persists until the next failover event.