-
Sub-task
-
Resolution: Done
-
Normal
-
None
-
None
-
3
-
False
-
-
False
-
None
-
Unset
-
-
The long term plan for KIC is to deploy the service with at least 3 replicas and 3 partitions to ensure each replica actively consumes messages. we will need to validate both the migration process and the outbox process properly handles sharding the messages to all consumers and that all messages for a single host id are always sent to the same consumer
Given: KIC is deployed with 3 replicas, the migration and outbox topics are both set for 3 partitions When: The consumer pods are started Then: each pod is assigned 1 partition for each topic (total 2 partitions each)
Given: Multiple messages are produced to either the migration or outbox topic When: Kafka broker sends the message to partition X Then: a single consumer that is assigned to partition X processes the message
Given: Multiple messages are produced to either the migration or outbox topic for the same HBI Host ID When: The HBI host ID is included in the message key Then: a single consumer that is assigned to the partition for that key processes the message to ensure ordering