-
Spike
-
Resolution: Won't Do
-
Major
-
None
-
None
-
False
-
None
-
False
-
No
-
MGDSRVS-48 - Be able to sustain an external paying customer in production
-
---
-
---
WHAT
Kafka broker default the config `num.replica.fetchers` to 1, which means if the broker has many followers needed to replicate data from the leader, it'll be queuing in the only one thread.
WHY
Improve the followers fetch performance
HOW
Run benchmark tests to find out the best configuration for RHOSAK
DONE
1. Add the new `num.replica.fetchers` number as the default broker config in fleetshard
2. Document the findings, ex: the performance gains
- depends on
-
MGDSTRM-9540 Write replication perf test
- Closed
- is depended on by
-
MGDSTRM-9542 Update fleetshard to set new fetcher thread count
- Closed
- relates to
-
MGDSTRM-8420 determine a better thread num configs in kafka broker
- Closed