Story

Engineering has figured out that running Pipelines Controller HA with statefulset in K8s provides better lease and bucket distribution. In this story, we try to evaluate the impact of using default HA setup vs statefulset HA setup.

Statefulset change is planned for release as part of 1.17 release.

Approach

1. As the changes are under development, add support to install nightly builds of pipelines into performance benchmark.
2. Run the math scenario against default and statefulset setups.
3. Collect relevant metrics to measure bucket/lease distribution (Check if there is any existing metric)