During load testing of relations-api, increasing the number of connections to the service of 3 pods would not always distribute load. This would almost always leave at least 1 or sometimes 2 pods idle while 1 pod serves all traffic.

This was not seen with the 1 connection from our relations-api service to spicedb, where all 3 spicedb pods would be receiving traffic and handling the load.

• Adding more connections doesn't necessarily load balance much better (one trial had 3 connections still go to the same pod)

Investigate how the spicedb client is handling this, and can we do the same? https://github.com/authzed/consistent 

Possibly open a connection for every request?