Currently debugging production is very involved, the process is as follows:

• Decide which queries to run
• Create a PR to app-interface with said queries
• Wait for PR to be merged (even though this is self-serviceable it can take between 14 and 40 mins)
• Wait for the Job to be deployed in production and run

This workflow is not conducive to debugging pressing production issues (as we found out). To mitigate against that in the future we want to be able to query our DBs directly via GABI.

The Quay team already does this for the quay.io production DB so hopefully we can add the Clair DBs to that instance to give the quay-oncall team full access to all the production DBs, failing that we will need our own GABI instance.

https://gitlab.cee.redhat.com/service/app-interface/-/blob/master/data/services/gabi/gabi-instances/gabi-quayio.yml