Backend components grafana dashboards and prometheus rules design

Define and implementation of

• Grafana dashboards
• Prometheus rules

Datasources:

• backend components exposing metrics. Seems that for now, only backend-worker component exports metrics.
• kube-state-metrics (https://issues.redhat.com/browse/THREESCALE-4679)
• aggregated health endpoints metrics. (https://issues.redhat.com/browse/THREESCALE-4681)

Backend guys have the domain knowledge to define useful dashboards and effective prometheus rules. Ops teams can help you with the syntax.

Setup your development environment with latest monitoring tools enabled: https://docs.google.com/document/d/1ogntOEYyi39E2SPp9DiHl-og4p_Ti3PPiEb4tCkZzv8/edit#