The products and metrics to be filtered are dynamically inspected using the metric "swatch_metrics_ingested_usage_total".

This metric is used when processing the events in the swatch-metrics, only for the events coming from the "prometheus" event source.

Link: https://github.com/RedHatInsights/rhsm-subscriptions/blob/169b8b0d6cd935e0549be40bf37205650a0a70ba/src/main/java/org/candlepin/subscriptions/event/EventController.java#L380

The problem is that:

• Some products like "rhel-for-x86-els-payg-addon" and "rhel-for-x86-els-payg" are coming from "rhelmeter" event source,
• For ansible, the event source is "urn:redhat:source:console:app:aap-controller-billing"

Therefore, since the event source for the above products is not prometheus, we're not counting them with the metric "swatch_metrics_ingested_usage_total".

This is a Critical priority because it falls in the category of monitoring to ensure things aren't going sideways and avoiding escalations.

Done:

• Dashboard needs to show all metered products/metrics.  Developer's choice on HOW to make this happen.  Here's an idea though:

• Count all the events regardless the event source is for "swatch_metrics_ingested_usage_total"
• Use the metric "swatch_billable_usage_total" in the grafana dashboard to resolve the products and metrics instead of "swatch_metrics_ingested_usage_total" because it will fix the issue in production since we already missed these events.