WHAT

For consumption based pricing, the billing unit hours metric needs to be scaled depending on the size of the instance (x1 vs. x2).  We need to expose the size of an instance (quota consumed) as a metric on the data plane. A label is not sufficient because in Prometheus metrics can only be multiplied with other metrics, not label values.

More details in the ADR: https://github.com/bf2fc6cc711aee1a0c2a/architecture/pull/51

WHY

To support consumption based pricing for larger Kafka instances.

HOW

1. Identify a component that can expose this metric (Canary, FSO?)
2. Expose a new metrics (e.g. billed_streaming_unit_hours) from the data plane. The value is available as an annotation on the ManagedKafka CR (bf2.org/kafkaInstanceProfileQuotaConsumed).

DONE

Include the following where applicable:

• Metric added and scraped by on-cluster Prometheus (data plane)
• The metric does not need to be sent to Observatorium

Guidelines

The following steps should be adhered to:

• Required tests should be put in place - unit, integration, manual test cases (if necessary)
• CI and all relevant tests passing
• Changes have been verified by one additional reviewer against:
• each required environment
• each supported upgrade path
• If the changes could have an impact on the clients (either UI or CLI), a JIRA should be created for making the required changes on the client side and acknowledged by one of the client side team members. PR has been merged