Feature Overview (aka. Goal Summary)

Extend Scorecard threshold configuration to support custom severity keys (beyond 'success', 'warning', 'error') with user-defined colors and categories, enabling more granular metric evaluation and visualization tailored to customer's needs and usage.

Platform engineers and developers can define custom severity levels (e.g., 'critical', 'info') with appropriate visual indicators and names, providing support for more nuanced metrics.

Goals (aka. Expected User Outcomes)

Custom severity levels allowing users freedom to specify additional key names and associated color

Requirements (aka. Acceptance Criteria)

• Allow custom severity keys beyond 'success', 'warning', 'error' (e.g., 'critical', 'info', 'notice')
  Support user-defined color mapping for each custom key
  Maintain backward compatibility with existing default keys
• Display custom severity levels with their specified colors 
• Handle invalid color values gracefully

Out of Scope

• Admin Scorecard UI is out of scope for now. This feature is via yaml config only.

Customer Considerations

Documentation Considerations

• Scorecard Configuration Guide: How to define custom severity keys, colors
• Release Notes: Highlight new customization capabilities