-
Story
-
Resolution: Unresolved
-
Normal
-
None
-
None
-
2
-
False
-
-
False
-
RHOAISTRAT-109 - KServe metrics feature parity with Model Mesh
-
No
-
No
-
-
-
Dashboard - General-5
-
Testable
Currently performance metrics are only supported in the UI for models served by modelmesh, this needs to be extended to support kserve. ModelMesh has a concept of "Server metrics" and "model metrics" (as a modelmesh server can serve multiple models) whereas a kserve model server can only serve one model.
Implement a page for "kserve model metrics" similar to the way "model metrics" are implemented for modelmesh. The page should however, contain more charts for kserve, which are the following:
- HTTP requests per 5 minutes
- Average response time (ms)
- CPU Utilisation %
- Memory Utilisation %
The page should be accessed in a similar way to modelmesh metrics (see attached screenshots of how it's done for modelmesh)
- by turning the text in the "Model name" row of the "Models and model servers" table on the models tab of the Data project page into a link
- similarly on the global model serving page
This ticket is only concerned with the visual elements, the existing chart components can be used and will be extended in a future ticket to work with both kserve and modelmesh.