Uploaded image for project: 'Red Hat OpenShift AI Engineering'
  1. Red Hat OpenShift AI Engineering
  2. RHOAIENG-6522

Create model metrics kserve page

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • Dashboard
    • Dashboard - General-5
    • Testable

      Currently performance metrics are only supported in the UI for models served by modelmesh, this needs to be extended to support kserve. ModelMesh has a concept of "Server metrics" and "model metrics" (as a modelmesh server can serve multiple models) whereas a kserve model server can only serve one model.

      Implement a page for "kserve model metrics" similar to the way "model metrics" are implemented for modelmesh. The page should however, contain more charts for kserve, which are the following:

      • HTTP requests per 5 minutes
      • Average response time (ms)
      • CPU Utilisation %
      • Memory Utilisation %

      The page should be accessed in a similar way to modelmesh metrics (see attached screenshots of how it's done for modelmesh)

      • by turning the text in the "Model name" row of the "Models and model servers" table on the models tab of the Data project page into a link
      • similarly on the global model serving page

      This ticket is only concerned with the visual elements, the existing chart components can be used and will be extended in a future ticket to work with both kserve and modelmesh.

            jephilli@redhat.com Jeffrey Phillips
            acreasy@redhat.com Alex Creasy
            RHOAI Dashboard
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: