Uploaded image for project: 'Performance and Scale for AI Platforms'
  1. Performance and Scale for AI Platforms
  2. PSAP-1349

Performance Evaluation of NVIDIA NIMs provided models

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • AI/ML

      User Story:
      As a customer, I would like to understand the relative performance of NVIDIA NIMs models on Red Hat software stack compared to the same models running with other inference runtime. I would also like to understand the performance improvements going into NVIDIA's NIM software stack over a period of time.

      Acceptance criteria:

      • Initial Performance tests results for NVIDIA NIM - readout with a slide deck
      • Subsequently, the same tests automated in PSAP's CPT for AI workloads to reduce the time to get future results

              Unassigned Unassigned
              akamra8979 Ashish Kamra
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: