Uploaded image for project: 'Performance and Scale for AI Platforms'
  1. Performance and Scale for AI Platforms
  2. PSAP-1349

Performance Evaluation of NVIDIA NIMs provided models

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • AI/ML
    • PSAP

      User Story:
      As a customer, I would like to understand the relative performance of NVIDIA NIMs models on Red Hat software stack compared to the same models running with other inference runtime. I would also like to understand the performance improvements going into NVIDIA's NIM software stack over a period of time.

      Acceptance criteria:

      • Initial Performance tests results for NVIDIA NIM - readout with a slide deck
      • Subsequently, the same tests automated in PSAP's CPT for AI workloads to reduce the time to get future results

            Unassigned Unassigned
            akamra8979 Ashish Kamra
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: