Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-4045

RHAIIS: vllm 0.10.0 TPU only

XMLWordPrintable

    • Icon: Feature Feature
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • None
    • Accelerator Enablement
    • None
    • False
    • True
    • 0% To Do, 0% In Progress, 100% Done
    • Hide

      2/Sept/25 Green 

      DONE for TPU.
      Few issues found ROCm that we need to reverify once fixes are made and then we can close the feature.

      Show
      2/Sept/25 Green  DONE for TPU. Few issues found ROCm that we need to reverify once fixes are made and then we can close the feature.

      Support vllm-0.10.0 for cuda, rocm, and any other variant. Currently 0.10.0 is only supported on Spyre and Google TPU.

              fjansen@redhat.com Frank Jansen
              prarit@redhat.com Prarit Bhargava
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: