Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-505

Onboard vllm-hpu-extension

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • AIPCC Sprint 2

      vLLM for Gaudi needs

      vllm-hpu-extension @ git+https://github.com/HabanaAI/vllm-hpu-extension.git@d4b0d38

      https://github.com/HabanaAI/vllm-fork/blob/v0.6.6.post1%2BGaudi-1.20.0/requirements-hpu.txt

      The PyPI package is not up to date. We need to build the package from git and talk to Intel about long-term maintenance.

              spryor@redhat.com Sean Pryor
              cheimes@redhat.com Christian Heimes
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: