Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-4903

Upstream vllm TPU requires nixl which should be optional

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • Accelerator Enablement
    • None
    • AIPCC Accelerators 18

      Full context: https://redhat-internal.slack.com/archives/C079FE5H94J/p1756832299007289

      https://github.com/vllm-project/vllm/blob/v0.10.1.1/requirements/tpu.txt#L13

      it requires nixl on TPU but it should stay optional. For now we'll patch the vllm package plugin but hopefully this can be fixed upstream.

              Unassigned Unassigned
              emacchi@redhat.com Emilien Macchi
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated: