Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-4820

vllm 0.10.0 - failed to identify the platform on ROCm

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Normal Normal
    • None
    • None
    • Accelerator Enablement
    • None
    • AIPCC Accelerators 14

      While importing LLM, its showing the message indicating that it couldn't identify the underlying hardware platform on ROCm.

      
(.venv) (app-root) /opt/app-root$ python
 Python 3.12.9 (main, Jun 20 2025, 00:00:00) [GCC 11.5.0 20240719 (Red Hat 11.5.0-5)] on linux
 Type "help", "copyright", "credits" or "license" for more information.
 >>> from vllm import LLM
 INFO 08-28 20:15:33 [__init__.py:239] No platform detected, vLLM is running on UnspecifiedPlatform
 >>> import vllm
 >>> print(vllm.platforms.current_platform)
 <vllm.platforms.interface.UnspecifiedPlatform object at 0x7ed54a14dfa0>

      This issue was noticed while testing vllm-0.10.0 on ROCm. The latest base image from quay (quay.io/aipcc/base-images/rocm) was used for testing and wheels were installed from the builder cache https://gitlab.com/api/v4/projects/72176068/packages/pypi/simple/

              emacchi@redhat.com Emilien Macchi
              rh-ee-aayikkar Aparna Ayikkara
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated:
                Resolved: