-
Bug
-
Resolution: Done
-
Critical
-
rhelai-1.5
-
False
-
-
False
-
-
-
AIPCC Application Platform 5
-
Proposed
vLLM 0.8.4 still does not work. The problem is caused by a combination of upstream packaging bug and the way how we are building in downstream. My upstream issue comment https://github.com/vllm-project/vllm/issues/15812#issuecomment-2829381966 and my upstream PR https://github.com/vllm-project/vllm/pull/17159 have more details.
$ vllm --help
Traceback (most recent call last):
File "/opt/app-root/bin/vllm", line 5, in <module>
from vllm.entrypoints.cli.main import main
File "/opt/app-root/lib64/python3.11/site-packages/vllm/entrypoints/cli/main.py", line 7, in <module>
import vllm.entrypoints.cli.benchmark.main
File "/opt/app-root/lib64/python3.11/site-packages/vllm/entrypoints/cli/benchmark/main.py", line 4, in <module>
import vllm.entrypoints.cli.benchmark.serve
File "/opt/app-root/lib64/python3.11/site-packages/vllm/entrypoints/cli/benchmark/serve.py", line 4, in <module>
from vllm.benchmarks.serve import add_cli_args, main
ModuleNotFoundError: No module named 'vllm.benchmarks'
