INFO 12-09 09:53:08 [__init__.py:36] Available plugins for group vllm.platform_plugins:
INFO 12-09 09:53:08 [__init__.py:38] - spyre -> vllm_spyre:register
INFO 12-09 09:53:08 [__init__.py:48] Loading plugin spyre
INFO 12-09 09:53:08 [__init__.py:207] Platform plugin spyre is activated
WARNING:torchao.kernel.intmm:Warning: Detected no triton, on systems without Triton certain kernels will not work
WARNING 12-09 09:53:12 [_custom_ops.py:20] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm._C'")
[1;36m(APIServer pid=1)[0;0m INFO 12-09 09:53:12 [api_server.py:1839] vLLM API server version 0.11.0
[1;36m(APIServer pid=1)[0;0m INFO 12-09 09:53:12 [utils.py:233] non-default args: {'model': '/mnt/models', 'max_model_len': 32768, 'served_model_name': ['granite-8b'], 'tensor_parallel_size': 4, 'max_num_seqs': 32}
[1;36m(APIServer pid=1)[0;0m INFO 12-09 09:53:12 [arg_utils.py:504] HF_HUB_OFFLINE is True, replace model_id [/mnt/models] to model_path [/mnt/models]
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548] Error in inspecting model architecture 'GraniteForCausalLM'
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548] Traceback (most recent call last):
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]   File "/opt/app-root/lib64/python3.12/site-packages/vllm/model_executor/models/registry.py", line 546, in _try_inspect_model_cls
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]     return model.inspect_model_cls()
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]            ^^^^^^^^^^^^^^^^^^^^^^^^^
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]   File "/opt/app-root/lib64/python3.12/site-packages/vllm/logging_utils/log_time.py", line 22, in _wrapper
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]     result = func(*args, **kwargs)
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]              ^^^^^^^^^^^^^^^^^^^^^
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]   File "/opt/app-root/lib64/python3.12/site-packages/vllm/model_executor/models/registry.py", line 494, in inspect_model_cls
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]     module_hash = hashlib.md5(f.read()).hexdigest()
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548]                   ^^^^^^^^^^^^^^^^^^^^^
[1;36m(APIServer pid=1)[0;0m ERROR 12-09 09:53:12 [registry.py:548] _hashlib.UnsupportedDigestmodError: [digital envelope routines] unsupported