-
Bug
-
Resolution: Done
-
Critical
-
None
-
rhoai-3.3
-
False
-
-
False
-
-
-
-
AIPCC Accelerators 25, AIPCC Accelerators 26, AIPCC Accelerators 27
-
Proposed
The RHOAI 3.3 indexes and RHAI 3.3 pipelines are out of sync with RHAIIS 3.3 product pipelines. The pipelines are building an older vLLM midstream release vllm-0.13.0+rhai2 without fixes for bugs like cupy-cuda dependency AIPCC-8724. The ROCm 6.4 variant for RHAIIS even builds an outdated 0.11 version.
The RHAIIS pipeline project has:
collections/rhaiis/cpu-ubi9/requirements.txt:vllm[tensorizer]==0.13.0+rhai7 collections/rhaiis/cuda12.9-ubi9/requirements.txt:vllm[audio,tensorizer,cgraph-cuda12]==0.13.0+rhai7 collections/rhaiis/cuda13.0-ubi9/requirements.txt:vllm[audio,tensorizer,cgraph-cuda13]==0.13.0+rhai7 collections/rhaiis/rocm6.4-ubi9/requirements.txt:vllm[audio,tensorizer]==0.13.0+rhai7
The RHAI pipeline in the 3.3 branch has:
collections/rhaiis/cpu-ubi9/requirements.txt:vllm[tensorizer]==0.13.0+rhai0 collections/rhaiis/cuda12.9-ubi9/requirements.txt:vllm[audio,tensorizer]==0.13.0+rhai0 collections/rhaiis/cuda13.0-ubi9/requirements.txt:vllm[audio,tensorizer]==0.13.0+rhai0 collections/rhaiis/rocm6.4-ubi9/requirements.txt:vllm[audio,tensorizer]==0.11.2+rhai5
- causes
-
AIPCC-8724 cuda13.0-ubi9 index for 3.3 has cupy-cuda12x==13.6.0
-
- Closed
-
- mentioned on