Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-10073

3.3 public index contains outdated vLLM versions

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • rhoai-3.3
    • Development Platform
    • False
    • Hide

      None

      Show
      None
    • False
    • Hide

      2026-Feb-25 green  

      vllm 0.13.0+rhai11 has been pushed to prod.

      Show
      2026-Feb-25 green   vllm 0.13.0+rhai11 has been pushed to prod.
    • AIPCC Accelerators 25, AIPCC Accelerators 26, AIPCC Accelerators 27
    • Proposed

      The RHOAI 3.3 indexes and RHAI 3.3 pipelines are out of sync with RHAIIS 3.3 product pipelines. The pipelines are building an older vLLM midstream release vllm-0.13.0+rhai2 without fixes for bugs like cupy-cuda dependency AIPCC-8724. The ROCm 6.4 variant for RHAIIS even builds an outdated 0.11 version.

      The RHAIIS pipeline project has:

      collections/rhaiis/cpu-ubi9/requirements.txt:vllm[tensorizer]==0.13.0+rhai7
      collections/rhaiis/cuda12.9-ubi9/requirements.txt:vllm[audio,tensorizer,cgraph-cuda12]==0.13.0+rhai7
      collections/rhaiis/cuda13.0-ubi9/requirements.txt:vllm[audio,tensorizer,cgraph-cuda13]==0.13.0+rhai7
      collections/rhaiis/rocm6.4-ubi9/requirements.txt:vllm[audio,tensorizer]==0.13.0+rhai7

      The RHAI pipeline in the 3.3 branch has:

      collections/rhaiis/cpu-ubi9/requirements.txt:vllm[tensorizer]==0.13.0+rhai0
      collections/rhaiis/cuda12.9-ubi9/requirements.txt:vllm[audio,tensorizer]==0.13.0+rhai0
      collections/rhaiis/cuda13.0-ubi9/requirements.txt:vllm[audio,tensorizer]==0.13.0+rhai0
      collections/rhaiis/rocm6.4-ubi9/requirements.txt:vllm[audio,tensorizer]==0.11.2+rhai5

              mcurlej Martin Curlej
              cheimes@redhat.com Christian Heimes
              Pavan Kalyan Reddy Cherupally
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated:
                Resolved: