Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-5023

RHAIIS pipeline fails to build vllm on Spyre

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • Accelerator Enablement
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • AIPCC Accelerators 14

      https://gitlab.com/redhat/rhel-ai/rhaiis/pipeline/-/jobs/11265202636

      It should not install llmcompressor as it'll be separated in RHAIIS from vllm.

      tokenizers version conflict: * transformers==4.56.1 requires tokenizers>=0.22.0,<=0.23.0

      • transformers==4.55.2 and 4.55.4 require tokenizers>=0.21,<0.22
      • No single tokenizers version satisfies both requirements

      compressed-tensors version conflict: * vllm==0.10.1.1 requires exactly compressed-tensors==0.10.2

      • llmcompressor==0.7.1 requires exactly compressed-tensors==0.11.0

      transformers version conflict: * vllm==0.10.1.1 requires transformers>=4.55.0

      • llmcompressor==0.7.1 requires transformers<=4.55.2,>=4.53.0
      • fms-model-optimizer==0.6.0 requires transformers<4.56,>=4.45

              spryor@redhat.com Sean Pryor
              emacchi@redhat.com Emilien Macchi
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: