Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-4564

vllm 0.10.1.1: add non-accelerator packages to the builder

XMLWordPrintable

    • Icon: Epic Epic
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • Development Platform
    • None
    • vllm 0.10.1.1: add non-accelerator packages to the builder
    • False
    • Hide

      None

      Show
      None
    • False
    • In Progress
    • AIPCC-4419 - vLLM v0.10.1.1 on CPU wheels tracker
    • AIPCC-4419vLLM v0.10.1.1 on CPU wheels tracker
    • 0% To Do, 0% In Progress, 100% Done

      Here are the non accelerator packages that we need to add to support vllm 0.10.1:

      • openai-harmony (add the package and ensure that the version >= 0.0.3)
      • openai (ensure that the version is >= 1.99.1)
      • transformers (ensure that the version is >= 4.55.0)
      • setproctitle (add the package)

       

       

              rh-ee-rdevasth Rohan Devasthale
              emacchi@redhat.com Emilien Macchi
              Antonio's Team
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: