Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-1379

Update ROCm vLLM support to 0.8.z

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • Development Platform
    • None
    • AIPCC Application Platform 5

      LoRA layer revealed an issue in training in the Triton kernels. We need to pull up vLLM again and it will be either v0.8.4.1 or v0.8.5.0.

              rh-ee-jgroenen Joseph Groenenboom
              rh-ee-jgroenen Joseph Groenenboom
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: