Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-4086

Update support to vLLM 0.8.z to pull in LoRA fix

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False

      LoRA layer revealed an issue in training in the Triton kernels. We need to pull up vLLM again and it will be either v0.8.4.1 or v0.8.5.0.

              rh-ee-jgroenen Joseph Groenenboom
              rh-ee-jgroenen Joseph Groenenboom
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: