Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-2688

Pick vLLM source (vllm or vllm-fork)

XMLWordPrintable

    • Icon: Spike Spike
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • InstructLab - Training
    • None
    • False
    • Hide

      None

      Show
      None
    • False

      Upstream vLLM now supports training on Gaudi cards. However, development is continuing on Intel's vllm-fork. Identify which upstream we're expecting to use for 1.4

              rhn-support-jkunstle James Kunstle
              rhn-support-jkunstle James Kunstle
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: