Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-2977

Update vLLM to 0.6.6.post1

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False

      For RHEL AI 1.4, we have decided to use vLLM 0.6.4.post1. The upstream instructlab project is updating vLLM to 0.6.6.post1, which is the latest available version. This issue tracks the attempt to build vLLM 0.6.6.post1 downstream, in order to be able to switch to this version in case instructlab has a hard dependency on it.

      This is not an official dependency of RHEL AI 1.4, hence the Fix Version set to RHEL AI Backlog. It will be moved to another epic if it is needed in another version of RHEL AI or closed if not needed at all (newer version picked for next RHEL AI).

              fdupont@redhat.com Fabien Dupont
              fdupont@redhat.com Fabien Dupont
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: