• Icon: Initiative Initiative
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • None
    • Accelerator Enablement
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • 50% To Do, 50% In Progress, 0% Done

      Feature title: Build flashinfer v0.4.0

      Feature Overview:
      A new release for flashinfer-ai/flashinfer version v0.4.0 was created.

      https://github.com/flashinfer-ai/flashinfer/compare/v0.4.0rc5...v0.4.0  

      Product(s) associated:

      RHAIIS: yes
      RHEL AI: no
      RHOAI:  yes

      Goals:

      VLLM upstream already uses it:

      https://github.com/vllm-project/vllm/blob/d1ddf340c88110ab9b961d5464ed7599bd4dc9a8/docker/Dockerfile#L374 

      Our goal is to get ahead of what we'll be asked to deliver in RHAIIS 3.2.4 and have a newer version of flashinfer.

      Requirements:

      Python wheels for flashinfer v0.4.0.

      Done - Acceptance Criteria:

      The wheels are installed in the RHAIIS containers. The version of RHAIIS has to be defined. It won't be for RHAIIS 3.2.3 at this point, but probably 3.2.4.

              emacchi@redhat.com Emilien Macchi
              emacchi@redhat.com Emilien Macchi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: