-
Story
-
Resolution: Unresolved
-
Normal
-
None
-
None
-
AIPCC Accelerators 14, AIPCC Accelerators 15, AIPCC Accelerators 16, AIPCC Accelerators 17, AIPCC Accelerators 18, AIPCC Accelerators 19
Currently our spyre builds use the upstream version of vllm. After discussions with IBM today it looks like we can use the midstream/NM vllm fork. Some additional work is required here to make sure tags are setup correctly in the midstream/NM vllm fork.