-
Task
-
Resolution: Unresolved
-
Normal
-
None
-
None
-
None
-
Product / Portfolio Work
-
False
-
-
False
-
None
-
Unset
-
None
-
-
Deploy an LLM using VLLM and [LiteMaas|https://github.com/rhpds/lite-maas.]
What we need to verify is how LiteMaas provides the mechanism for managing security, usage, and monitoring models. Also need to verify that LiteMaas fits properly with VLLM.
To perform this spike, it's important to follow a GitOps approach, since ArgoCD will be our deployment platform on the HCMAI cluster.