Feature Overview (mandatory - Complete while in New status)

• Validation of inference for existing models supported by Neural Magic vLLM

Scope:

• Models from RHEL AI 1.5
• Granite 3.1 & 3.2 models
• Teacher model
• Student model
• Arctic Embedding (as part of subset selection feature)
• Granite Embedding (as part of the RAG feature)

• InstructLab fine-tuned model
• New models:
• Granite 3.3 language model
• Granite 3.3 vision models
• Granite 3.x audio models
• Granite Embedding (New version)
• (tbd subset) Neural Magic 3rd-party models
•  

Goals (mandatory - Complete while in New status)
Provide high-level goal statement, providing user context and expected user outcome(s) for this Feature

• We should do more with Inference validation since we can inherit existing work done by the Neural Magic team and the vLLM community with 

Requirements (mandatory -_ Complete while in Refinement status):

Done - Acceptance Criteria (mandatory - Complete while in Refinement status):

TBD