Goal:

Validate third-party models in InstructLab flows and Inference flows on vLLM by doing inference performance benchmarking and accuracy evaluations for third-party models to give customers flexibility, confidence and predictability bringing third-party models to Instruct Lab and vLLM within RHEL AI