The OpenShift LLM Instance Gateway Integration feature introduces seamless support for deploying and managing Large Language Model (LLM) instances within OpenShift clusters, leveraging Kubernetes’ LLM Instance Gateway project. This feature empowers teams to create, configure, and scale AI workloads directly within OpenShift, making it easier for organizations to operationalize LLM capabilities in their workflows.

https://github.com/kubernetes-sigs/llm-instance-gateway