Feature Overview (Goal Summary)

OLS supports Azure AI as a Large Language Model (LLM) provider. This allows customers to use their own Azure AI API key by integrating it into the OLS secret file.

However, Azure does not offer multiple API keys for each organization or user within a company to access its LLM. This can be challenging for large organizations that need to share the same API key across the entire organization. To address this, customers can use service principal authentication, as detailed in Microsoft's documentation.

Goals (Expected User Outcomes)

The goal of this feature is to enable users to utilize "service principal authentication" for Azure AI in OLS.