Uploaded image for project: 'Red Hat Internal Developer Platform'
  1. Red Hat Internal Developer Platform
  2. RHIDP-11452

Alternatives to OpenAI for the Llama Stack Agentic AI Software Template

    • Icon: Story Story
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • None
    • Software Templates
    • None
    • RHDH AI Sprint 3286

      Story

      As a user of the Llama Stack Agentic AI Software Template, I do not want to use OpenAI, so I should have that option of not using it with the Software Template

      Change the run.yaml embedding model from openai model to "ollama/all-minilm:l6-v2" as we already have an openai deployment running

      Background

      OpenAI API Key cost money and many people would not want to use it in the Software Template or the Agentic Sample

      Dependencies and Blockers

      QE impacted work

      Documentation impacted work

      Acceptance Criteria

      • Find alternative to OpenAI in the Agentic AI Sample
      • Make it optional

              gmontero@redhat.com Gabe Montero
              mfaisal2 Maysun Faisal
              RHDH AI
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: