Story

As a user of Llama Stack, I want my image to have a 0.3.x version of Llama Stack to consume the latest Lightspeed Core changes.

Our current Llama Stack image is on 0.2.x https://github.com/redhat-ai-dev/llama-stack/tree/main, we will need to bump the dependencies and update the run.yaml to 0.3.x standards.

Action Items:

• Update Llama Stack dependencies to 0.3.x https://github.com/redhat-ai-dev/llama-stack/blob/main/pyproject.toml
• Update run.yaml https://github.com/redhat-ai-dev/llama-stack/blob/main/run.yaml
• Update to 0.3.x compatible RAG image: https://github.com/redhat-ai-dev/llama-stack/blob/main/Makefile#L16
• Ensure README is updated (pay careful attention to image tags, compatibility, etc) https://github.com/redhat-ai-dev/llama-stack/blob/main/README.md

Changes I have made so far can be found in https://github.com/redhat-ai-dev/llama-stack/tree/dev-0.3.x 

NOTICE: The Llama Stack repository will auto build latest tagged images on PR merges to main for arm64 and amd64 architectures.

Background

Dependencies and Blockers

QE impacted work

Documentation impacted work

Acceptance Criteria

upstream documentation updates (design docs, release notes etc)

Technical enablement / Demo