Story

As a consumer of the Lightspeed Safety Shield (https://github.com/lightspeed-core/lightspeed-providers) I want to be able to use this safety shield with the latest Llama Stack versions. 

Currently this shield is locked to Llama Stack 0.2.22 and cannot be used with our teams Llama Stack image and/or Lightspeed Core.

You will need to:

• Make the changes in https://github.com/lightspeed-core/lightspeed-providers/blob/main/lightspeed_stack_providers/providers/inline/safety/lightspeed_question_validity/safety.py to match whatever changed upstream in Llama Stack
• Update the Llama Stack Dependency to 0.3.x https://github.com/lightspeed-core/lightspeed-providers/blob/main/pyproject.toml#L11-L12

To test:

• Push changes above to a Github Branch and import it into our Llama Stack https://github.com/redhat-ai-dev/llama-stack/blob/main/pyproject.toml#L37
• Build the image and try to start it, start LCS as well and try to run a query that should be filtered out as well as a query that should succeed
• You will have to battle error logs from there on out to resolve and update

NOTICE: I have reached out to Lightspeed Core and there is a small chance Pavel implements changes before us but he said probably not this year (2025).

Background

Dependencies and Blockers

QE impacted work

Documentation impacted work

Acceptance Criteria

upstream documentation updates (design docs, release notes etc)

Technical enablement / Demo