Task

As an engineer working on RHDH, I want to update the AI models and model support images (model service, vllm container) being consumed by AI Software Templates so that I can ensure security patches and improvements to the models are available in the next release.

Background

As part of our ongoing support obligations to AI Software Templates, we are required to perform maintenance tasks every release cycle of RHDH to ensure the security exceptions are being met, new improvements of dependencies are being brought in, new RHDH releases have compatibility, and new release cuts of the templates are being regularly made.

Updating the model related images being consumed by the AI Software Templates supports this goal.

Dependencies and Blockers

QE impacted work
Documentation impacted work 

Acceptance Criteria

Update audio-to-text model and model support images

• Model image: quay.io/redhat-ai-dev/whisper-small

Update chatbot model and model support images

• Model image: quay.io/redhat-ai-dev/granite-3.1-8b-instruct-gguf

Update codegen model and model support images

• Model image: quay.io/redhat-ai-dev/mistral-7b-instruct-v0.2

Update model-server (no application) model and model support images

• Model image: quay.io/redhat-ai-dev/granite-3.1-8b-instruct-gguf

Update object-detection model and model support images

• Model image: quay.io/redhat-ai-dev/detr-resnet-101

Update rag model and model support images

• Model image: quay.io/redhat-ai-dev/granite-3.1-8b-instruct-gguf