Task Description (Required)

When using ODH you have to select whether you AI project is single or multi model.

Single model according to the doc is based on KServe inference services; the reconciliation work RHOAI has done for us only deals with inference services.

Multi model is KServe model mesh

Minimally we need to work with RHOAI team to get multi model running, deployed from model registry, assuming that is possible, and then start investigating how we interact with it.

This task is a spike to start the investigation.

TBD if a summit or post summit item.

https://opendatahub.io/docs/serving-models/