-
Story
-
Resolution: Obsolete
-
Normal
-
None
-
None
-
False
-
-
False
-
-
Story (Required)
As a user of the 'bac' CLI for importing new AI Models, I want the AI Models hosted in Ollama to be translated into Catalog content.
Background (Required)
Ollama has a REST API defined at https://github.com/ollama/ollama/blob/main/docs/api.md and from there you can list running models (and their access URLs) as well as model information that can fill in descriptions and tags.
To be clear is Ollama running in openshift, in a server side fashion. Not running on someone's laptop or desktop down the hall.
Out of scope
<Defines what is not included in this story>
Approach (Required)
Using our ollama instance on the dev cluster, or standing it up locally on a laptop, connect to the environment and via REST API see if metadata, most notably inference endpoints, for any models hosted there can be pulled and provide sufficient model catalog representations.
Dependencies
Acceptance Criteria (Mandatory)
merged PR to our CLI repo that includes unit tests
INVEST Checklist
Dependencies identified
Blockers noted and expected delivery timelines set
Design is implementable
Acceptance criteria agreed upon
Story estimated
Legend
Unknown
Verified
Unsatisfied
Done Checklist
- Code is completed, reviewed, documented and checked in
- Unit and integration test automation have been delivered and running cleanly in continuous integration/staging/canary environment
- Continuous Delivery pipeline(s) is able to proceed with new code included
- Customer facing documentation, API docs etc. are produced/updated, reviewed and published
- Acceptance criteria are met
- clones
-
RHIDP-10432 Models hosted in 3Scale
-
- Closed
-
- depends on
-
RHIDP-10313 Map Ollama-in-openshift REST API to our Backstage Model Catalog API
-
- Closed
-
- is cloned by
-
RHIDP-10299 Models from HuggingFace
-
- Closed
-