• Icon: Task Task
    • Resolution: Done
    • Icon: Minor Minor
    • None
    • None
    • None
    • HAS Sprint 2268

      Task Description (Required)

       

      _<Task description> _
      Currently when deploying locally to Podman Desktop the generated `user-catalog.json` has recommended models that are already apart of Podman Desktop AI Lab. We are able to add other models to the catalog by adding them to the `models` array within that json file.

      If the user chooses the `Local` deployment option as part of the software template they should be presented with a field where they can enter (for example) a HuggingFace URL to a model they would like to use. This URL would need to be in the proper format for the model server (GGUF for example).

      During the generation the requested model would be added to the catalog so that the application can run using that model instead of an existing one in the AI Lab.

      The AI Lab however does include a long list of models that come preinstalled and it may be the case that there is not many additional models available it doesn't already have.
       

      If this requires Change Management, complete sections below: 

      Change Request 

       

      <Select which item is being changed>

       

      [ ]  Add New Tokens

      [ ]  Rotate Tokens

      [ ]  Remove Tokens

      [ ] Others: (specify)

       

        Environment

      <Select which environment the change is being made on.  If both, open a separate issue so changes are tracked in each environment>

       

      [ ]  Stage OR

      [ ]  Prod

       

        Backout Plan

      <State what steps are needed to roll back in case something goes wrong>

       

        Downtime

      <Is there any downtime for these changes?  If so, for how long>

       

        Risk Level

      <How risky is this change?>

       

        Testing

      <How are changes verified?>

       

        Communication

      <How are service owners or consumers notified of these changes?>

              rh-ee-jdubrick Jordan Dubrick
              rh-ee-jdubrick Jordan Dubrick
              RHIDP - AI
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: