Uploaded image for project: 'Red Hat Internal Developer Platform'
  1. Red Hat Internal Developer Platform
  2. RHIDP-10658

Update Ollama Model Service with new IBM Granite 3 models

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • Test Infrastructure
    • 2
    • False
    • Hide

      None

      Show
      None
    • False

      Task Description (Required)

       

      Slack discussion: https://redhat-internal.slack.com/archives/C07N7CR4FFH/p1729585797505599

      Update the "Ollama Model Service"  on the team ROSA cluster to include the new IBM Granite 3 models that were recently released.

      https://ollama.com/blog/ibm-granite has more information on the models that are now available, but I'm thinking we can add the following:

      • granite3-dense:8b (replaces the granite 20b model we currently have deployed)
      • granite3-moe

       

              Unassigned Unassigned
              johnmcollier John Collier
              RHIDP - AI
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: