Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-15812

[agent smith] get GPU instance to allow us to run open source model

XMLWordPrintable

    • Icon: Spike Spike
    • Resolution: Done
    • Icon: Blocker Blocker
    • None
    • None
    • None
    • PIDONE 18.0.8
    • 1
    • Critical

      By experience, to be effective a langchain agent at least need a model with 20b parameter, else its inference are quite horrible and its decision too...

      Running this kind of model require resources, especially GPU, else latency will be the rule of thumbs, and we do not need an assistant which help us 3 days later after we asked him so help.

      We have to determine how to get these resources, and we have to obtain them, else it will break this project.

              hberaud Hervé Beraud
              hberaud Hervé Beraud
              rhos-dfg-pidone
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: