Uploaded image for project: 'Red Hat Developer Hub Bugs'
  1. Red Hat Developer Hub Bugs
  2. RHDHBUGS-2169

LightSpeed needs to allow request timeout when dealing with ollama

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • None
    • Lightspeed
    • None
    • False
    • Hide

      None

      Show
      None
    • False

      Description of problem:

      Sometimes when using Ollama and LS, the request times out, this is because Ollama cannot handle a lot of models and may need a few seconds to generate responses.

      We had this discussion in the thread about adding timeouts to the LS backed to requests to deal with this.

      https://redhat-internal.slack.com/archives/C07N7CR4FFH/p1750765774781439?thread_ts=1750748401.549299&cid=C07N7CR4FFH

      Additional info (Such as Logs, Screenshots, etc):

              Unassigned Unassigned
              mfaisal2 Maysun Faisal
              RHDHPAI - DevAI
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: