Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-4523

ilab model chat fails with UnboundLocalError on model mismatch

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Do
    • Icon: Undefined Undefined
    • None
    • rhelai-1.5
    • InstructLab - Core
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Low

      A glitch occurs when running ilab model chat against prometheus-8x7b-v2-0:

      $ ilab model chat
      INFO 2025-06-20 16:13:15,662 instructlab.model.chat:816: Requested model /var/home/cloud-user/.cache/instructlab/models/granite-3.1-8b-lab-v2 is not served by the server. Proceeding to chat with served model: /var/home/cloud-user/.cache/instructlab/models/prometheus-8x7b-v2-0
      ╭─────────────────────────────────── system ───────────────────────────────────╮
      │ Welcome to InstructLab Chat w/ PROMETHEUS-8X7B-V2-0 (type /h for help)       │
      ╰──────────────────────────────────────────────────────────────────────────────╯
      >>> Please reformat the following code to GNU style: printf("cos=%f\n", cos(x));Unknown error
      Executing chat failed with: API issue found while executing chat: Unknown error: <class 'UnboundLocalError'> 

      The actual cause is only available on the server side: Conversation roles must alternate user/assistant/user/assistant/...

              Unassigned Unassigned
              fweimer@redhat.com Florian Weimer
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: