Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-4054

ilab's default granite paths don't exist/need updating for Granite 3.1 v2 in RHEL AI 1.5 on Intel

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • rhelai-1.5
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Critical
    • Approved

      To Reproduce Steps to reproduce the behavior:

      Deploy RHEL AI 1.5 on an Intel Gaudi 3 machine

      According to https://docs.google.com/document/d/1rk5lgztANsY9SO4xYUwhT0K3Q0OSSHtntk5GBo0Gf4o/edit?tab=t.0#bookmark=id.p22uv82ydgkv , Gaudi 3.1 8B should be used even on Intel, but the default config paths aren't updated.

      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-3.1-8b-lab-v2 --release 1.5
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-3.1-8b-starter-v2 --release 1.5

      ilab model <anything> will fail because granite-7b-redhat-lab and 
      granite-7b-redhat-started do not exist.
      Bug impact

      • Please provide information on the impact of this bug to the end user.

      Known workaround

      • Older models could be downloaded and documented for customers to use. Those may have performance and/or reliability impact compared to "if we used the newer models".

      Additional context

       

              fzatlouk@redhat.com František Zatloukal
              fzatlouk@redhat.com František Zatloukal
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: