Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-4034

ilab's default granite paths don't exist/need updating for v2 in RHEL AI 1.5

XMLWordPrintable

    • Critical
    • Approved

      To Reproduce Steps to reproduce the behavior:

       

      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/skills-adapter-v3 --release 1.5
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/knowledge-adapter-v3 --release 1.5
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-3-1-8b-lab-v2 --release 1.5
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-3-1-8b-starter-v2 --release 1.5
      ilab config init
      ilab model serve
      

       

      Expected behavior

      • model being served

      Bug impact

      • Please provide information on the impact of this bug to the end user.

      Known workaround

      Change the following in .config/instructlab/config.yaml:

      .cache/instructlab/models/granite-3.1-8b-lab-v1 to .cache/instructlab/models/granite-3-1-8b-lab-v2

      .cache/instructlab/models/granite-3.1-8b-starter-v1 to .cache/instructlab/models/granite-3-1-8b-starter-v2

      (notice also - instead of a dot in the version, apart from v1>v2!)

      Additional context

      • ilab, version 0.26.0a1

              jrusz Jakub Rusz
              fzatlouk@redhat.com František Zatloukal
              Jaideep Rao
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated:
                Resolved: