-
Bug
-
Resolution: Done
-
Critical
-
None
-
rhelai-1.5
-
None
-
False
-
-
False
-
-
-
Critical
-
Approved
To Reproduce Steps to reproduce the behavior:
Deploy RHEL AI 1.5 on an Intel Gaudi 3 machine
According to https://docs.google.com/document/d/1rk5lgztANsY9SO4xYUwhT0K3Q0OSSHtntk5GBo0Gf4o/edit?tab=t.0#bookmark=id.p22uv82ydgkv , Gaudi 3.1 8B should be used even on Intel, but the default config paths aren't updated.
ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-3.1-8b-lab-v2 --release 1.5
ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-3.1-8b-starter-v2 --release 1.5
ilab model <anything> will fail because granite-7b-redhat-lab and
granite-7b-redhat-started do not exist.
Bug impact
- Please provide information on the impact of this bug to the end user.
Known workaround
- Older models could be downloaded and documented for customers to use. Those may have performance and/or reliability impact compared to "if we used the newer models".
Additional context
- mentioned on
(1 mentioned on)