-
Bug
-
Resolution: Done
-
Undefined
-
rhelai-1.5
-
False
-
-
False
-
-
The builder config file https://gitlab.com/redhat/rhel-ai/wheels/builder/-/blob/main/overrides/settings/llama_cpp_python.yaml does not pass package global CMAKE_ARGS to CUDA and ROCm variants.
Something like
env: CMAKE_ARGS: >- -DLLAMA_NATIVE=off -DGGML_NATIVE=off variants: cuda-ubi9: env: CMAKE_ARGS: >- ${CMAKE_ARGS} -DGGML_CUDA=on ...
should do the trick