-
Bug
-
Resolution: Done
-
Undefined
-
rhelai-1.5
-
False
-
-
False
-
-
The builder config file https://gitlab.com/redhat/rhel-ai/wheels/builder/-/blob/main/overrides/settings/llama_cpp_python.yaml does not pass package global CMAKE_ARGS to CUDA and ROCm variants.
Something like
env:
CMAKE_ARGS: >-
-DLLAMA_NATIVE=off
-DGGML_NATIVE=off
variants:
cuda-ubi9:
env:
CMAKE_ARGS: >-
${CMAKE_ARGS}
-DGGML_CUDA=on
...
should do the trick