-
Bug
-
Resolution: Done
-
Critical
-
None
-
None
-
False
-
-
False
-
Impediment
-
-
-
Approved
Goal:
Build Gradlib with packages from ROCm.
Acceptance Criteria:
- Gradlib builds
Background:
Gradlib is a ROCm only dependency in the AMD fork for vLLM. It has no entry in the pyproject.toml file and no requirements or version tracking. AMD copy-pasted the code whole into the project as a way to improve gradient calculation performance with optimizations for hipblas and rocblas GEMMs. This was found very late in the cycle and was only delivered to the Builder team a week before the freeze date.
We must add it or we will get runtime failures for the ROCm fork of vLLM.
In the future we may take a different integration approach but for the urgency faced in RHEL AI 1.3, we will take the early work for this feature and integrate a simple port of the build from AMD and deliver this as a wheel, allowing the Python interfaces to be called at runtime.
- clones
-
RHELAI-2239 Add GradLib Support to ROCm Build
-
- Closed
-
- is blocked by
-
RHELAI-2368 rpdTracerControl missing from instructlab-amd-rhel9:1.3-1732115458
-
- Closed
-
- relates to
-
RHELAI-2368 rpdTracerControl missing from instructlab-amd-rhel9:1.3-1732115458
-
- Closed
-
- mentioned on