-
Epic
-
Resolution: Unresolved
-
Normal
-
None
-
None
-
None
-
New variants for multiple accelerator versions
-
False
-
-
False
-
In Progress
-
-
83% To Do, 17% In Progress, 0% Done
As we decided in PCC-ADR111, the AIPCC Accelerator team (with support from the Development Platform team when needed) will be responsible for creating new variants that will support multiple versions of our accelerator toolkits.
We'll have to figure out out the logic in which packages would be needed for each version.
In the builder, we will name the images with versions, but set the FROMAGER_VARIANT environment variable in the image to not have versions. This allows us to avoid duplicating lots of the same settings values across all of our existing plugins. If, in the future, we do need different settings we will make a new variant at that point. For example, the image will have cuda-12.9-ubi9 but the variable will be cuda-ubi9.
This work does not impact RHAIIS 3.2.4, but this is to be confirmed with the Product Owners.
The initial target of this work is to support both CUDA 12.8 and 12.9, where the model-opt image would need to be on 12.9. This is the thread for that discussion.