Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-5987

New variants for multiple accelerator versions

    • Icon: Epic Epic
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • Accelerator Enablement
    • None
    • New variants for multiple accelerator versions
    • False
    • Hide

      None

      Show
      None
    • False
    • In Progress
    • AIPCC-5943 Support multiple versions of accelerator toolkits
    • 83% To Do, 17% In Progress, 0% Done

      As we decided in PCC-ADR111, the AIPCC Accelerator team (with support from the Development Platform team when needed) will be responsible for creating new variants that will support multiple versions of our accelerator toolkits.

      We'll have to figure out out the logic in which packages would be needed for each version.

      In the builder, we will name the images with versions, but set the FROMAGER_VARIANT environment variable in the image to not have versions. This allows us to avoid duplicating lots of the same settings values across all of our existing plugins. If, in the future, we do need different settings we will make a new variant at that point. For example, the image will have cuda-12.9-ubi9 but the variable will be cuda-ubi9.

      This work does not impact RHAIIS 3.2.4, but this is to be confirmed with the Product Owners.

      The initial target of this work is to support both CUDA 12.8 and 12.9, where the model-opt image would need to be on 12.9. This is the thread for that discussion.

              emacchi@redhat.com Emilien Macchi
              emacchi@redhat.com Emilien Macchi
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: