Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-3785

build torch-2.8

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • True
    • 20% To Do, 40% In Progress, 40% Done
    • Hide

      8/Oct/25 GREEN

      • CUDA torch 2.8 - Pending arm tests. Tests are finalized on x86
      • ROCm torch 2.8 - All tests completed and have passed. There is a risk as we tested the rc since the non rc version for ROCm is not yet cut upstream or midstream.
      • TPU - Vikash is working on getting the benchmarks to run for tpu. All other tests have ran and passed. We are pending rerunning the test for vllm against the non RC version.

       

      Show
      8/Oct/25 GREEN CUDA torch 2.8 - Pending arm tests. Tests are finalized on x86 ROCm torch 2.8 - All tests completed and have passed. There is a risk as we tested the rc since the non rc version for ROCm is not yet cut upstream or midstream. TPU - Vikash is working on getting the benchmarks to run for tpu. All other tests have ran and passed. We are pending rerunning the test for vllm against the non RC version.  

      Build a new version of torch, torch-2.8 for CUDA, ROCm,
      Gaudi, Spyre, and Google TPU. The CUDA work should begin prior to
      the other architectures. The CUDA work should be staged in a branch in the
      builder repository for ROCm and Gaudi to consume. This way work
      can be done in parallel for all three vendor variants.

      We are initially targeting the versions listed here:

      torch-2.8 [2]
      ROCM_VERSION=6.4.3 [2]
      CUDA_VERSION=12.9 [3]
      NVIDIA_DRIVER_VERSION=575.57.08 [3]
      NVIDIA_REQUIRE_CUDA=cuda==12.9 [3]
      triton-3.4 [4]
      vllm-0.10.2 [5]

      xformers==0.0.31 (for now)

      [1] https://en.wikipedia.org/wiki/CUDA#GPUs_supported
      [2] https://pytorch.org/get-started/locally/
      [3] https://docs.nvidia.com/cuda/archive/12.9.1/cuda-toolkit-release-notes/index.html
      [4] https://pytorch.org/blog/pytorch-2-7/
      [5] https://github.com/vllm-project/vllm/blob/main/pyproject.toml

              fjansen@redhat.com Frank Jansen
              prarit@redhat.com Prarit Bhargava
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated: