Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-3473

Triton is not included as torch dependency

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • AIPCC Accelerators 12, AIPCC Accelerators 13, AIPCC Accelerators 14

      torch's setup.py gets extra requires from an environment variable: https://github.com/pytorch/pytorch/blob/main/setup.py?plain=1#L1110-L1115
       
      which is set in CI here: https://github.com/pytorch/pytorch/blob/main/.github/workflows/_binary-build-linux.yml?plain=1#L245
       
      which is invoked by this https://github.com/pytorch/pytorch/blob/main/.github/workflows/generated-linux-binary-manywheel-main.yml?plain=1#L138
       
      the script itself concatenates the triton version here: https://github.com/pytorch/pytorch/blob/main/.circleci/scripts/binary_populate_env.sh?plain=1#L89
       
      triton version: https://github.com/pytorch/pytorch/blob/v2.7.0/.ci/docker/triton_version.txt#L1

      What this means is that triton isn't included as a torch dependency unless set explicitly as an env variable:

      Here's a diff between torch==2.7.0's METADATA and the AIPCC version's for RHAIIS 3.1:

      Unable to find source-code formatter for language: diff. Available languages are: actionscript, ada, applescript, bash, c, c#, c++, cpp, css, erlang, go, groovy, haskell, html, java, javascript, js, json, lua, none, nyan, objc, perl, php, python, r, rainbow, ruby, scala, sh, sql, swift, visualbasic, xml, yaml
      *** upstream_torch_2.7.0_wheel_METADATA	2025-07-10 16:26:36.075139283 +0200
      --- cuda-ubi9:3.1-0-1751392193_torch_wheel_METADATA	2025-07-01 19:55:30.000000000 +0200
      ***************
      *** 1,4 ****
      ! Metadata-Version: 2.2
        Name: torch
        Version: 2.7.0
        Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
      --- 1,4 ----
      ! Metadata-Version: 2.4
        Name: torch
        Version: 2.7.0
        Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
      *************** Requires-Dist: sympy>=1.13.3
      *** 37,57 ****
        Requires-Dist: networkx
        Requires-Dist: jinja2
        Requires-Dist: fsspec
      - Requires-Dist: nvidia-cuda-nvrtc-cu12==12.6.77; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cuda-runtime-cu12==12.6.77; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cuda-cupti-cu12==12.6.80; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cudnn-cu12==9.5.1.17; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cublas-cu12==12.6.4.1; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cufft-cu12==11.3.0.4; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-curand-cu12==10.3.7.77; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cusolver-cu12==11.7.1.2; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cusparse-cu12==12.5.4.2; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cusparselt-cu12==0.6.3; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-nccl-cu12==2.26.2; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-nvtx-cu12==12.6.77; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-nvjitlink-cu12==12.6.85; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: nvidia-cufile-cu12==1.11.1.6; platform_system == "Linux" and platform_machine == "x86_64"
      - Requires-Dist: triton==3.3.0; platform_system == "Linux" and platform_machine == "x86_64"
        Provides-Extra: optree
        Requires-Dist: optree>=0.13.0; extra == "optree"
        Provides-Extra: opt-einsum
      --- 37,42 ----
      *************** Dynamic: download-url
      *** 65,70 ****
      --- 50,56 ----
        Dynamic: home-page
        Dynamic: keywords
        Dynamic: license
      + Dynamic: license-file
        Dynamic: provides-extra
        Dynamic: requires-dist
        Dynamic: requires-python
      

       

              prarit@redhat.com Prarit Bhargava
              rh-ee-tmuttaki Tahmid Muttaki
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: