Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-3828

Torch downstream build does not depend on Triton

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Major Major
    • None
    • None
    • PyTorch
    • None

      The Torch upstream packages on PyPI and PyTorch's custom index have a dependency on a pinned Triton version. "pip install torch==2.7.1" installs "triton==3.3.1".

      $ grep triton lib64/python3.12/site-packages/torch-2.7.1+cu128.dist-info/METADATA  
      Requires-Dist: triton==3.3.1; platform_system == "Linux"

      Our downstream builds lack this dependency. It took me a bit to figure out why we are lacking the dependency on Triton. The dependency is injected at build time through the magic env var "PYTORCH_EXTRA_INSTALL_REQUIREMENTS".

      We should implement the same logic in our build plugin for Torch, then remove the vLLM Triton patch and Triton version constraints.

              Unassigned Unassigned
              cheimes@redhat.com Christian Heimes
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: