Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-4819

triton - failed to import on ROCm

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Critical Critical
    • None
    • None
    • Accelerator Enablement
    • None
    • AIPCC Accelerators 14

      Importing triton package failed on ROCm with the following error.

      (.venv) (app-root) /opt/app-root$ python
        Python 3.12.9 (main, Jun 20 2025, 00:00:00) [GCC 11.5.0 20240719 (Red Hat 11.5.0-5)] on linux
        Type "help", "copyright", "credits" or "license" for more information.
        >>> import triton
        Traceback (most recent call last):
        File "<stdin>", line 1, in <module>
        ModuleNotFoundError: No module named 'triton' 

       This issue was noticed as part of testing vllm-0.10.0 on ROCm.

      The latest base image from quay (quay.io/aipcc/base-images/rocm) was used for testing and wheels were installed from the builder cache https://gitlab.com/api/v4/projects/72176068/packages/pypi/simple/

      Also, tried installing triton separately from the builder cache for ROCm. There wasn't any error message during the installation. But there was no 'triton' folder seen under .venv/lib64/python3.12/site-packages/ and only triton-3.4.0.dist-info folder was created. Attaching the output of pip install command.

       

              emacchi@redhat.com Emilien Macchi
              rh-ee-aayikkar Aparna Ayikkara
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: