Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-7928

builder: torchax tpu package onboard request

XMLWordPrintable

    • Torchax package update
    • False
    • Hide

      None

      Show
      None
    • False
    • In Progress
    • AIPCC-7872 - AIPCC: Enable vLLM TPU Backend Support (tpu-inference – Tech Preview)
    • 40% To Do, 0% In Progress, 60% Done
    • AIPCC Accelerators 21, AIPCC Accelerators 22

      Requested Package Name and Version:

      torchax>=0.07

      Brief Explanation for request

      Torchax is necessary to update vLLM tpu to 0.12.0. This version of vLLM will not be using torch-xla; instead, torchax (and tpu-inference) will be used to support this version of vLLM on tpu.

      QE user acceptance tests

      torchax builds and installs sucessfully on TPU

      Package License

      https://github.com/google/torchax/blob/main/LICENSE 

       

              rh-ee-jelevy Jenna Levy
              rh-ee-jelevy Jenna Levy
              Doug Hellmann
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: