Uploaded image for project: 'Performance and Scale for AI Platforms'
  1. Performance and Scale for AI Platforms
  2. PSAP-1585

Single Node - Multi GPU setup

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Duplicate
    • Icon: Major Major
    • Feb 11
    • None
    • None
    • None
    • RHOAI, Training
    • False
    • False
    • None
    • 8
    • PSAP - General-12, PSAP - General-13, PSAP - General-14

      1. Add single host on IBM cloud.
      2. install openshift with https://github.com/redhat-performance/jetlag
      3. Install instructlab - https://github.com/instructlab/instructlab/blob/main/README.md#-installing-ilab
      4. Set the environment, including SDG, model, taxonomy - https://docs.google.com/document/d/15WdoJb9MYcljn5osojjw0NimHxzbuEvQhmTIBIJohko/edit?tab=t.0
      5. Create judge model server
      6. Create NFS server
      7. Execute standalone.py script

              rh-ee-tosokin Tanya Osokin
              rh-ee-tosokin Tanya Osokin
              Kevin Pouget
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: