Uploaded image for project: 'RHEL Performance'
  1. RHEL Performance
  2. RHELPERF-104

Investigate CPU-Mode AI Workloads for multi-arch performance testing

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • 13
    • False
    • Hide

      None

      Show
      None
    • False

      Identify an AI Workload suitable for multi-arch CPU-mode testing.

      The first candidate to be pursued, vLLM supports CPU-Mode as documented here

      https://docs.vllm.ai/en/stable/getting_started/installation/cpu.html#set-up-using-docker

      Document investigation findings along with setup procedures and initial test results, if possible.

              jth@redhat.com John Harrigan
              jth@redhat.com John Harrigan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: