Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-2041

llm-d enablement in RHAIIS

XMLWordPrintable

    • Icon: Initiative Initiative
    • Resolution: Duplicate
    • Icon: Undefined Undefined
    • None
    • None
    • Development Platform
    • None
    • False
    • Hide

      None

      Show
      None
    • False

      As part of the initiative around llm-d productization, we need to start working towards building an "llm-d" compatible variant of the RHAIIS product images that include various plugins like the NixlConnector + Cluster scale optimizations like DeepEP and PPLX kernels. This initiative tracks the work to generate this new variant.

              Unassigned Unassigned
              rhn-support-weaton Will Eaton
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: