Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-8649

Base Images: Update RPMs

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • AIPCC Accelerators 26, AIPCC Accelerators 27

      Adding

      VLLM_SPYRE_USE_CHUNKED_PREFILL=1  

      variables to enable chunked Prefill in vLLM

      This changes are discussed in this thread :

      **Note : https://ibm-research.slack.com/archives/C07QCKFAA9J/p1769617640426279

              rh-ee-nzeak Nick Zeak
              autobot-jira-api pme bot
              Frank's Team
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: