Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-1077

Migrate over missing Red Hat AI Models to S3 Bucket

    • Migrate over missing Red Hat AI Models to S3 Bucket
    • False
    • Hide

      None

      Show
      None
    • False

      We need to migrate over a set of models to s3 fom their new Red Hat AI stubs. This set of models are not currently in S3, and they are the ones we still need to move to S3 (for the RHOAI catalog demo):
      Qwen2.5-VL-72B-Instruct-quantized.w8a8
      Pixtral-Large-Instruct-2411-hf-quantized.w8a8
      whisper-large-v2-W4A16-G128
      Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

      We're still waiting on quantized mistral 3.1, but I will follow up w/ the research team and comment on this ticket when we have that added to the HF and need to pull it into S3. 

              lmilbaum Liora Milbaum
              rh-ee-rogreenb Rob Greenberg
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: