Uploaded image for project: 'OpenShift Container Platform (OCP) Strategy'
  1. OpenShift Container Platform (OCP) Strategy
  2. OCPSTRAT-1887

Tech Preview: Dynamic Accelerator slicer Operator (fka: InstaSlice)

XMLWordPrintable

    • Product / Portfolio Work
    • OCPSTRAT-1692AI Workloads for OpenShift
    • 0% To Do, 0% In Progress, 100% Done
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • None
    • None
    • None
    • None
    • None

      Feature Overview (aka. Goal Summary)  

      As an OpenShift administrator looking to run AI workloads on the platform, efficient GPU utilization is crucial given the high cost of these resources. While NVIDIA GPUs offer a method to pre-slice the GPU for multiple workloads, this approach can lead to resource wastage if the slicing does not align with the actual workload demands.

      Therefore, I want to dynamically slice the GPU based on the specific requirements of each workload, ensuring optimal utilization and minimizing resource waste.

       

      Goal 

      TP in 4.19

      Acceptance criteria 

      • operator can run on infra/worker node
      • Operator should not modify Machine config
      • is build and tested via Konflux
      •  

       

      GA goal 

      • FIPS complient -> depends on nvidia 
      • should work in disconnected mode
      • can be installed in non *openshift NS

      Non-Goals:

      • Share MIG slices among multiple containers
      • Achieve scheduling latency below 5s (need help from RH team)
      • SNO/MicroShift testing is out of scope 

              gausingh@redhat.com Gaurav Singh
              gausingh@redhat.com Gaurav Singh
              None
              Harshal Patil, Sai Ramesh Vanka
              Mrunal Patel Mrunal Patel
              Harshal Patil Harshal Patil
              Aruna Naik Aruna Naik
              Daniel Macpherson Daniel Macpherson
              Julia Driapachenko Julia Driapachenko
              Votes:
              1 Vote for this issue
              Watchers:
              17 Start watching this issue

                Created:
                Updated:
                Resolved: