Uploaded image for project: 'Red Hat OpenShift Data Science'
  1. Red Hat OpenShift Data Science
  2. RHODS-8248

Change ModelMesh OVMS adapter to add target_device: NVIDIA into the config JSON when on a GPU node

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Major Major
    • None
    • RHODS_1.26.0_GA
    • Model Serving
    • ML Serving Sprint 1.27

      Due to a conflict in OVMS with CLI options and the config file, we can't pass --target_device=NVIDIA as a CLI option. Instead, we need to modify the adapter to pass this argument in the model config file for each model. This code should be conditional on the pod requesting an Nvidia GPU, and behind a flag that can remove it once the AUTO, HETERO, or MULTI plugins can use the Nvidia plugin.

       

      Acceptance Criteria: ModelMesh OVMS adapter is able to pass target_device: NVIDIA argument to OVMS via the config file only when an Nvidia GPU is requested by the pod

              spryor@redhat.com Sean Pryor
              spryor@redhat.com Sean Pryor
              Luca Giorgi Luca Giorgi
              Lucas Fernandez Aragon
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: