Uploaded image for project: 'Red Hat OpenShift Data Science'
  1. Red Hat OpenShift Data Science
  2. RHODS-8248

Change ModelMesh OVMS adapter to add target_device: NVIDIA into the config JSON when on a GPU node

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Major Major
    • None
    • RHODS_1.26.0_GA
    • Model Serving
    • ML Serving Sprint 1.27

      Due to a conflict in OVMS with CLI options and the config file, we can't pass --target_device=NVIDIA as a CLI option. Instead, we need to modify the adapter to pass this argument in the model config file for each model. This code should be conditional on the pod requesting an Nvidia GPU, and behind a flag that can remove it once the AUTO, HETERO, or MULTI plugins can use the Nvidia plugin.

       

      Acceptance Criteria: ModelMesh OVMS adapter is able to pass target_device: NVIDIA argument to OVMS via the config file only when an Nvidia GPU is requested by the pod

            spryor@redhat.com Sean Pryor
            spryor@redhat.com Sean Pryor
            Luca Giorgi Luca Giorgi
            Lucas Fernandez Aragon
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: