The UX mockups for model serving include the ability to select GPUs for the model server. However, this wasn't implemented in phase 1 because OpenVINO did not support GPUs. This is planned to be added to OpenVINO by the end of 2022. This story is to add the UI capabilities to select GPUs per the mockups.
Scope of story:
- test to ensure model serving with OpenVINO supports GPUs
- Add UI to select & use GPUs for the model server per UX mockups.