Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-2385

`ilab model list` occasionally takes a long time to complete and it appears as stuck - we should improve the user experience.

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Rejected

      ilab, version 0.21.0

       

      Attempted to run `ilab model list` on an AWS instance, while downloading the models from stage

      Started downloading the following models (in background):

      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-8b-lab-v1 --release 1.3 
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/granite-8b-starter-v1 --release 1.3 
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/prometheus-8x7b-v2-0 --release 1.3 
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/mixtral-8x7b-instruct-v0-1 --release 1.3 
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/skills-adapter-v3 --release 1.3
      ilab model download --repository docker://registry.stage.redhat.io/rhelai1/knowledge-adapter-v3 --release 1.3 

       

       

      In the interim, wanted to check which modules were downloaded, so executed `ilab model list`

      As you can see below - it took more than a minute for the command to complete:

      time ilab model list                                                                                                                                           
      +------------------------------+---------------------+---------+                                                                                                                              
      | Model Name                   | Last Modified       | Size    |
      +------------------------------+---------------------+---------+                                                                                                                              
      | models/granite-8b-lab-v1     | 2024-11-25 16:12:39 | 15.2 GB |
      | models/granite-8b-starter-v1 | 2024-11-25 16:13:50 | 15.2 GB |                          
      +------------------------------+---------------------+---------+
                                                                           
      real    1m18.514s                                                    
      user    0m9.335s                                                                                                                                                                              
      sys     0m49.258s    

      We should improve the user experience or have the command to complete sooner.

              fdupont@redhat.com Fabien Dupont
              achuzhoy@redhat.com Alexander Chuzhoy
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated: