Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-3657

RHEL AI 1.4.1 `ilab model download` from HF not working

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False

      To Reproduce Steps to reproduce the behavior:

       

      [cloud-user@ip-172-31-23-148 ~]$ ilab model download --repository neuralmagic/Llama-3.2-1B-FP8 --filename model.safetensors --hf-token <my_token>

      Downloading safetensors model failed with the following Hugging Face Hub error: Fast download using 'hf_transfer' is enabled (HF_HUB_ENABLE_HF_TRANSFER=1) but 'hf_transfer' package is not available in your environment. Try `pip install hf_transfer`. 

       

      Expected behavior

      Download the model  

      Screenshots

      • message above

      Device Info (please complete the following information):

      • Hardware Specs: RHEL AI 1.4.1 instance on AWS
      • OS Version: 1.4.1
      • InstructLab Version: 1.4.1 
      • Provide the output of these two commands:
        • sudo bootc status --format json | jq .status.booted.image.image.image to print the name and tag of the bootc image, should look like registry.stage.redhat.io/rhelai1/bootc-intel-rhel9:1.3-1732894187
        • ilab system info to print detailed information about InstructLab version, OS, and hardware – including GPU / AI accelerator hardware

      Bug impact

      • Please provide information on the impact of this bug to the end user.

      Known workaround

      • Please add any known workarounds.

      Additional context

      • <your text here>

              rhn-support-amaredia Ali Maredia
              wcabanba@redhat.com William Caban
              Jenny Yi
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: