# Confirm driver is not installed on EDPM Hypervisor [cloud-admin@edpm-compute-0 ~]$ nvidia-smi NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running. [zuul@controller-0 ~]$ oc rsh openstackclient sh-5.1$ curl -Ok https://download-01.beak-001.prod.iad2.dc.redhat.com/brewroot/packages/rhel-guest-image/9.4/20250530.1/images/rhel-guest-image-9.4-20250530.1.x86_64.qcow2 sh-5.1$ openstack image create rhel --disk-format qcow2 --container-format bare --file rhel-guest-image-9.4-20250530.1.x86_64.qcow2 +------------------+------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +------------------+------------------------------------------------------------------------------------------------------------------------------------------+ | container_format | bare | | created_at | 2025-07-09T15:52:00Z | | disk_format | qcow2 | | file | /v2/images/cb0aadd4-23cc-4e20-a932-95fd9cdb2593/file | | id | cb0aadd4-23cc-4e20-a932-95fd9cdb2593 | | min_disk | 0 | | min_ram | 0 | | name | rhel | | owner | 8ea3217cfc534dfaaa620a545c25ccee | | properties | os_hidden='False', owner_specified.openstack.md5='', owner_specified.openstack.object='images/rhel', owner_specified.openstack.sha256='' | | protected | False | | schema | /v2/schemas/image | | status | queued | | tags | | | updated_at | 2025-07-09T15:52:00Z | | visibility | shared | +------------------+------------------------------------------------------------------------------------------------------------------------------------------+ sh-5.1$ ssh-keygen Generating public/private rsa key pair. Enter file in which to save the key (/home/cloud-admin/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/cloud-admin/.ssh/id_rsa Your public key has been saved in /home/cloud-admin/.ssh/id_rsa.pub The key fingerprint is: SHA256:+E2gzUEF5l0P1RncdyS0bKTMfyCf5B36724WcPY7U0A cloud-admin@openstackclient The key's randomart image is: +---[RSA 3072]----+ | +o. oo*+=| | + . + *E==| | + . =.B.o| | = o Oo*.| | o S . .O.+| | . o .oo| | . . .+| | ++| | =*| +----[SHA256]-----+ sh-5.1$ openstack keypair create --public-key /home/cloud-admin/.ssh/id_rsa.pub mykey +-------------+-------------------------------------------------+ | Field | Value | +-------------+-------------------------------------------------+ | created_at | None | | fingerprint | 7b:cc:dd:8f:0c:2a:57:03:a1:6c:bc:92:6d:96:d4:00 | | id | mykey | | is_deleted | None | | name | mykey | | type | ssh | | user_id | eee43f1eb6a84aa69d54d944edff8fbd | +-------------+-------------------------------------------------+ sh-5.1$ SECID=$(openstack security group list | grep `openstack project show admin -f value -c id` | head -n 1 | awk '{print $2}') sh-5.1$ openstack security group rule create $SECID --protocol tcp --dst-port 22 --remote-ip 0.0.0.0/0 2>/dev/null || true sh-5.1$ openstack security group rule create $SECID --protocol icmp --dst-port -1 --remote-ip 0.0.0.0/0 2>/dev/null || true sh-5.1$ openstack flavor create --vcpus 4 --ram 2048 --disk 20 m1.vgpu --property "pci_passthrough:alias"="nvidia_gpu:1" +----------------------------+--------------------------------------+ | Field | Value | +----------------------------+--------------------------------------+ | OS-FLV-DISABLED:disabled | False | | OS-FLV-EXT-DATA:ephemeral | 0 | | description | None | | disk | 20 | | id | 42fd74cb-fe16-40ab-91f5-87c0b70d9d38 | | name | m1.vgpu | | os-flavor-access:is_public | True | | properties | pci_passthrough:alias='nvidia_gpu:1' | | ram | 2048 | | rxtx_factor | 1.0 | | swap | | | vcpus | 4 | +----------------------------+--------------------------------------+ sh-5.1$ openstack server create --flavor m1.vgpu --image rhel --key-name mykey gpu_passthrough_guest --wait +-------------------------------------+----------------------------------------------------------+ | Field | Value | +-------------------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | nova | | OS-EXT-SRV-ATTR:host | edpm-compute-0.ctlplane.example.com | | OS-EXT-SRV-ATTR:hypervisor_hostname | edpm-compute-0.ctlplane.example.com | | OS-EXT-SRV-ATTR:instance_name | instance-00000010 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-07-09T20:37:03.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | public=192.168.122.181 | | adminPass | W6MsYtWPL3cT | | config_drive | True | | created | 2025-07-09T20:36:54Z | | flavor | m1.vgpu (42fd74cb-fe16-40ab-91f5-87c0b70d9d38) | | hostId | 7e16c4292e010b4e2628aadc2db437eaa325210e1973578614948c5c | | id | f9e6e64c-b632-4ff2-9780-d13c4cee3cd9 | | image | rhel (cb0aadd4-23cc-4e20-a932-95fd9cdb2593) | | key_name | mykey | | name | gpu_passthrough_guest | | progress | 0 | | project_id | 8ea3217cfc534dfaaa620a545c25ccee | | properties | | | security_groups | name='default' | | status | ACTIVE | | updated | 2025-07-09T20:37:03Z | | user_id | eee43f1eb6a84aa69d54d944edff8fbd | | volumes_attached | | +-------------------------------------+----------------------------------------------------------+ sh-5.1$ ssh -i ~/.ssh/id_rsa cloud-user@192.168.122.181 [cloud-user@gpu-passthrough-guest ~]$ lspci | grep -i nvidia 05:00.0 3D controller: NVIDIA Corporation TU104GL [Tesla T4] (rev a1) [cloud-user@gpu-passthrough-guest ~]$ curl -Ok 10.2.129.226/qa/rhts/lookaside/virt-test/driver-storage/nvidia/grid/latest-GRID-17/host-driver-9.4.rpm % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 95.7M 100 95.7M 0 0 698k 0 0:02:20 0:02:20 --:--:-- 715k [cloud-user@gpu-passthrough-guest ~]$ sudo dnf localinstall -y host-driver-9.4.rpm Dependencies resolved. =================================================================================================================================================================================================================== Package Architecture Version Repository Size =================================================================================================================================================================================================================== Installing: NVIDIA-vGPU-rhel x86_64 1:9.4-550.144.02 @commandline 96 M Transaction Summary =================================================================================================================================================================================================================== Install 1 Package Total size: 96 M Installed size: 170 M Downloading Packages: Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Running scriptlet: NVIDIA-vGPU-rhel-1:9.4-550.144.02.x86_64 1/1 Installing : NVIDIA-vGPU-rhel-1:9.4-550.144.02.x86_64 1/1 Running scriptlet: NVIDIA-vGPU-rhel-1:9.4-550.144.02.x86_64 1/1 Verifying : NVIDIA-vGPU-rhel-1:9.4-550.144.02.x86_64 1/1 Installed: NVIDIA-vGPU-rhel-1:9.4-550.144.02.x86_64 Complete! [cloud-user@gpu-passthrough-guest ~]$ cd /etc/modprobe.d/ [cloud-user@gpu-passthrough-guest modprobe.d]$ sudo vi disable-nouveau.conf [cloud-user@gpu-passthrough-guest ~]$ cat /etc/modprobe.d/disable-nouveau.conf blacklist nouveau options nouveau modeset=0 [cloud-user@gpu-passthrough-guest modprobe.d]$ sudo dracut --force [cloud-user@gpu-passthrough-guest modprobe.d]$ sudo grub2-mkconfig -o /boot/grub2/grub.cfg --update-bls-cmdline Generating grub configuration file ... Adding boot menu entry for UEFI Firmware Settings ... done [cloud-user@gpu-passthrough-guest modprobe.d]$ sudo reboot [cloud-user@gpu-passthrough-guest modprobe.d]$ Connection to 192.168.122.181 closed by remote host. sh-5.1$ ssh -i ~/.ssh/id_rsa cloud-user@192.168.122.181 Register this system with Red Hat Insights: insights-client --register Create an account or view all your systems at https://red.ht/insights-dashboard Last login: Wed Jul 9 16:39:21 2025 from 192.168.122.12 [cloud-user@gpu-passthrough-guest ~]$ nvidia-smi Wed Jul 9 16:45:10 2025 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.144.02 Driver Version: 550.144.02 CUDA Version: N/A | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 Tesla T4 On | 00000000:05:00.0 Off | 0 | | N/A 50C P8 16W / 70W | 93MiB / 15360MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | No running processes found | +-----------------------------------------------------------------------------------------+ [cloud-user@gpu-passthrough-guest ~]$