Description of problem:
There are the following errors visible in syslog/console when starting an installation on an s390x z/VM system with a RoCE card:

...
11:14:40,030 INFO kernel:mlx5_core 0000:00:00.0: enabling device (0000 -> 0002)
11:14:40,030 INFO kernel:mlx5_core 0000:00:00.0: firmware version: 14.25.1020
11:14:43,050 INFO kernel:mlx5_core 0000:00:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(0)
11:14:43,260 INFO kernel:mlx5_core 0000:00:00.0: Supported tc offload range - chains: 1, prios: 1
11:14:43,323 INFO systemd-udevd:link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
11:14:43,330 INFO kernel:mlx5_core 0000:00:00.0 ens993: renamed from eth0
11:14:43,336 INFO systemd:Created slice system-rdma\x2dload\x2dmodules.slice.
11:14:43,336 INFO systemd:Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf...
11:14:43,337 INFO systemd:Starting Load RDMA modules from /etc/rdma/modules/roce.conf...
11:14:43,337 INFO systemd:Starting Load RDMA modules from /etc/rdma/modules/rdma.conf...
11:14:43,341 ERR systemd-modules-load:Failed to find module 'ib_ipoib'
11:14:43,341 ERR systemd-modules-load:Failed to find module 'ib_umad'
11:14:43,341 NOTICE systemd:rdma-load-modules@infiniband.service: Main process exited, code=exited, status=1/FAILURE
11:14:43,342 WARNING systemd:rdma-load-modules@infiniband.service: Failed with result 'exit-code'.
11:14:43,342 ERR systemd:Failed to start Load RDMA modules from /etc/rdma/modules/infiniband.conf.
11:14:43,353 INFO systemd:Started Load RDMA modules from /etc/rdma/modules/roce.conf.
11:14:43,355 ERR systemd-modules-load:Failed to find module 'ib_iser'
11:14:43,355 ERR systemd-modules-load:Failed to find module 'ib_isert'
11:14:43,355 ERR systemd-modules-load:Failed to find module 'ib_srpt'
11:14:43,377 INFO systemd-udevd:Using default interface naming scheme 'rhel-8.0'.
11:14:43,389 INFO systemd-modules-load:Inserted module 'rdma_ucm'
11:14:43,390 INFO systemd:Started udev Wait for Complete Device Initialization.
11:14:43,391 INFO systemd:Starting Device-Mapper Multipath Device Controller...
11:14:43,405 INFO systemd-modules-load:Inserted module 'rpcrdma'
11:14:43,406 NOTICE systemd:rdma-load-modules@rdma.service: Main process exited, code=exited, status=1/FAILURE
11:14:43,406 WARNING systemd:rdma-load-modules@rdma.service: Failed with result 'exit-code'.
11:14:43,406 ERR systemd:Failed to start Load RDMA modules from /etc/rdma/modules/rdma.conf.
11:14:43,406 INFO systemd:Reached target Network (Pre).
11:14:43,406 INFO systemd:Reached target RDMA Hardware.
...

Version-Release number of selected component (if applicable):
RHEL-8.7 GA, rdma-core-41.0-1.el8, kernel-4.18.0-425.3.1.el8
RHEL-8.8.0-20230220.41, rdma-core-44.0-2.el8.1, kernel-4.18.0-472.el8

How reproducible:
Always

Steps to Reproduce:
1. Start an installation on a system with a RoCE card
2. Check the console output, journalctl in the installation environment or /var/log/anaconda/syslog on the installed system.

Actual results:
Failed to start Load RDMA modules from /etc/rdma/modules/infiniband.conf
Failed to start Load RDMA modules from /etc/rdma/modules/rdma.conf

Expected results:
No errors