Description of problem:

SIGABRT core files were observed during the fabtests on RHEL-8.9.0-20230728.11 compose.

Version-Release number of selected component (if applicable):

Clients: rdma-dev-31
Servers: rdma-dev-30

DISTRO=RHEL-8.9.0-20230728.11

+ [23-07-28 16:14:30] cat /etc/redhat-release
Red Hat Enterprise Linux release 8.9 Beta (Ootpa)

+ [23-07-28 16:14:30] uname -a
Linux rdma-dev-30.rdma.lab.eng.rdu2.redhat.com 4.18.0-505.el8.x86_64 #1 SMP Tue Jul 25 11:48:20 EDT 2023 x86_64 x86_64 x86_64 GNU/Linux

+ [23-07-28 16:14:30] cat /proc/cmdline
BOOT_IMAGE=(hd0,gpt2)/vmlinuz-4.18.0-505.el8.x86_64 root=UUID=0bed7f80-86c2-46ed-a825-fa3b27e8c194 ro crashkernel=auto resume=UUID=3642ab93-41cb-4622-bf66-af00505a317f console=ttyS0,115200n81

+ [23-07-28 16:14:30] rpm -q rdma-core linux-firmware
rdma-core-46.0-1.el8.1.x86_64
linux-firmware-20230711-116.gitd3f66064.el8.noarch

+ [23-07-28 16:14:30] tail /sys/class/infiniband/irdma0/fw_ver /sys/class/infiniband/irdma1/fw_ver
==> /sys/class/infiniband/irdma0/fw_ver <==
1.52

==> /sys/class/infiniband/irdma1/fw_ver <==
1.52
+ [23-07-28 16:14:30] lspci
+ [23-07-28 16:14:30] grep -i -e ethernet -e infiniband -e omni -e ConnectX
04:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
04:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
04:00.2 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
04:00.3 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
44:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)
44:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)

How reproducible:

Steps to Reproduce:
1. 1. run the fatests with the above packages on the above E810 iRDMA IW device

2.
3.

Actual results: the following cores found in RDMA server side

TIME PID UID GID SIG COREFILE EXE
Fri 2023-07-28 20:11:57 EDT 72674 0 0 6 present /usr/bin/fi_av_xfer
Fri 2023-07-28 20:12:05 EDT 72769 0 0 6 present /usr/bin/fi_av_xfer
Fri 2023-07-28 20:12:29 EDT 72872 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 20:12:50 EDT 72969 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 20:13:10 EDT 73065 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 20:13:30 EDT 73162 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 20:13:51 EDT 73262 0 0 6 present /usr/bin/fi_dgram
Fri 2023-07-28 20:14:12 EDT 73357 0 0 6 present /usr/bin/fi_dgram_waitset
Fri 2023-07-28 20:14:37 EDT 73540 0 0 6 present /usr/bin/fi_dgram_pingpong
Fri 2023-07-28 20:14:51 EDT 73643 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 20:15:12 EDT 73739 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 20:15:32 EDT 73836 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 20:15:52 EDT 73933 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 20:16:18 EDT 74031 0 0 6 present /usr/bin/fi_multi_mr
Fri 2023-07-28 20:16:48 EDT 74141 0 0 6 present /usr/bin/fi_multi_recv
Fri 2023-07-28 20:17:10 EDT 74324 0 0 6 present /usr/bin/fi_poll
Fri 2023-07-28 20:17:30 EDT 74420 0 0 6 present /usr/bin/fi_poll
Fri 2023-07-28 20:17:52 EDT 74523 0 0 6 present /usr/bin/fi_rdm
Fri 2023-07-28 20:18:14 EDT 74618 0 0 6 present /usr/bin/fi_bw
Fri 2023-07-28 20:18:34 EDT 74713 0 0 6 present /usr/bin/fi_rdm_atomic
Fri 2023-07-28 20:18:56 EDT 74812 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:19:16 EDT 74907 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:19:37 EDT 75003 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:19:58 EDT 75100 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:20:18 EDT 75198 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:20:40 EDT 75295 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:21:00 EDT 75390 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:21:21 EDT 75487 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:21:41 EDT 75583 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:22:01 EDT 75682 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:22:20 EDT 75778 0 0 6 present /usr/bin/fi_rdm
Fri 2023-07-28 20:22:42 EDT 75876 0 0 6 present /usr/bin/fi_bw
Fri 2023-07-28 20:23:02 EDT 75973 0 0 6 present /usr/bin/fi_rdm_atomic
Fri 2023-07-28 20:23:22 EDT 76068 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:23:42 EDT 76165 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:24:01 EDT 76261 0 0 6 present /usr/bin/fi_rdm_rma_event
Fri 2023-07-28 20:24:22 EDT 76356 0 0 6 present /usr/bin/fi_rdm_rma_trigger
Fri 2023-07-28 20:24:42 EDT 76453 0 0 6 present /usr/bin/fi_rdm_tagged_peek
Fri 2023-07-28 20:25:02 EDT 76549 0 0 6 present /usr/bin/fi_rdm_shared_av
Fri 2023-07-28 20:25:28 EDT 76646 0 0 6 present /usr/bin/fi_recv_cancel
Fri 2023-07-28 20:25:49 EDT 76743 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 20:26:09 EDT 76837 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 20:26:29 EDT 76932 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 20:26:53 EDT 77030 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 20:27:13 EDT 77126 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 20:27:33 EDT 77224 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 20:28:03 EDT 77408 0 0 6 present /usr/bin/fi_unexpected_msg
Fri 2023-07-28 21:05:28 EDT 113236 0 0 6 present /usr/bin/fi_av_xfer
Fri 2023-07-28 21:05:48 EDT 113330 0 0 6 present /usr/bin/fi_av_xfer
Fri 2023-07-28 21:06:13 EDT 113425 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 21:06:33 EDT 113519 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 21:06:53 EDT 113612 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 21:07:13 EDT 113709 0 0 6 present /usr/bin/fi_cq_data
Fri 2023-07-28 21:07:35 EDT 113804 0 0 6 present /usr/bin/fi_dgram
Fri 2023-07-28 21:07:55 EDT 113896 0 0 6 present /usr/bin/fi_dgram_waitset
Fri 2023-07-28 21:08:21 EDT 114073 0 0 6 present /usr/bin/fi_dgram_pingpong
Fri 2023-07-28 21:08:35 EDT 114168 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 21:08:55 EDT 114262 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 21:09:15 EDT 114355 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 21:09:36 EDT 114450 0 0 6 present /usr/bin/fi_inject_test
Fri 2023-07-28 21:10:01 EDT 114543 0 0 6 present /usr/bin/fi_multi_mr
Fri 2023-07-28 21:10:31 EDT 114639 0 0 6 present /usr/bin/fi_multi_recv
Fri 2023-07-28 21:10:54 EDT 114819 0 0 6 present /usr/bin/fi_poll
Fri 2023-07-28 21:11:14 EDT 114912 0 0 6 present /usr/bin/fi_poll
Fri 2023-07-28 21:11:35 EDT 115005 0 0 6 present /usr/bin/fi_rdm
Fri 2023-07-28 21:11:57 EDT 115100 0 0 6 present /usr/bin/fi_bw
Fri 2023-07-28 21:12:18 EDT 115195 0 0 6 present /usr/bin/fi_rdm_atomic
Fri 2023-07-28 21:12:40 EDT 115289 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:13:00 EDT 115381 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:13:20 EDT 115476 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:13:42 EDT 115571 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:14:02 EDT 115665 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:14:36 EDT 115759 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:14:44 EDT 115855 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:15:04 EDT 115948 0 0 6 present /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:15:24 EDT 116042 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:15:45 EDT 116138 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:16:03 EDT 116230 0 0 6 present /usr/bin/fi_rdm
Fri 2023-07-28 21:16:25 EDT 116324 0 0 6 present /usr/bin/fi_bw
Fri 2023-07-28 21:16:46 EDT 116420 0 0 6 present /usr/bin/fi_rdm_atomic
Fri 2023-07-28 21:17:06 EDT 116512 0 0 6 present /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:17:26 EDT 116605 0 0 6 present /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:17:45 EDT 116702 0 0 6 present /usr/bin/fi_rdm_rma_event
Fri 2023-07-28 21:18:06 EDT 116795 0 0 6 present /usr/bin/fi_rdm_rma_trigger
Fri 2023-07-28 21:18:25 EDT 116888 0 0 6 present /usr/bin/fi_rdm_tagged_peek
Fri 2023-07-28 21:18:46 EDT 116983 0 0 6 present /usr/bin/fi_rdm_shared_av
Fri 2023-07-28 21:19:08 EDT 117080 0 0 6 present /usr/bin/fi_recv_cancel
Fri 2023-07-28 21:19:32 EDT 117172 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 21:19:52 EDT 117267 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 21:20:12 EDT 117365 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 21:20:36 EDT 117461 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 21:21:05 EDT 117555 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 21:21:25 EDT 117650 0 0 6 present /usr/bin/fi_rma_bw
Fri 2023-07-28 21:21:47 EDT 117829 0 0 6 present /usr/bin/fi_unexpected_msg
total 328992

Expected results:

Additional info: