Uploaded image for project: 'RHEL Testing'
  1. RHEL Testing
  2. RHELTEST-1914

RHEL9[aarch64]/kdump takes the memory consumption by mxl5 netcard into account for kernel-64K

    • +

      Description of problem:
      Kdump tests of below aarch64 baremetal models failed:

      Version-Release number of selected component (if applicable):
      kernel-64k-5.14.0-228.dd64kv4.el9
      (https://brewweb.engineering.redhat.com/brew/taskinfo?taskID=49980272)
      kexec-tools-2.0.25-10.el9
      crash-8.0.2-1.el9
      RHEL-9.2.0-20230110.5

      How reproducible:
      Always

      Steps to Reproduce:
      1. install and active kernel-64k-5.14.0-228.dd64kv4.el9 as the default grub entry

      1. yum install -y kernel-64k-5.14.0-228.dd64kv4.el9; grubby --set-default=/boot/vmlinuz-5.14.0-228.dd64kv4.el9.aarch64+64k
        2. turn off swap device
      2. sed -i '/swap/s/^/#/g' /etc/fstab;
        3. reboot into the 64k kernel and turn on the swap again.
      3. sed -i '/swap/s/#//g' /etc/fstab; swapon -fav; swapoff -av; swapon -av;
      4. getconf PAGESIZE
        4. trigger panic

      Actual results:
      after kernel-64k panic, kdump will running into OOM:
      (https://beaker.engineering.redhat.com/recipes/13219142/logs/console.log)
      .....
      [ 9.820944] swapper/0: page allocation failure: order:8, mode:0xcc0(GFP_KERNEL), nodemask=(null),cpuset=/,mems_allowed=2-3
      [ 9.831994] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.14.0-228.dd64kv4.el9.aarch64+64k #1
      [ 9.840334] Hardware name: WIWYNN Mt.Jade Server System B81.030Z1.0007/Mt.Jade Motherboard, BIOS 2.10.20220810 (SCP: 2.10.20220810) 2022/08/10
      [ 9.853100] Call trace:
      [ 9.855534] dump_backtrace+0xb0/0x120
      [ 9.859286] show_stack+0x1c/0x6c
      [ 9.862590] dump_stack_lvl+0x64/0x7c
      [ 9.866250] dump_stack+0x14/0x2c
      [ 9.869552] warn_alloc+0x114/0x1a0
      [ 9.873036] __alloc_pages_slowpath.constprop.0+0x8ac/0x8d0
      [ 9.878598] __alloc_pages+0x204/0x274
      [ 9.882335] __dma_direct_alloc_pages.constprop.0+0x184/0x1ec
      [ 9.888073] dma_direct_alloc+0x204/0x31c
      [ 9.892071] dma_alloc_attrs+0x80/0xec
      [ 9.895809] dmam_alloc_attrs+0x70/0xc0
      [ 9.899632] arm_smmu_init_one_queue+0x90/0x140
      [ 9.904156] arm_smmu_device_probe+0x264/0x560
      [ 9.908589] platform_probe+0x6c/0xe0
      [ 9.912242] really_probe+0xc4/0x3ec
      [ 9.915805] __driver_probe_device+0x114/0x190
      [ 9.920236] driver_probe_device+0x40/0xf0
      [ 9.924320] __driver_attach+0xac/0x210
      [ 9.928143] bus_for_each_dev+0x74/0xd0
      [ 9.931970] driver_attach+0x28/0x30
      [ 9.935533] bus_add_driver+0x148/0x234
      [ 9.939356] driver_register+0x7c/0x130
      [ 9.943179] __platform_driver_register+0x2c/0x34
      [ 9.947871] arm_smmu_driver_init+0x24/0x2c
      [ 9.952047] do_one_initcall+0x48/0x2c0
      [ 9.955872] do_initcalls+0x100/0x13c
      [ 9.959527] kernel_init_freeable+0x164/0x1ac
      [ 9.963873] kernel_init+0x28/0x140
      [ 9.967352] ret_from_fork+0x10/0x20
      [ 9.970928] Mem-Info:
      [ 9.973194] active_anon:0 inactive_anon:510 isolated_anon:0
      [ 9.973194] active_file:0 inactive_file:0 isolated_file:0
      [ 9.973194] unevictable:0 dirty:0 writeback:0
      [ 9.973194] slab_reclaimable:136 slab_unreclaimable:877
      [ 9.973194] mapped:0 shmem:517 pagetables:3 bounce:0
      [ 9.973194] kernel_misc_reclaimable:0
      [ 9.973194] free:251 free_pcp:26 free_cma:0
      [ 10.006979] Node 2 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:0kB pagetables:0kB all_unreclaimable? no
      [ 10.034071] Node 3 active_anon:0kB inactive_anon:32640kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:33088kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:4416kB pagetables:192kB all_unreclaimable? no
      [ 10.062291] Node 2 DMA free:0kB boost:0kB min:0kB low:0kB high:0kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:130624kB managed:0kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
      [ 10.087301] lowmem_reserve[]: 0 0 0 0 0
      [ 10.091125] Node 3 DMA free:16064kB boost:0kB min:2752kB low:3392kB high:4032kB reserved_highatomic:0KB active_anon:0kB inactive_anon:32640kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:589824kB managed:506240kB mlocked:0kB bounce:0kB free_pcp:1664kB local_pcp:1664kB free_cma:0kB
      [ 10.118563] lowmem_reserve[]: 0 0 0 0 0
      [ 10.122387] Node 2 DMA: 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB 0*8192kB 0*16384kB 0*32768kB 0*65536kB 0*131072kB 0*262144kB 0*524288kB = 0kB
      [ 10.136638] Node 3 DMA: 6*64kB (UM) 3*128kB (M) 3*256kB (M) 3*512kB (UM) 1*1024kB (M) 2*2048kB (M) 2*4096kB (UM) 0*8192kB 0*16384kB 0*32768kB 0*65536kB 0*131072kB 0*262144kB 0*524288kB = 16384kB
      [ 10.153928] Node 2 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=16777216kB
      [ 10.162701] Node 2 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=524288kB
      [ 10.171300] Node 2 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
      [ 10.179724] Node 3 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=16777216kB
      [ 10.188504] Node 3 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=524288kB
      [ 10.197102] Node 3 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
      [ 10.205526] 517 total pagecache pages
      [ 10.209176] 0 pages in swap cache
      [ 10.212478] Swap cache stats: add 0, delete 0, find 0/0
      [ 10.217691] Free swap = 0kB
      [ 10.220560] Total swap = 0kB
      [ 10.223428] 11257 pages RAM
      [ 10.226209] 0 pages HighMem/MovableOnly
      [ 10.230032] 3347 pages reserved
      [ 10.233161] 0 pages cma reserved
      [ 10.236377] 0 pages hwpoisoned
      [ 10.240222] arm-smmu-v3 arm-smmu-v3.11.auto: allocated 131072 entries for evtq
      [ 10.248096] arm-smmu-v3 arm-smmu-v3.11.auto: allocated 262144 entries for priq
      [ 10.256027] arm-smmu-v3 arm-smmu-v3.11.auto: SMMU currently enabled! Resetting...
      [ 10.265395] rdac: device handler registered
      [ 10.269742] hp_sw: device handler registered
      [ 10.274002] emc: device handler registered
      [ 10.278154] alua: device handler registered
      [ 10.283898] libphy: Fixed MDIO Bus: probed
      [ 10.288544] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
      [ 10.295070] ehci-pci: EHCI PCI platform driver
      [ 10.299592] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
      [ 10.305764] ohci-pci: OHCI PCI platform driver
      [ 10.310214] uhci_hcd: USB Universal Host Controller Interface driver
      [ 10.316877] xhci_hcd 0004:03:00.0: Adding to iommu group 0
      [ 10.322787] xhci_hcd 0004:03:00.0: xHCI Host Controller
      [ 10.328125] xhci_hcd 0004:03:00.0: new USB bus registered, assigned bus number 1
      [ 10.335533] xhci_hcd 0004:03:00.0: Zeroing 64bit base registers, expecting fault
      [ 10.380542] xhci_hcd 0004:03:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x0000001100000410
      [ 10.390187] xhci_hcd 0004:03:00.0: xHCI Host Controller
      [ 10.395476] xhci_hcd 0004:03:00.0: new USB bus registered, assigned bus number 2
      [ 10.402872] xhci_hcd 0004:03:00.0: Host supports USB 3.0 SuperSpeed
      [ 10.409232] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14
      [ 10.417487] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
      [ 10.424696] usb usb1: Product: xHCI Host Controller
      [ 10.429562] usb usb1: Manufacturer: Linux 5.14.0-228.dd64kv4.el9.aarch64+64k xhci-hcd
      [ 10.437380] usb usb1: SerialNumber: 0004:03:00.0
      [ 10.442157] hub 1-0:1.0: USB hub found
      [ 10.445907] hub 1-0:1.0: 4 ports detected
      [ 10.450081] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
      [ 10.458182] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14
      [ 10.466438] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
      [ 10.473646] usb usb2: Product: xHCI Host Controller
      [ 10.478513] usb usb2: Manufacturer: Linux 5.14.0-228.dd64kv4.el9.aarch64+64k xhci-hcd
      [ 10.486329] usb usb2: SerialNumber: 0004:03:00.0
      [ 10.491129] hub 2-0:1.0: USB hub found
      [ 10.494876] hub 2-0:1.0: 4 ports detected
      [ 10.499923] usbcore: registered new interface driver usbserial_generic
      [ 10.506554] usbserial: USB Serial support registered for generic
      [ 10.512991] mousedev: PS/2 mouse device common for all mice
      [ 10.519945] rtc-efi rtc-efi.0: registered as rtc0
      [ 10.525081] rtc-efi rtc-efi.0: setting system clock to 2023-01-12T21:44:02 UTC (1673559842)
      [ 10.537136] SMCCC: SOC_ID: ID = jep106:0a16:0001 Revision = 0x000000a1
      [ 10.544040] hid: raw HID events driver (C) Jiri Kosina
      [ 10.549300] usbcore: registered new interface driver usbhid
      [ 10.554862] usbhid: USB HID core driver
      [ 10.560842] drop_monitor: Initializing network drop monitor service
      [ 10.570667] swapper/0 invoked oom-killer: gfp_mask=0x2dc2(GFP_KERNEL|_GFP_HIGHMEM|GFP_NOWARN|_GFP_ZERO), order=0, oom_score_adj=0 ==========================> OOM
      [ 10.582708] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.14.0-228.dd64kv4.el9.aarch64+64k #1
      [ 10.591049] Hardware name: WIWYNN Mt.Jade Server System B81.030Z1.0007/Mt.Jade Motherboard, BIOS 2.10.20220810 (SCP: 2.10.20220810) 2022/08/10
      [ 10.603815] Call trace:
      [ 10.606250] dump_backtrace+0xb0/0x120
      [ 10.610002] show_stack+0x1c/0x6c
      [ 10.613305] dump_stack_lvl+0x64/0x7c
      [ 10.616964] dump_stack+0x14/0x2c
      [ 10.620266] dump_header+0x4c/0x1f8
      [ 10.623747] out_of_memory+0x2e8/0x330
      [ 10.627490] __alloc_pages_may_oom+0x110/0x190
      [ 10.631925] __alloc_pages_slowpath.constprop.0+0x5a8/0x8d0
      [ 10.637487] __alloc_pages+0x204/0x274
      [ 10.641224] alloc_page_interleave+0x20/0xc0
      [ 10.645486] alloc_pages+0x100/0x160
      [ 10.649050] vm_area_alloc_pages.constprop.0+0x120/0x130
      [ 10.654351] __vmalloc_area_node.constprop.0+0x100/0x2e0
      [ 10.659652] __vmalloc_node_range+0x114/0x1ac
      [ 10.663997] kvmalloc_node+0xe4/0x130
      [ 10.667649] btf_add_type.isra.0+0x8c/0x100
      [ 10.671825] btf_check_all_metas+0xf8/0x1f0
      [ 10.675996] btf_parse_vmlinux+0x104/0x1d4
      [ 10.680083] bpf_get_btf_vmlinux+0x60/0x70
      [ 10.684169] btf_get_module_btf+0xc8/0x12c
      [ 10.688253] register_btf_kfunc_id_set+0x28/0x124
      [ 10.692945] cubictcp_register+0x70/0x88
      [ 10.696861] do_one_initcall+0x48/0x2c0
      [ 10.700686] do_initcalls+0x100/0x13c
      [ 10.704341] kernel_init_freeable+0x164/0x1ac
      [ 10.708686] kernel_init+0x28/0x140
      [ 10.712165] ret_from_fork+0x10/0x20
      [ 10.715752] Mem-Info:
      [ 10.718020] active_anon:0 inactive_anon:510 isolated_anon:0
      [ 10.718020] active_file:0 inactive_file:0 isolated_file:0
      [ 10.718020] unevictable:0 dirty:0 writeback:0
      [ 10.718020] slab_reclaimable:136 slab_unreclaimable:926
      [ 10.718020] mapped:0 shmem:517 pagetables:3 bounce:0
      [ 10.718020] kernel_misc_reclaimable:0
      [ 10.718020] free:43 free_pcp:30 free_cma:0
      [ 10.751726] Node 2 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:0kB pagetables:0kB all_unreclaimable? no
      [ 10.778819] Node 3 active_anon:0kB inactive_anon:32640kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:33088kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:4672kB pagetables:192kB all_unreclaimable? yes
      [ 10.807124] Node 2 DMA free:0kB boost:0kB min:0kB low:0kB high:0kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:130624kB managed:0kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
      ......

      Expected results:
      No OOM.

      Additional info:

              piliu@redhat.com Pingfan Liu
              rhn-support-jieli Jie Li
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: