Uploaded image for project: 'RHEL'
  1. RHEL
  2. RHEL-6410

anacondas encounters "malloc(): invalid size (unsorted)" before launching GUI installer

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Major Major
    • None
    • rhel-9.3.0
    • libdnf
    • None
    • Moderate
    • rhel-sst-cs-software-management
    • ssg_core_services
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • If docs needed, set a value
    • None

      Description of problem:
      During the past few rounds of KVM guest installation, we found the anaconda pane dead. When this problem is triggered, I can see some logs related to malloc from the console log.
      x86: malloc(): unsorted double linked list corrupted
      aarch64: malloc(): invalid size (unsorted)

      The ks using GUI mode
      [stdlog] 2023-07-19 05:09:07,271 avocado.virttest.tests.unattended_install DEBUG| Unattended install contents:
      [stdlog] 2023-07-19 05:09:07,271 avocado.virttest.tests.unattended_install DEBUG| cdrom
      [stdlog] 2023-07-19 05:09:07,272 avocado.virttest.tests.unattended_install DEBUG| graphical
      ...
      ...

      The problem can be triggered at anaconda-34.25.3.6-1.el9 and anaconda-34.25.3.7-1.el9, I suppose the new feature kernel switcher introduces this issue, of course, just a guess.

      Version-Release number of selected component (if applicable):
      RHEL-9.3.0-20230719.0-aarch64-dvd1.iso (anaconda 34.25.3.7-1.el9)

      How reproducible:
      6/100

      Steps to Reproduce:
      1. Start a qemu process for guest installation with "MALLOC_PERTURB_=1", example qemu command:
      MALLOC_PERTURB_=1 /usr/libexec/qemu-kvm \
      -name 'avocado-vt-vm1' \
      -sandbox on \
      -blockdev '

      {"node-name": "file_aavmf_code", "driver": "file", "filename": "/usr/share/edk2/aarch64/QEMU_EFI-silent-pflash.qcow2", "auto-read-only": true, "discard": "unmap"}

      ' \
      -blockdev '

      {"node-name": "drive_aavmf_code", "driver": "qcow2", "read-only": true, "file": "file_aavmf_code"}

      ' \
      -blockdev '

      {"node-name": "file_aavmf_vars", "driver": "file", "filename": "/root/avocado/data/avocado-vt/avocado-vt-vm1_rhel930-aarch64-64k-virtio-scsi_qcow2_filesystem_VARS.qcow2", "auto-read-only": true, "discard": "unmap"}

      ' \
      -blockdev '

      {"node-name": "drive_aavmf_vars", "driver": "qcow2", "read-only": false, "file": "file_aavmf_vars"}

      ' \
      -machine virt,gic-version=host,memory-backend=mem-machine_mem,pflash0=drive_aavmf_code,pflash1=drive_aavmf_vars \
      -device '

      {"id": "pcie-root-port-0", "driver": "pcie-root-port", "multifunction": true, "bus": "pcie.0", "addr": "0x1", "chassis": 1}

      ' \
      -device '

      {"id": "pcie-pci-bridge-0", "driver": "pcie-pci-bridge", "addr": "0x0", "bus": "pcie-root-port-0"}

      ' \
      -nodefaults \
      -device '

      {"id": "pcie-root-port-1", "port": 1, "driver": "pcie-root-port", "addr": "0x1.0x1", "bus": "pcie.0", "chassis": 2}

      ' \
      -device '

      {"driver": "virtio-gpu-pci", "bus": "pcie-root-port-1", "addr": "0x0"}

      ' \
      -m 8192 \
      -object '

      {"size": 8589934592, "id": "mem-machine_mem", "qom-type": "memory-backend-ram"}

      ' \
      -smp 4,maxcpus=4,cores=2,threads=1,clusters=1,sockets=2 \
      -cpu 'host' \
      -serial unix:'/var/tmp/avocado_60klyq8d/serial-serial0-20230719-050907-v6BwFrIg',server=on,wait=off \
      -device '

      {"id": "pcie-root-port-2", "port": 2, "driver": "pcie-root-port", "addr": "0x1.0x2", "bus": "pcie.0", "chassis": 3}

      ' \
      -device '

      {"driver": "qemu-xhci", "id": "usb1", "bus": "pcie-root-port-2", "addr": "0x0"}

      ' \
      -device '

      {"driver": "usb-tablet", "id": "usb-tablet1", "bus": "usb1.0", "port": "1"}

      ' \
      -device '

      {"id": "pcie-root-port-3", "port": 3, "driver": "pcie-root-port", "addr": "0x1.0x3", "bus": "pcie.0", "chassis": 4}

      ' \
      -device '

      {"id": "virtio_scsi_pci0", "driver": "virtio-scsi-pci", "bus": "pcie-root-port-3", "addr": "0x0"}

      ' \
      -blockdev '{"node-name": "file_image1", "driver": "file", "auto-read-only": true, "discard": "unmap", "aio": "threads", "filename": "/home/kvm_autotest_root/images/rhel930-aarch64-64k-virtio-scsi.qcow2", "cache": {"direct": true, "no-flush": false}}' \
      -blockdev '{"node-name": "drive_image1", "driver": "qcow2", "read-only": false, "cache":

      {"direct": true, "no-flush": false}

      , "file": "file_image1"}' \
      -device '

      {"driver": "scsi-hd", "id": "image1", "drive": "drive_image1", "write-cache": "on"}

      ' \
      -device '

      {"id": "pcie-root-port-4", "port": 4, "driver": "pcie-root-port", "addr": "0x1.0x4", "bus": "pcie.0", "chassis": 5}

      ' \
      -device '

      {"driver": "virtio-net-pci", "mac": "9a:4b:a3:a2:84:ef", "rombar": 0, "id": "idlGmTu3", "netdev": "idm5R4TI", "bus": "pcie-root-port-4", "addr": "0x0"}

      ' \
      -netdev tap,id=idm5R4TI,vhost=on,vhostfd=16,fd=10 \
      -blockdev '{"node-name": "file_cd1", "driver": "file", "auto-read-only": true, "discard": "unmap", "aio": "threads", "filename": "/home/kvm_autotest_root/iso/linux/RHEL-9.3.0-20230719.0-aarch64-dvd1.iso", "cache": {"direct": true, "no-flush": false}}' \
      -blockdev '{"node-name": "drive_cd1", "driver": "raw", "read-only": true, "cache":

      {"direct": true, "no-flush": false}

      , "file": "file_cd1"}' \
      -device '

      {"driver": "scsi-cd", "id": "cd1", "drive": "drive_cd1", "write-cache": "on"}

      ' \
      -blockdev '{"node-name": "file_unattended", "driver": "file", "auto-read-only": true, "discard": "unmap", "aio": "threads", "filename": "/home/kvm_autotest_root/images/rhel930-aarch64/ks.iso", "cache": {"direct": true, "no-flush": false}}' \
      -blockdev '{"node-name": "drive_unattended", "driver": "raw", "read-only": true, "cache":

      {"direct": true, "no-flush": false}

      , "file": "file_unattended"}' \
      -device '

      {"driver": "scsi-cd", "id": "unattended", "drive": "drive_unattended", "write-cache": "on"}

      ' \
      -kernel '/home/kvm_autotest_root/images/rhel930-aarch64/vmlinuz' \
      -append 'inst.sshd inst.repo=cdrom inst.ks=cdrom:/ks.cfg net.ifnames=0 console=ttyAMA0,38400' \
      -initrd '/home/kvm_autotest_root/images/rhel930-aarch64/initrd.img' \
      -vnc :0 \
      -rtc base=utc,clock=host,driftfix=slew \
      -no-shutdown \
      -enable-kvm \

      2. Check the console log

      Actual results:
      2023-07-19 05:09:38: [anaconda]1:main* 2:shell 3:log 4:sto><'echo -n "Switch tab: Alt+Tab | Help: F[m(B[?25h[1;1H[?25l[7m[24;1H[anaconda]1:main* 2:shell 3:log 4:storage-log >Switch tab: Alt+Tab | Help: F1 [m(B[?25h[1;1HStarting installer, one moment...
      2023-07-19 05:09:39: [?7727h
      2023-07-19 05:09:39: anaconda 34.25.3.7-1.el9 for Red Hat Enterprise Linux 9.3 (pre-release) started.[3;1H * installation log files are stored in /tmp during the installation
      2023-07-19 05:09:39: * shell is available on TTY2
      2023-07-19 05:09:39: * when reporting a bug add logs from /tmp as separate text/plain attachments
      2023-07-19 05:09:49: Queued start job for default target Main User Target.
      2023-07-19 05:09:49: Startup finished in 188ms.
      2023-07-19 05:09:53: malloc(): invalid size (unsorted)
      2023-07-19 05:09:53: Received SIGHUP.
      2023-07-19 05:09:53: Reloading.
      2023-07-19 05:09:53: [1;23r[23;1H
      2023-07-19 05:09:53: Pane is dead (signal[C6, Wed Jul 19 09:09:53 2023)[K[1;24r[23;50H[?25l[Hanaconda 34.25.3.7-1.el9 for Red Hat Enterprise Linux 9.3 (pre-release) started.[2;1H * installation log files are stored in /tmp during the installation[K
      2023-07-19 05:09:53: * shell is available on TTY2[K
      2023-07-19 05:09:53: * when reporting a bug add logs from /tmp as separate text/plain attachments[K
      2023-07-19 05:09:53: malloc(): invalid size (unsorted)[K

      Expected results:
      The installation can be completed

      Additional info:
      Besides the malloc problem, also some other errors can be found in different installation process.

      1.
      2023-07-19 05:18:17: Anaconda received signal 11!.
      2023-07-19 05:18:17: /usr/lib64/python3.9/site-packages/pyanaconda/_isys.so(+0x10b8)[0xffffa87ba0b8]
      2023-07-19 05:18:17: linux-vdso.so.1(__kernel_rt_sigreturn+0x0)[0xffffbb3397e0]
      2023-07-19 05:18:17: /lib64/libsolv.so.1(+0x39ec0)[0xffffa5c82ec0]
      2023-07-19 05:18:17: /lib64/libsolv.so.1(repodata_set_void+0x60)[0xffffa5c85730]
      2023-07-19 05:18:17: /lib64/libsolv.so.1(repodata_set_sourcepkg+0x30c)[0xffffa5c87e8c]
      2023-07-19 05:18:17: /lib64/libsolvext.so.1(+0x2a284)[0xffffa5c21284]
      2023-07-19 05:18:17: /lib64/libxml2.so.2(+0x1220bc)[0xffffabd5c0bc]
      2023-07-19 05:18:17: [1;23r[23;1H
      2023-07-19 05:18:17:
      2023-07-19 05:18:17:
      2023-07-19 05:18:17:
      2023-07-19 05:18:17: [10;1H/lib64/libxml2.so.2(+0x12b80c)[0xffffabd6580c]
      2023-07-19 05:18:17: /lib64/libxml2.so.2(xmlParseChunk+0x214)[0xffffabc869d4]
      2023-07-19 05:18:17: /lib64/libsolvext.so.1(+0x2e430)[0xffffa5c25430]
      2023-07-19 05:18:17: /lib64/libsolvext.so.1(repo_add_rpmmd+0xe4)[0xffffa5c1b3d4]
      2023-07-19 05:18:17: /lib64/libdnf.so.2(dnf_sack_load_repo+0x1cc)[0xffffa5d882b0]
      2023-07-19 05:18:17: /usr/lib64/python3.9/site-packages/hawkey/_hawkey.so(+0x25e9c)[0xffffa54f3e9c]
      2023-07-19 05:18:17: /lib64/libpython3.9.so.1.0(+0xd4820)[0xffffbaed4820]
      2023-07-19 05:18:17: /lib64/libpython3.9.so.1.0(_PyObject_Call+0x80)[0xffffbaed3220]
      2023-07-19 05:18:17: /lib64/libpython3.9.so.1.0(_PyEval_EvalFrameDefault+0x5454)[0xffffbaebf0b4]
      2023-07-19 05:18:17: /lib64/libpython3.9.so.1.0(+0xc8c30)[0xffffbaec8c30]
      2023-07-19 05:18:17: /lib64/libpython3.9.so.1.0(_PyEval_EvalFrameDefault+0x77c)[0xffffbaeba3dc][K
      2023-07-19 05:18:17: /lib64/libpython3.9.so.1.0(+0xb8c70)[0xffffbaeb8c70][K
      2023-07-19 05:18:17: /lib64/libpython3.9.so.1.0(_PyFunction_Vectorcall+0x168)[0xffffbaec89c8][K
      2023-07-19 05:18:17: [K[1;24r[23;1H
      2023-07-19 05:18:17: [New LWP 2324][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2325][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2521][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[1;23r[23;1H
      2023-07-19 05:18:17: [A[New LWP 2601]
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2694][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2695][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2702][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2704][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2707][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H[New LWP 2708][1;23r[23;1H
      2023-07-19 05:18:17: [K[1;24r[23;1H
      2023-07-19 05:18:19: [1;23r[23;1H
      2023-07-19 05:18:19:
      2023-07-19 05:18:19: [2A[Thread debugging using libthread_db enabled]
      2023-07-19 05:18:19: Using host libthread_db library "/lib64/libthread_db.so.1".[K
      2023-07-19 05:18:19: [K[1;24r[23;1H[1;23r[23;1H
      2023-07-19 05:18:19:
      2023-07-19 05:18:19: [2A0x0000ffffbacd112c in __futex_abstimed_wait_cancelable64 () from /lib64/libc.so.6[K
      2023-07-19 05:18:19: [K[1;24r[23;1H
      2023-07-19 05:18:21: [1;23r[23;1H
      2023-07-19 05:18:21: [ASaved corefile /tmp/anaconda.core.2296
      2023-07-19 05:18:21: [K[1;24r[23;1H[1;23r[23;1H
      2023-07-19 05:18:21: [AError waiting on gcore: Interrupted system call
      2023-07-19 05:18:21: [K[1;24r[23;1H[1;23r[23;1H
      2023-07-19 05:18:21: [A[Inferior 1 (process 2296) detached]
      2023-07-19 05:18:21: [K[1;24r[23;1HReceived SIGHUP.
      2023-07-19 05:18:21: Reloading.
      2023-07-19 05:18:21: [1;23r[23;1H
      2023-07-19 05:18:21: Pane is dead (status[C1, Wed Jul 19 09:18:21 2023)[K[1;24r[23;50H[?25l[H/lib64/libpython3.9.so.1.0(+0xc8c30)[0xffffbaec8c30][K
      2023-07-19 05:18:21: /lib64/libpython3.9.so.1.0(_PyEval_EvalFrameDefault+0x77c)[0xffffbaeba3dc][K
      2023-07-19 05:18:21: /lib64/libpython3.9.so.1.0(+0xb8c70)[0xffffbaeb8c70][K
      2023-07-19 05:18:21: /lib64/libpython3.9.so.1.0(_PyFunction_Vectorcall+0x168)[0xffffbaec89c8][K
      2023-07-19 05:18:21: [New LWP 2324][K
      2023-07-19 05:18:21: [New LWP 2325][K
      2023-07-19 05:18:21: [New LWP 2521][K
      2023-07-19 05:18:21: [New LWP 2601][K
      2023-07-19 05:18:21: [New LWP 2694][K
      2023-07-19 05:18:21: [New LWP 2695][K
      2023-07-19 05:18:21: [New LWP 2702][K
      2023-07-19 05:18:21: [New LWP 2704][K
      2023-07-19 05:18:21: [New LWP 2707][K
      2023-07-19 05:18:21: [New LWP 2708][K
      2023-07-19 05:18:21: [Thread debugging using libthread_db enabled][K
      2023-07-19 05:18:21: Using host libthread_db library "/lib64/libthread_db.so.1".[K
      2023-07-19 05:18:21: 0x0000ffffbacd112c in __futex_abstimed_wait_cancelable64 () from /lib64/libc.so.6[K
      2023-07-19 05:18:21: Saved corefile /tmp/anaconda.core.2296[K
      2023-07-19 05:18:21: Error waiting on gcore: Interrupted system call[K

      2.
      2023-07-17 07:25:49: python3: /builddir/build/BUILD/libdnf-0.69.0/libdnf/sack/query.cpp:2316: void libdnf::Query::Impl::apply(): Assertion `m.size == result->getMap()->size' failed.[8;1H
      2023-07-17 07:25:49: Received SIGHUP.
      2023-07-17 07:25:49: Reloading.

      3.
      2023-07-18 00:00:18: (anaconda:2054): Gtk-[1mWARNING[m(B **: 04:00:18.933: Could not load a pixbuf from icon theme.
      2023-07-18 00:00:18: This may indicate that pixbuf loaders or the mime database could not be found.
      2023-07-18 00:00:19: **
      2023-07-18 00:00:19: Gtk:ERROR:../gtk/gtkiconhelper.c:494:ensure_surface_for_gicon: assertion failed (error == NULL): Failed to load /usr/share/icons/Adwaita/16x16/status/image-missing.png: Error reading from file: Input/output error (g-io-error-quark, 0)
      2023-07-18 00:00:19: Bail out! Gtk:ERROR:../gtk/gtkiconhelper.c:494:ensure_surface_for_gicon: assertion failed (error == NULL): Failed to load /usr/share/icons/Adwaita/16x16/status/image-missing.png: Error reading from file: Input/output error (g-io-error-quark, 0)
      2023-07-18 00:00:19: Received SIGHUP.
      2023-07-18 00:00:19: Reloading.
      2023-07-18 00:00:19: [1;23r[23;1H
      2023-07-18 00:00:19: Pane is dead (signal[C6, Tue Jul 18 04:00:19 2023)[K[1;24r[23;50H[?25l[Hanaconda 34.25.3.7-1.el9 for Red Hat Enterprise Linux 9.3 (pre-release) started.[2;1H * installation log files are stored in /tmp during the installation[K
      2023-07-18 00:00:19: * shell is available on TTY2[K
      2023-07-18 00:00:19: * when reporting a bug add logs from /tmp as separate text/plain attachments[K
      2023-07-18 00:00:19: [K
      2023-07-18 00:00:19: (anaconda:2054): Gtk-[1mWARNING[m(B **: 04:00:18.933: Could not load a pixbuf from icon theme.[K
      2023-07-18 00:00:19: This may indicate that pixbuf loaders or the mime database could not be found.[K
      2023-07-18 00:00:19: **[K
      2023-07-18 00:00:19: Gtk:ERROR:../gtk/gtkiconhelper.c:494:ensure_surface_for_gicon: assertion failed (error == NULL): Failed to load /usr/share/icons/Adwaita/16x16/status/image-missing.png: Error reading from file: Input/output error (g-io-error-quark, 0)[K
      2023-07-18 00:00:19: Bail out! Gtk:ERROR:../gtk/gtkiconhelper.c:494:ensure_surface_for_gicon: assertion failed (error == NULL): Failed to load /usr/share/icons/Adwaita/16x16/status/image-missing.png: Error reading from file: Input/output error (g-io-error-quark, 0)[K

              mblaha@redhat.com Marek Blaha
              rhn-support-yihyu Yihuang Yu
              packaging-team-maint packaging-team-maint
              Software Management QE Software Management QE
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: