Uploaded image for project: 'RHEL'
  1. RHEL
  2. RHEL-7990

"rpm -e" in libguestfs appliance (guest) triggers xfs_iunlink_lookup() WARNING [kernel-5.14.0-347.el9]

    • kernel-5.14.0-478.el9
    • Yes
    • Low
    • rhel-sst-filesystems
    • ssg_filesystems_storage_and_HA
    • 20
    • 24
    • 5
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • If docs needed, set a value
    • None

      Description of problem:
      coredump happens when converting a RHEL7.4 guest which installs vmtools

      Version-Release number of selected component (if applicable):
      virt-v2v-2.3.4-5.el9.x86_64
      libvirt-9.3.0-2.el9.x86_64
      qemu-kvm-8.0.0-9.el9.x86_64
      libguestfs-1.50.1-6.el9.x86_64

      How reproducible:
      100%

      Steps to Reproduce:
      1. Prepare a RHEL7.4 guest, then install vmtools on it.
      2. Run virt-v2v to convert the VM.
      3. Check the log.

      commandrvf: rpm -e --allmatches open-vm-tools-desktop open-vm-tools
      [ 37.653365] -----------[ cut here ]-----------
      [ 37.653370] WARNING: CPU: 5 PID: 615 at fs/xfs/xfs_inode.c:1840 xfs_iunlink+0x154/0x1e0 [xfs]
      [ 37.659150] Modules linked in: xfs dm_mod sg virtio_snd snd_pcm snd_timer snd soundcore libcrc32c crc8 crc7 crc_itu_t virtiofs fuse ext4 mbcache jbd2 virtio_vdpa vdpa virtio_mem virtio_input virtio_dma_buf virtio_balloon virtio_scsi sd_mod t10_pi nd_pmem nd_btt virtio_net net_failover failover virtio_console virtio_blk ata_piix libata nfit libnvdimm crc32_generic crct10dif_pclmul crc32c_intel crc32_pclmul
      [ 37.672362] CPU: 5 PID: 615 Comm: rpm Not tainted 5.14.0-347.el9.x86_64 #1
      [ 37.675023] Hardware name: Red Hat KVM/RHEL, BIOS 1.16.1-1.el9 04/01/2014
      [ 37.677598] RIP: 0010:xfs_iunlink+0x154/0x1e0 [xfs]
      [ 37.688127] Code: 77 3a 4c 89 4c 24 08 e8 ca f0 5c da 44 89 f6 48 8d bd c0 00 00 00 e8 3b 0e a8 da 49 89 c4 48 85 c0 74 07 48 83 78 20 00 75 2c <0f> 0b e8 05 32 5d da 41 bc 8b ff ff ff e9 fb fe ff ff 48 c7 c6 c6
      [ 37.694974] RSP: 0018:ffffbddf80ddbd38 EFLAGS: 00010246
      [ 37.696953] RAX: 0000000000000000 RBX: 000000000009c686 RCX: 0000000000000006
      [ 37.699629] RDX: ffff9a4243bf7d98 RSI: ffff9a4243bf7de8 RDI: 00000000000d8146
      [ 37.702344] RBP: ffff9a42dfa1a600 R08: 0000000000000000 R09: ffff9a42dfa1a6c0
      [ 37.705073] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
      [ 37.707755] R13: ffff9a42dfd6c740 R14: 00000000000d8146 R15: ffff9a425055f400
      [ 37.710450] FS: 00007f0a20cf4800(0000) GS:ffff9a42dcd40000(0000) knlGS:0000000000000000
      [ 37.713454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
      [ 37.715629] CR2: 0000000001ab3558 CR3: 0000000004ad8000 CR4: 00000000000406e0
      [ 37.718767] Call Trace:
      [ 37.719747] <TASK>
      [ 37.723503] ? show_trace_log_lvl+0x1c4/0x2df
      [ 37.726701] ? show_trace_log_lvl+0x1c4/0x2df
      [ 37.728410] ? xfs_remove+0x269/0x390 [xfs]
      [ 37.730482] ? xfs_iunlink+0x154/0x1e0 [xfs]
      [ 37.732541] ? __warn+0x81/0x110
      [ 37.733830] ? xfs_iunlink+0x154/0x1e0 [xfs]
      [ 37.735890] ? report_bug+0x10a/0x140
      [ 37.737313] ? handle_bug+0x3c/0x70
      [ 37.738685] ? exc_invalid_op+0x14/0x70
      [ 37.740187] ? asm_exc_invalid_op+0x16/0x20
      [ 37.741798] ? xfs_iunlink+0x154/0x1e0 [xfs]
      [ 37.743914] ? xfs_iunlink+0x145/0x1e0 [xfs]
      [ 37.745976] xfs_remove+0x269/0x390 [xfs]
      [ 37.747969] xfs_vn_unlink+0x53/0xa0 [xfs]
      [ 37.749970] vfs_unlink+0x117/0x290
      [ 37.751383] do_unlinkat+0x1af/0x2e0
      [ 37.752776] __x64_sys_unlink+0x3e/0x60
      [ 37.754268] ? _pfx__x64_sys_unlink+0x10/0x10
      [ 37.756015] do_syscall_64+0x5c/0x90
      [ 37.757405] ? syscall_exit_to_user_mode+0x12/0x30
      [ 37.759238] ? do_syscall_64+0x69/0x90
      [ 37.760699] entry_SYSCALL_64_after_hwframe+0x72/0xdc
      [ 37.762597] RIP: 0033:0x7f0a1c6eaf77
      [ 37.767040] Code: 48 3d 00 f0 ff ff 77 03 48 98 c3 48 8b 15 09 0f 2d 00 f7 d8 64 89 02 48 83 c8 ff eb eb 66 0f 1f 44 00 00 b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d e1 0e 2d 00 f7 d8 64 89 01 48
      [ 37.773900] RSP: 002b:00007ffe88d79138 EFLAGS: 00000206 ORIG_RAX: 0000000000000057
      [ 37.776804] RAX: ffffffffffffffda RBX: 0000000001ab33a0 RCX: 00007f0a1c6eaf77
      [ 37.779430] RDX: 00007ffe88d790a0 RSI: 0000000000000000 RDI: 0000000001ab3550
      [ 37.782080] RBP: 0000000001ab3550 R08: 0000000000000001 R09: 0000000000000000
      [ 37.784761] R10: 2d6e65706f2f6572 R11: 0000000000000206 R12: 0000000000000000
      [ 37.787414] R13: 0000000001aa25d0 R14: 0000000000000000 R15: 0000000000000006
      [ 37.790082] </TASK>
      [ 37.790922] --[ end trace 88eb53a6eaeed878 ]--
      [ 37.792694] XFS (dm-1): Internal error xfs_trans_cancel at line 1097 of file fs/xfs/xfs_trans.c. Caller xfs_remove+0x168/0x390 [xfs]
      [ 37.793192] CPU: 5 PID: 615 Comm: rpm Tainted: G W ------- — 5.14.0-347.el9.x86_64 #1
      [ 37.793199] Hardware name: Red Hat KVM/RHEL, BIOS 1.16.1-1.el9 04/01/2014
      [ 37.793201] Call Trace:
      [ 37.793205] <TASK>
      warning: file /u[ 37.793209] dump_stack_lvl+0x34/0x48
      sr/share/open-vm[ 37.793219] xfs_trans_cancel+0x123/0x150 [xfs]
      -tools/messages/[ 37.793626] xfs_remove+0x168/0x390 [xfs]
      ja/vmware-vgauth[ 37.794074] xfs_vn_unlink+0x53/0xa0 [xfs]
      -cmd.vmsg: remov[ 37.794471] vfs_unlink+0x117/0x290
      e failed: Struct[ 37.794480] do_unlinkat+0x1af/0x2e0
      ure needs cleani[ 37.794487] __x64_sys_unlink+0x3e/0x60
      ng
      warning: fil[ 37.794491] ? _pfx__x64_sys_unlink+0x10/0x10
      e /usr/share/ope[ 37.794495] do_syscall_64+0x5c/0x90
      n-vm-tools/messa[ 37.794504] ? syscall_exit_to_user_mode+0x12/0x30
      ges/ja/vmtoolsd.[ 37.794510] ? do_syscall_64+0x69/0x90
      vmsg: remove fai[ 37.794516] entry_SYSCALL_64_after_hwframe+0x72/0xdc
      led: Input/outpu[ 37.794523] RIP: 0033:0x7f0a1c6eaf77
      t error
      warning[ 37.794537] Code: 48 3d 00 f0 ff ff 77 03 48 98 c3 48 8b 15 09 0f 2d 00 f7 d8 64 89 02 48 83 c8 ff eb eb 66 0f 1f 44 00 00 b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d e1 0e 2d 00 f7 d8 64 89 01 48
      : file /usr/shar[ 37.794541] RSP: 002b:00007ffe88d79138 EFLAGS: 00000206 ORIG_RAX: 0000000000000057
      e/open-vm-tools/[ 37.794547] RAX: ffffffffffffffda RBX: 0000000001ab33a0 RCX: 00007f0a1c6eaf77
      messages/ja/tool[ 37.794550] RDX: 00007ffe88d790a0 RSI: 0000000000000000 RDI: 0000000001ab3550
      boxcmd.vmsg: rem[ 37.794553] RBP: 0000000001ab3550 R08: 0000000000000001 R09: 0000000000000000
      ove failed: Inpu[ 37.794556] R10: 2d6e65706f2f6572 R11: 0000000000000206 R12: 0000000000000000
      t/output error
      [ 37.794559] R13: 0000000001aa25d0 R14: 0000000000000000 R15: 0000000000000006
      warning: file /u[ 37.794565] </TASK>
      sr/share/open-vm[ 37.796201] XFS (dm-1): xfs_difree: xfs_ialloc_read_agi() returned error -5.
      -tools/messages/[ 37.796233] XFS (dm-1): xfs_difree: xfs_ialloc_read_agi() returned error -5.
      ja/libvgauth.la.[ 37.796256] XFS (dm-1): xfs_difree: xfs_ialloc_read_agi() returned error -5.
      vmsg: remove fai[ 37.797071] XFS (dm-1): Corruption of in-memory data (0x8) detected at xfs_trans_cancel+0x13c/0x150 [xfs] (fs/xfs/xfs_trans.c:1098). Shutting down filesystem.
      led: Input/outpu[ 37.797597] XFS (dm-1): Please unmount the filesystem and rectify the problem(s)
      t error

      Actual results:
      As description.

      Expected results:
      The V2V conversion should be success.

      Additional info:
      1. I can't reproduce it on rhel7.4 when vmtools is not installed.
      2. I also tried rhel7.9, but it's not reproduced.

        1. dmesg.txt
          75 kB
        2. journal.txt
          4 kB

              preichl@redhat.com Pavel Reichl
              xiaodwan@redhat.com Xiaodai Wang
              Pavel Reichl Pavel Reichl
              Zirong Lang Zirong Lang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated:
                Resolved: