Uploaded image for project: 'RHEL'
  1. RHEL
  2. RHEL-46807

[Upgrade] leapp upgrade fails when NVMe-FC LVs added to /etc/fstab [IPU 8 ->9]

    • None
    • None
    • rhel-sst-upgrades
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • x86_64
    • None

      What were you trying to do that didn't work?

      Attempted an upgrade with Leapp from RHEL-8.10 to RHEL-9.5. The system in test has both FC Luns and NVMe-FC Namespaces mounted:

       

      # mount |grep vol
      /dev/mapper/n_vg_f-nvol--2--f on /mnt/qa/n_vg_f/nvol-2-f type xfs (rw,relatime,seclabel,attr2,inode64,logbufs=8,logbsize=32k,sunit=128,swidth=640,noquota)
      /dev/mapper/n_vg_f-nvol--4--f on /mnt/qa/n_vg_f/nvol-4-f type xfs (rw,relatime,seclabel,attr2,inode64,logbufs=8,logbsize=32k,sunit=128,swidth=640,noquota)
      /dev/mapper/n_vg_f-nvol--1--f on /mnt/qa/n_vg_f/nvol-1-f type ext4 (rw,relatime,seclabel,stripe=80)
      /dev/mapper/n_vg_f-nvol--3--f on /mnt/qa/n_vg_f/nvol-3-f type ext4 (rw,relatime,seclabel,stripe=80)
      /dev/mapper/nvme_vg_f-nvme--vol--3--f on /mnt/qa/nvme_vg_f/nvme-vol-3-f type ext4 (rw,relatime,seclabel,stripe=80)
      /dev/mapper/nvme_vg_f-nvme--vol--4--f on /mnt/qa/nvme_vg_f/nvme-vol-4-f type xfs (rw,relatime,seclabel,attr2,inode64,logbufs=8,logbsize=32k,sunit=128,swidth=640,noquota)
      /dev/mapper/nvme_vg_f-nvme--vol--1--f on /mnt/qa/nvme_vg_f/nvme-vol-1-f type ext4 (rw,relatime,seclabel,stripe=80)
      /dev/mapper/nvme_vg_f-nvme--vol--2--f on /mnt/qa/nvme_vg_f/nvme-vol-2-f type xfs (rw,relatime,seclabel,attr2,inode64,logbufs=8,logbsize=32k,sunit=128,swidth=640,noquota)
      
      # cat /etc/fstab |grep vol
      UUID=bf8c9233-088d-4be7-8ed0-5f796b94560d /mnt/qa/nvme_vg_f/nvme-vol-1-f        ext4     defaults        0 0
      UUID=b3bb900e-a624-4555-888a-6e106e72e725 /mnt/qa/nvme_vg_f/nvme-vol-2-f        xfs     defaults        0 0
      UUID=b8db0f66-3a74-42ec-a146-9fdb400883e6 /mnt/qa/nvme_vg_f/nvme-vol-3-f        ext4     defaults        0 0
      UUID=fe52b509-1fdb-4d4f-b690-6502cf7e8b68 /mnt/qa/nvme_vg_f/nvme-vol-4-f        xfs     defaults        0 0
      UUID=d43c2395-50a5-4dbc-a4ae-97e8ca91e28a /mnt/qa/n_vg_f/nvol-1-f        ext4     defaults        0 0
      UUID=87169ead-3c3a-46c3-acc8-6c5fb6715147 /mnt/qa/n_vg_f/nvol-2-f        xfs    defaults        0 0
      UUID=0378deaf-1bf1-4c57-9d48-64d63d6c0550 /mnt/qa/n_vg_f/nvol-3-f        ext4     defaults        0 0
      UUID=7b105ecc-feac-404e-9030-8d46f257c8ab /mnt/qa/n_vg_f/nvol-4-f        xfs    defaults        0 0
      
      # blkid |grep vol
      /dev/mapper/n_vg_f-nvol--1--f: UUID="d43c2395-50a5-4dbc-a4ae-97e8ca91e28a" BLOCK_SIZE="4096" TYPE="ext4"
      /dev/mapper/n_vg_f-nvol--2--f: UUID="87169ead-3c3a-46c3-acc8-6c5fb6715147" BLOCK_SIZE="4096" TYPE="xfs"
      /dev/mapper/n_vg_f-nvol--3--f: UUID="0378deaf-1bf1-4c57-9d48-64d63d6c0550" BLOCK_SIZE="4096" TYPE="ext4"
      /dev/mapper/n_vg_f-nvol--4--f: UUID="7b105ecc-feac-404e-9030-8d46f257c8ab" BLOCK_SIZE="4096" TYPE="xfs"
      /dev/mapper/nvme_vg_f-nvme--vol--1--f: UUID="bf8c9233-088d-4be7-8ed0-5f796b94560d" BLOCK_SIZE="4096" TYPE="ext4"
      /dev/mapper/nvme_vg_f-nvme--vol--2--f: UUID="b3bb900e-a624-4555-888a-6e106e72e725" BLOCK_SIZE="4096" TYPE="xfs"
      /dev/mapper/nvme_vg_f-nvme--vol--3--f: UUID="b8db0f66-3a74-42ec-a146-9fdb400883e6" BLOCK_SIZE="4096" TYPE="ext4"
      /dev/mapper/nvme_vg_f-nvme--vol--4--f: UUID="fe52b509-1fdb-4d4f-b690-6502cf7e8b68" BLOCK_SIZE="4096" TYPE="xfs"

      Attempted the upgrade which is failing with the message below:

       

      [   46.195237] upgrade[1715]: ============================================================ 
      [   46.195260] upgrade[1715]:                     UNSUPPORTED UPGRADE 
      [   46.195280] upgrade[1715]: ============================================================ 
      [   46.195398] upgrade[2148]: 2024-07-09 05:34:52.973 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: External command has started: ['/bin/mount', '/boot'] 
      [   46.195420] upgrade[2148]: mount: /boot: /dev/sda1 already mounted on /boot. 
      [   46.195438] upgrade[2148]: 2024-07-09 05:34:52.985 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: Command ['/bin/mount', '/boot'] failed with exit code 32. 
      [   46.195456] upgrade[2148]: 2024-07-09 05:34:52.987 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: External command has finished: ['/bin/mount', '/boot'] 
      [   46.195475] upgrade[2148]: 2024-07-09 05:34:52.989 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: External command has started: ['/usr/sbin/grubby', '--remove-kernel=/boot/vmlinuz-upgrade.x86_64'] 
      [   46.195493] upgrade[2148]: 2024-07-09 05:34:53.107 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: External command has finished: ['/usr/sbin/grubby', '--remove-kernel=/boot/vmlinuz-upgrade.x86_64'] 
      [   46.195512] upgrade[2148]: 2024-07-09 05:34:53.108 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: External command has started: ['/bin/mount', '-a'] 
      [   46.195532] upgrade[2148]: mount: /mnt/qa/nvme_vg_f/nvme-vol-1-f: can't find UUID=b1d6fbd2-2b00-48dc-b320-12b449ae1c0c. 
      [   46.195550] upgrade[2148]: mount: /mnt/qa/nvme_vg_f/nvme-vol-2-f: can't find UUID=5ccb7cbe-1770-4b5f-8404-6f4d87dd1cdf. 
      [   46.527608] upgrade[2148]: mount: /mnt/qa/nvme_vg_f/nvme-vol-3-f: can't find UUID=ffbd2541-e3a0-4cc9-aa07-542484495b90. 
      [   46.527634] upgrade[2148]: mount: /mnt/qa/nvme_vg_f/nvme-vol-4-f: can't find UUID=3936eb1b-e866-452f-bda2-b5d4e169f178. 
      [   46.527652] upgrade[2148]: 2024-07-09 05:34:53.188 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: Command ['/bin/mount', '-a'] failed with exit code 32. 
      [   46.527670] upgrade[2148]: 2024-07-09 05:34:53.190 DEBUG    PID: 436 leapp.workflow.InitRamStart.remove_upgrade_boot_entry: External command has finished: ['/bin/mount', '-a'] 

      Below is the job where the problem was observed:

      https://beaker.engineering.redhat.com/jobs/9548918

      Please provide the package NVR for which bug is seen:

      leapp-0.17.0-100.20240703131737393408.master.12.gbf4fd61.el8

      How reproducible: Often

      Steps to reproduce

      1. Connect to NVMe-FC namespaces
      2. Create PV, VG, and LVs
      3. Create filesystem and mount
      4. add entries to /etc/fstab

              leapp-notifications leapp-notifications
              mpatalan Marco Patalano
              leapp-notifications leapp-notifications
              RHEL Upgrades QE Team RHEL Upgrades QE Team
              Miriam Portman Miriam Portman
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: