Loading...

Type: Bug
Resolution: Unresolved
Priority: Normal
Fix Version/s: rhel-10.2
Affects Version/s: CentOS Stream 9
Component/s: mdadm
Labels:
None

Fixed in Build:
kernel-6.12.0-154.el10
Regression:
Yes
Severity:
Important
Keywords:

TestOnly

AssignedTeam:
rhel-storage-crs

Story Points:
2
ACKs Check:

Dev ack
Blocked:
False
Ready:
False
Blocked Reason:

Hide

None

Show
None
Product Documentation Required:
None
Sprint:
None

Preliminary Testing:
Pass
Errata Link:
https://errata.engineering.redhat.com/advisory/154161
Test Coverage:
None

ProdDocsReview-CCS:
Unspecified
ProdDocsReview-Dev:
Unspecified
ProdDocsReview-QE:
Unspecified

Experience:

PX Impact Score:
SFDC Cases Counter:
SFDC Cases Open:
SFDC Cases Links:

Planning:
None

What were you trying to do that didn't work?

Recently both our upstream and downstream systemd integration test jobs started failing on CentOS Stream 9 in tests that utilize mdadm:

[   19.582974] TEST-64-UDEV-STORAGE.sh[1027]: + mdadm --assemble /dev/md/mdmirror --name mdmirror -v
[   19.585143] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: looking for devices for /dev/md/mdmirror
[   20.586814] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no recogniseable superblock on /dev/sde
[   21.739799] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no recogniseable superblock on /dev/sdd
[   22.972536] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/sdc (Expected magic a92b4efc, got 00000000)
[   22.972536] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/sdc
[   22.976700] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda3 (Expected magic a92b4efc, got 00000040)
[   22.976700] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda3
[   22.977537] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda2 (Expected magic a92b4efc, got 00000401)
[   22.977537] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda2
[   22.978465] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda1 (Expected magic a92b4efc, got 41615252)
[   22.978465] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda1
[   22.980767] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda (Expected magic a92b4efc, got 00000000)
[   22.980767] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda
[   23.001493] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: /dev/sda is identified as a member of /dev/md/mdmirror, slot 0.
[   23.003299] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: /dev/sdb is identified as a member of /dev/md/mdmirror, slot 1.
[   23.011911] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: Unable to initialize sysfs

This seems to be the same issue that was already addressed in Fedora: https://bugzilla.redhat.com/show_bug.cgi?id=2388455

Please provide the package NVR for which the bug is seen:

mdadm-4.4-2.el9.x86_64.rpm

How reproducible is this bug?:

always

Steps to reproduce

[   18.252530] systemd[1]: Starting TEST-64-UDEV-STORAGE-mdadm_basic.service - TEST-64-UDEV-STORAGE-mdadm_basic...
[   18.338075] TEST-64-UDEV-STORAGE.sh[1027]: + set -o pipefail
[   18.353616] TEST-64-UDEV-STORAGE.sh[1027]: + udevadm settle
[   18.365418] TEST-64-UDEV-STORAGE.sh[1027]: + udevadm control --log-level debug
[   18.371141] TEST-64-UDEV-STORAGE.sh[1027]: + lsblk -a
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: NAME   MAJ:MIN RM  SIZE RO TYPE MOUNTPOINTS
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: sda      8:0    0   64M  0 disk
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: sdb      8:16   0   64M  0 disk
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: sdc      8:32   0   64M  0 disk
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: sdd      8:48   0   64M  0 disk
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: sde      8:64   0   64M  0 disk
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: vda    252:0    0  9.5G  0 disk
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: ├─vda1 252:1    0    1G  0 part /boot
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: ├─vda2 252:2    0    8G  0 part /
[   18.404269] TEST-64-UDEV-STORAGE.sh[1032]: └─vda3 252:3    0  498M  0 part
[   18.424902] TEST-64-UDEV-STORAGE.sh[1027]: + echo 'Check if all symlinks under /dev/disk/ are valid (pre-test)'
[   18.424902] TEST-64-UDEV-STORAGE.sh[1027]: Check if all symlinks under /dev/disk/ are valid (pre-test)
[   18.424902] TEST-64-UDEV-STORAGE.sh[1027]: + helper_check_device_symlinks
[   18.426152] TEST-64-UDEV-STORAGE.sh[1033]: + set +x
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + command -v testcase_mdadm_basic
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: testcase_mdadm_basic
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + echo TEST_FUNCTION_NAME=testcase_mdadm_basic
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: TEST_FUNCTION_NAME=testcase_mdadm_basic
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + testcase_mdadm_basic
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + local i part_name raid_name raid_dev uuid
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + expected_symlinks=()
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + local expected_symlinks
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + devices=('/dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm0' '/dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm1' '/dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm2' '/dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm3' '/dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm4')
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + local devices
[   18.912101] TEST-64-UDEV-STORAGE.sh[1027]: + ls -l /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm0 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm1 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm2 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm3 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm4
[   18.932520] TEST-64-UDEV-STORAGE.sh[1148]: lrwxrwxrwx 1 root root 9 Nov  1 16:21 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm0 -> ../../sda
[   18.932520] TEST-64-UDEV-STORAGE.sh[1148]: lrwxrwxrwx 1 root root 9 Nov  1 16:21 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm1 -> ../../sdb
[   18.932520] TEST-64-UDEV-STORAGE.sh[1148]: lrwxrwxrwx 1 root root 9 Nov  1 16:21 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm2 -> ../../sdc
[   18.932520] TEST-64-UDEV-STORAGE.sh[1148]: lrwxrwxrwx 1 root root 9 Nov  1 16:21 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm3 -> ../../sdd
[   18.932520] TEST-64-UDEV-STORAGE.sh[1148]: lrwxrwxrwx 1 root root 9 Nov  1 16:21 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm4 -> ../../sde
[   18.938429] TEST-64-UDEV-STORAGE.sh[1027]: + echo 'Mirror raid (RAID 1)'
[   18.938429] TEST-64-UDEV-STORAGE.sh[1027]: Mirror raid (RAID 1)
[   18.938429] TEST-64-UDEV-STORAGE.sh[1027]: + raid_name=mdmirror
[   18.938429] TEST-64-UDEV-STORAGE.sh[1027]: + raid_dev=/dev/md/mdmirror
[   18.938429] TEST-64-UDEV-STORAGE.sh[1027]: + part_name=mdmirror_part
[   18.938429] TEST-64-UDEV-STORAGE.sh[1027]: + uuid=aaaaaaaa:bbbbbbbb:cccccccc:00000001
[   18.938429] TEST-64-UDEV-STORAGE.sh[1027]: + expected_symlinks=("$raid_dev" "/dev/disk/by-id/md-name-H:$raid_name" "/dev/disk/by-id/md-uuid-$uuid" "/dev/disk/by-label/$part_name")
[   18.947268] TEST-64-UDEV-STORAGE.sh[1149]: + printf 'y\ny\n'
[   18.949840] TEST-64-UDEV-STORAGE.sh[1150]: + mdadm --create /dev/md/mdmirror --name mdmirror --uuid aaaaaaaa:bbbbbbbb:cccccccc:00000001 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm0 /dev/disk/by-id/scsi-0systemd_foobar_deadbeefmdadm1 -v -f --level=1 --raid-devices=2
[   19.009638] TEST-64-UDEV-STORAGE.sh[1150]: To optimalize recovery speed, it is recommended to enable write-indent bitmap, do you want to enable it now? [y/N]? mdadm: Note: this array has metadata at the start and
[   19.009638] TEST-64-UDEV-STORAGE.sh[1150]:     may not be suitable as a boot device.  If you plan to
[   19.009638] TEST-64-UDEV-STORAGE.sh[1150]:     store '/boot' on this device please ensure that
[   19.009638] TEST-64-UDEV-STORAGE.sh[1150]:     your boot-loader understands md/v1.x metadata, or use
[   19.009638] TEST-64-UDEV-STORAGE.sh[1150]:     --metadata=0.90
[   19.069297] TEST-64-UDEV-STORAGE.sh[1150]: mdadm: size set to 64512K
[   19.361991] TEST-64-UDEV-STORAGE.sh[1150]: Continue creating array [y/N]? mdadm: Defaulting to version 1.2 metadata
[   19.361991] TEST-64-UDEV-STORAGE.sh[1150]: mdadm: array /dev/md/mdmirror started.
[   19.363813] TEST-64-UDEV-STORAGE.sh[1027]: + udevadm wait --settle --timeout=30 /dev/md/mdmirror
[   19.385745] TEST-64-UDEV-STORAGE.sh[1027]: + mkfs.ext4 -L mdmirror_part /dev/md/mdmirror
[   19.393298] TEST-64-UDEV-STORAGE.sh[1164]: mke2fs 1.46.5 (30-Dec-2021)
[   19.418382] TEST-64-UDEV-STORAGE.sh[1164]: [74B blob data]
[   19.419185] TEST-64-UDEV-STORAGE.sh[1164]: Creating filesystem with 64512 1k blocks and 16128 inodes
[   19.419185] TEST-64-UDEV-STORAGE.sh[1164]: Filesystem UUID: 7f7a262e-2704-4aa3-b34b-e731746fb73e
[   19.419185] TEST-64-UDEV-STORAGE.sh[1164]: Superblock backups stored on blocks:
[   19.419185] TEST-64-UDEV-STORAGE.sh[1164]:         8193, 24577, 40961, 57345
[   19.419185] TEST-64-UDEV-STORAGE.sh[1164]: [41B blob data]
[   19.424441] TEST-64-UDEV-STORAGE.sh[1164]: [38B blob data]
[   19.463108] TEST-64-UDEV-STORAGE.sh[1164]: Creating journal (4096 blocks): done
[   19.474415] TEST-64-UDEV-STORAGE.sh[1164]: [75B blob data]
[   19.475210] TEST-64-UDEV-STORAGE.sh[1027]: + udevadm trigger --settle /dev/md/mdmirror
[   19.506158] TEST-64-UDEV-STORAGE.sh[1027]: + udevadm wait --settle --timeout=30 /dev/md/mdmirror /dev/disk/by-id/md-name-H:mdmirror /dev/disk/by-id/md-uuid-aaaaaaaa:bbbbbbbb:cccccccc:00000001 /dev/disk/by-label/mdmirror_part
[   19.536592] TEST-64-UDEV-STORAGE.sh[1027]: + for i in {0..9}
[   19.536592] TEST-64-UDEV-STORAGE.sh[1027]: + echo 'Disassemble - reassemble loop, iteration #0'
[   19.538823] TEST-64-UDEV-STORAGE.sh[1027]: Disassemble - reassemble loop, iteration #0
[   19.538823] TEST-64-UDEV-STORAGE.sh[1027]: + mdadm -v --stop /dev/md/mdmirror
[   19.577639] TEST-64-UDEV-STORAGE.sh[1170]: mdadm: stopped /dev/md/mdmirror
[   19.580423] TEST-64-UDEV-STORAGE.sh[1027]: + udevadm wait --settle --timeout=30 --removed /dev/md/mdmirror /dev/disk/by-id/md-name-H:mdmirror /dev/disk/by-id/md-uuid-aaaaaaaa:bbbbbbbb:cccccccc:00000001 /dev/disk/by-label/mdmirror_part
[   19.582974] TEST-64-UDEV-STORAGE.sh[1027]: + mdadm --assemble /dev/md/mdmirror --name mdmirror -v
[   19.585143] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: looking for devices for /dev/md/mdmirror
[   20.586814] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no recogniseable superblock on /dev/sde
[   21.739799] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no recogniseable superblock on /dev/sdd
[   22.972536] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/sdc (Expected magic a92b4efc, got 00000000)
[   22.972536] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/sdc
[   22.976700] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda3 (Expected magic a92b4efc, got 00000040)
[   22.976700] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda3
[   22.977537] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda2 (Expected magic a92b4efc, got 00000401)
[   22.977537] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda2
[   22.978465] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda1 (Expected magic a92b4efc, got 41615252)
[   22.978465] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda1
[   22.980767] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: No super block found on /dev/vda (Expected magic a92b4efc, got 00000000)
[   22.980767] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: no RAID superblock on /dev/vda
[   23.001493] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: /dev/sda is identified as a member of /dev/md/mdmirror, slot 0.
[   23.003299] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: /dev/sdb is identified as a member of /dev/md/mdmirror, slot 1.
[   23.011911] TEST-64-UDEV-STORAGE.sh[1172]: mdadm: Unable to initialize sysfs
[   23.012143] systemd[1]: TEST-64-UDEV-STORAGE-mdadm_basic.service: Main process exited, code=exited, status=1/FAILURE
[   23.012283] systemd[1]: TEST-64-UDEV-STORAGE-mdadm_basic.service: Failed with result 'exit-code'.
[   23.012508] systemd[1]: Failed to start TEST-64-UDEV-STORAGE-mdadm_basic.service - TEST-64-UDEV-STORAGE-mdadm_basic.
[   23.016740] systemd[1]: TEST-64-UDEV-STORAGE-mdadm_basic.service: Consumed 2.148s CPU time over 4.759s wall clock time.

Full journal from the test VM: https://mrc0mmand.fedorapeople.org/journals/TEST-64-UDEV-STORAGE-mdadm_basic.journal.tar.gz

links to

RHSA-2025:154161 kernel update

Details

Description

What were you trying to do that didn't work?

Please provide the package NVR for which the bug is seen:

How reproducible is this bug?:

Steps to reproduce

Attachments

Issue Links

Easy Agile Planning Poker

Activity

People

Dates