Loading...

Type: Bug
Resolution: Unresolved
Priority: Undefined
Fix Version/s: None
Affects Version/s: rhel-9.6
Component/s: lvm2
Labels:
None

Regression:
No
Severity:
Low

Pool Team:

rhel-sst-logical-storage
Sub-System Group:

ssg_filesystems_storage_and_HA

Story Points:
None
Blocked:
False
Blocked Reason:

Hide

None

Show
None
Product Documentation Required:
None
Sprint:
None

Preliminary Testing:
None
Test Coverage:
None

Experience:

SFDC Cases Counter:
SFDC Cases Open:
SFDC Cases Links:

Planning:
None

What were you trying to do that didn't work?

What is the impact of this issue to you?

Please provide the package NVR for which the bug is seen:

RHEL-9.6.0-20241109.2 BaseOS x86_64

5.14.0-527.el9.x86_64+rt

How reproducible is this bug?:

just one time

Steps to reproduce

Expected results

Actual results

ov  9 22:02:34 dell-r640-01 systemd[1]: systemd-hostnamed.service: Deactivated successfully.
Nov  9 22:02:40 dell-r640-01 restraintd[2301]: ** Running task: 186501187 [dm-crypt/cryptsetup_rhel_41238]
Nov  9 22:02:40 dell-r640-01 systemd[1]: Starting Hostname Service...
Nov  9 22:02:40 dell-r640-01 systemd[1]: Started Hostname Service.
Nov  9 22:02:50 dell-r640-01 kernel: loop0: detected capacity change from 0 to 20971520
Nov  9 22:03:01 dell-r640-01 kernel: loop1: detected capacity change from 0 to 20971520
Nov  9 22:03:03 dell-r640-01 lvm[32445]: PV /dev/loop1 not used.
Nov  9 22:03:03 dell-r640-01 lvm[32446]: PV /dev/loop0 not used.
Nov  9 22:03:05 dell-r640-01 lvm[32448]: PV /dev/loop0 online, VG cache_sanity incomplete (need 1).
Nov  9 22:03:05 dell-r640-01 lvm[32449]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:05 dell-r640-01 systemd[1]: Started /usr/sbin/lvm vgchange -aay --autoactivation event cache_sanity.
Nov  9 22:03:07 dell-r640-01 lvm[32451]:  0 logical volume(s) in volume group "cache_sanity" now active
Nov  9 22:03:07 dell-r640-01 systemd[1]: lvm-activate-cache_sanity.service: Deactivated successfully.
Nov  9 22:03:07 dell-r640-01 lvm[32452]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:03:07 dell-r640-01 lvm[32452]: VG cache_sanity finished
Nov  9 22:03:07 dell-r640-01 lvm[32453]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:07 dell-r640-01 lvm[32453]: VG cache_sanity finished
Nov  9 22:03:11 dell-r640-01 systemd[1]: systemd-hostnamed.service: Deactivated successfully.
Nov  9 22:03:16 dell-r640-01 lvm[32466]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:03:16 dell-r640-01 lvm[32466]: VG cache_sanity finished
Nov  9 22:03:16 dell-r640-01 lvm[32467]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:16 dell-r640-01 lvm[32467]: VG cache_sanity finished
Nov  9 22:03:16 dell-r640-01 lvm[32472]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:16 dell-r640-01 lvm[32472]: VG cache_sanity finished
Nov  9 22:03:16 dell-r640-01 lvm[32473]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:03:16 dell-r640-01 lvm[32473]: VG cache_sanity finished
Nov  9 22:03:20 dell-r640-01 lvm[32484]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:03:20 dell-r640-01 lvm[32484]: VG cache_sanity finished
Nov  9 22:03:20 dell-r640-01 lvm[32485]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:20 dell-r640-01 lvm[32485]: VG cache_sanity finished
Nov  9 22:03:20 dell-r640-01 lvm[32493]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:03:20 dell-r640-01 lvm[32493]: VG cache_sanity finished
Nov  9 22:03:20 dell-r640-01 lvm[32494]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:20 dell-r640-01 lvm[32494]: VG cache_sanity finished
Nov  9 22:03:21 dell-r640-01 lvm[32503]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:03:21 dell-r640-01 lvm[32503]: VG cache_sanity finished
Nov  9 22:03:21 dell-r640-01 lvm[32504]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:21 dell-r640-01 lvm[32504]: VG cache_sanity finished
Nov  9 22:03:25 dell-r640-01 lvm[32527]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:03:25 dell-r640-01 lvm[32527]: VG cache_sanity finished
Nov  9 22:03:25 dell-r640-01 lvm[32526]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:03:25 dell-r640-01 lvm[32526]: VG cache_sanity finished
Nov  9 22:03:42 dell-r640-01 restraintd[2301]: *** Current Time: Sat Nov 09 22:03:42 2024  Localwatchdog at: Sun Nov 10 02:02:40 2024
Nov  9 22:04:41 dell-r640-01 restraintd[2301]: *** Current Time: Sat Nov 09 22:04:41 2024  Localwatchdog at: Sun Nov 10 02:02:40 2024
Nov  9 22:05:42 dell-r640-01 restraintd[2301]: *** Current Time: Sat Nov 09 22:05:42 2024  Localwatchdog at: Sun Nov 10 02:02:40 2024
Nov  9 22:06:22 dell-r640-01 kernel: INFO: task lvconvert:32528 blocked for more than 122 seconds.
Nov  9 22:06:22 dell-r640-01 kernel:      Not tainted 5.14.0-527.el9.x86_64+rt #1
Nov  9 22:06:22 dell-r640-01 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov  9 22:06:22 dell-r640-01 kernel: task:lvconvert       state:D stack:0     pid:32528 tgid:32528 ppid:32384  flags:0x00004002
Nov  9 22:06:22 dell-r640-01 kernel: Call Trace:
Nov  9 22:06:22 dell-r640-01 kernel: <TASK>
Nov  9 22:06:22 dell-r640-01 kernel: __schedule+0x238/0x4e0
Nov  9 22:06:22 dell-r640-01 kernel: schedule+0x31/0xc0
Nov  9 22:06:22 dell-r640-01 kernel: schedule_timeout+0x153/0x190
Nov  9 22:06:22 dell-r640-01 kernel: io_schedule_timeout+0x4c/0x80
Nov  9 22:06:22 dell-r640-01 kernel: __wait_for_common+0x8b/0x1c0
Nov  9 22:06:22 dell-r640-01 kernel: ? __pfx_io_schedule_timeout+0x10/0x10
Nov  9 22:06:22 dell-r640-01 kernel: sync_io+0xbf/0x100 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: ? __schedule+0x240/0x4e0
Nov  9 22:06:22 dell-r640-01 kernel: dm_io+0x200/0x220 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: ? __pfx_km_get_page+0x10/0x10 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: ? __pfx_km_next_page+0x10/0x10 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: dm_bufio_issue_flush+0xa2/0xd0 [dm_bufio]
Nov  9 22:06:22 dell-r640-01 kernel: dm_bufio_write_dirty_buffers+0x181/0x440 [dm_bufio]
Nov  9 22:06:22 dell-r640-01 kernel: ? dm_bufio_write_dirty_buffers+0xd6/0x440 [dm_bufio]
Nov  9 22:06:22 dell-r640-01 kernel: __write_initial_superblock.constprop.0+0x27/0x180 [dm_cache]
Nov  9 22:06:22 dell-r640-01 kernel: __open_or_format_metadata+0x194/0x1d0 [dm_cache]
Nov  9 22:06:22 dell-r640-01 kernel: metadata_open+0xda/0x1b0 [dm_cache]
Nov  9 22:06:22 dell-r640-01 kernel: ? __smq_create+0x75f/0x7e0 [dm_cache_smq]
Nov  9 22:06:22 dell-r640-01 kernel: dm_cache_metadata_open+0x85/0x140 [dm_cache]
Nov  9 22:06:22 dell-r640-01 kernel: cache_create.constprop.0+0x2d1/0x850 [dm_cache]
Nov  9 22:06:22 dell-r640-01 kernel: cache_ctr+0xe1/0x130 [dm_cache]
Nov  9 22:06:22 dell-r640-01 kernel: dm_table_add_target+0x163/0x390 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: populate_table+0xbe/0xf0 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: table_load+0xc5/0x260 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: ctl_ioctl+0x19f/0x290 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: dm_ctl_ioctl+0xa/0x20 [dm_mod]
Nov  9 22:06:22 dell-r640-01 kernel: __x64_sys_ioctl+0x87/0xc0
Nov  9 22:06:22 dell-r640-01 kernel: do_syscall_64+0x5c/0xf0
Nov  9 22:06:22 dell-r640-01 kernel: ? do_syscall_64+0x6b/0xf0
Nov  9 22:06:22 dell-r640-01 kernel: ? fpregs_restore_userregs+0x12/0x110
Nov  9 22:06:22 dell-r640-01 kernel: ? exit_to_user_mode_prepare+0xe1/0xf0
Nov  9 22:06:22 dell-r640-01 kernel: ? syscall_exit_to_user_mode+0x19/0x40
Nov  9 22:06:22 dell-r640-01 kernel: ? do_syscall_64+0x6b/0xf0
Nov  9 22:06:22 dell-r640-01 kernel: entry_SYSCALL_64_after_hwframe+0x78/0x80
Nov  9 22:06:22 dell-r640-01 kernel: RIP: 0033:0x7faf0373875b
Nov  9 22:06:22 dell-r640-01 kernel: RSP: 002b:00007ffce0c2fd78 EFLAGS: 00000202 ORIG_RAX: 0000000000000010
Nov  9 22:06:22 dell-r640-01 kernel: RAX: ffffffffffffffda RBX: 000055fb04d0cdd0 RCX: 00007faf0373875b
Nov  9 22:06:22 dell-r640-01 kernel: RDX: 000055fb05888820 RSI: 00000000c138fd09 RDI: 0000000000000003
Nov  9 22:06:22 dell-r640-01 kernel: RBP: 000055fb04df103a R08: 000055fb04e6df40 R09: 00007ffce0c2fbd0
Nov  9 22:06:22 dell-r640-01 kernel: R10: 0000000000000007 R11: 0000000000000202 R12: 000055fb058888d0
Nov  9 22:06:22 dell-r640-01 kernel: R13: 000055fb05888850 R14: 000055fb05888820 R15: 000055fb05889210
Nov  9 22:06:22 dell-r640-01 kernel: </TASK>
Nov  9 22:06:34 dell-r640-01 lvm[32568]: PV /dev/loop0 online, VG cache_sanity is complete.
Nov  9 22:06:34 dell-r640-01 lvm[32568]: VG cache_sanity finished
Nov  9 22:06:34 dell-r640-01 lvm[32569]: PV /dev/loop1 online, VG cache_sanity is complete.
Nov  9 22:06:34 dell-r640-01 lvm[32569]: VG cache_sanity finished
Nov  9 22:06:41 dell-r640-01 restraintd[2301]: *** Current Time: Sat Nov 09 22:06:41 2024  Localwatchdog at: Sun Nov 10 02:02:40 2024
Nov  9 22:07:42 dell-r640-01 restraintd[2301]: *** Current Time: Sat Nov 09 22:07:42 2024  Localwatchdog at: Sun Nov 10 02:02:40 2024
Nov  9 22:08:42 dell-r640-01 restraintd[2301]: *** Current Time: Sat Nov 09 22:08:42 2024  Localwatchdog at: Sun Nov 10 02:02:40 2024

test server

dell-r640-01.lab.eng.rdu2.dc.redhat.com

https://beaker.engineering.redhat.com/recipes/17431164#task186501188

https://beaker.engineering.redhat.com/recipes/17431164/tasks/186501188/logs/sosreport-dell-r640-01-2024-11-09-kskatsb.tar.xz

https://beaker.engineering.redhat.com/recipes/17431164/tasks/186501188/logs/messages

https://beaker.engineering.redhat.com/recipes/17431164/tasks/186501188/logs/system_logs1731208280.tar