Uploaded image for project: 'RHEL'
  1. RHEL
  2. RHEL-59556

[RHEl-10] possible deadlock between __handle_sysrq and rcu_lock_acquire.constprop.0

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Undefined Undefined
    • None
    • rhel-10.0
    • libblockdev
    • None
    • No
    • None
    • rhel-sst-storage-management
    • ssg_filesystems_storage_and_HA
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None

      What were you trying to do that didn't work?

      What is the impact of this issue to you?

      Please provide the package NVR for which the bug is seen:

      libblockdev-3.1.0-7.el10.x86_64

      6.11.0-0.rc5.22.el10.x86_64+debug

      lvm2-dbusd-2.03.24-1.el10.noarch

      lvm2-2.03.24-1.el10.x86_64

      How reproducible is this bug?:

      Steps to reproduce

      1.  
      2.  
      3.  

      Expected results

      Actual results

       

      0 S root        2093       1  0  80   0 - 56807 do_wai 16:12 ?        00:00:00   make run
      0 S root        2096    2093  0  80   0 - 57097 do_wai 16:12 ?        00:00:00     /bin/sh ./runtest.sh
      0 S root        2097    2096  0  80   0 - 57098 do_wai 16:12 ?        00:00:00       /usr/bin/bash /usr/bin/rhts-run-simple-test run ./main.sh
      1 S root        2102    2097  0  80   0 - 57098 do_wai 16:12 ?        00:00:00         /usr/bin/bash /usr/bin/rhts-run-simple-test run ./main.sh
      0 S root        2105    2102  0  80   0 - 57367 do_wai 16:12 ?        00:00:00           /bin/bash -x ./main.sh
      4 S root        3454    2105  1  80   0 - 143499 poll_s 16:20 ?       00:00:59             python3 tests/run_tests.py --fast -i
      4 D root       39042    3454 33  62 -18 - 60978 submit 17:12 ?        00:00:00               lvm lvcreate -T -L 524288K --poolmetadatasize=4096K --chunksize=512K --profile=thin-performance testVG/testPool
      0 S root        3455    2105  0  80   0 - 56705 pipe_r 16:20 ?        00:00:00             tee test_log
      0 S root        2103    2097  0  80   0 - 56705 pipe_r 16:12 ?        00:00:00         tee /mnt/testarea/tmp.oa66HC
      4 S root       23604       1  0  80   0 - 139398 poll_s 16:50 ?       00:00:07   /usr/bin/python3 /usr/sbin/lvmdbusd
      4 S root       23929       1  0  80   0 - 18017 poll_s 16:50 ?        00:00:02   /usr/sbin/dmeventd -f
      4 S root       38972       1  8  80   0 -  3860 ep_pol 17:12 ?        00:00:00   /usr/lib/systemd/systemd-hostnamed 
      [ 3858.992822] Sched Debug Version: v0.11, 6.11.0-0.rc5.22.el10.x86_64+debug #1 
      [ 3858.992835] ktime                                   : 3858985.308680 
      [ 3858.992845] sched_clk                               : 3859405.084624 
      [ 3858.992850] cpu_clk                                 : 3858992.821796 
      [ 3858.992854] jiffies                                 : 4298524043 
      [ 3858.992859] sched_clock_stable()                    : 1 
      [ 3858.992863]  
      [ 3858.992866] sysctl_sched 
      [ 3858.992870]   .sysctl_sched_base_slice                 : 3.000000 
      [ 3858.992875]   .sysctl_sched_features                   : 6237751 
      [ 3858.992879]   .sysctl_sched_tunable_scaling            : 1 (logarithmic) 
      [ 3858.992884]  
      [ 3858.992888] cpu#0, 2100.000 MHz 
      [ 3858.992893]   .nr_running                    : 1 
      [ 3858.992897]   .nr_switches                   : 291786 
      [ 3858.992901]   .nr_uninterruptible            : 68 
      [ 3858.992905]   .next_balance                  : 4298.524087 
      [ 3858.992909]   .curr->pid                     : 1123 
      [ 3858.992913]   .clock                         : 3858992.521583 
      [ 3858.992917]   .clock_task                    : 3692866.386680 
      [ 3858.992921]   .avg_idle                      : 1000000 
      [ 3858.992925]   .max_idle_balance_cost         : 500000 
      [ 3858.992930]  
      [ 3858.993104] cfs_rq[0]:/system.slice/dm-event.service 
      [ 3858.993109]   .exec_clock                    : 0.000000 
      [ 3858.993171]   .left_deadline                 : 0.000001 
      [ 3858.993175]   .left_vruntime                 : 0.000001 
      [ 3858.993179]   .min_vruntime                  : 165.508042 
      [ 3858.993184]   .avg_vruntime                  : 165.508042 
      [ 3858.993188]   .right_vruntime                : 0.000001 
      [ 3858.993192]   .spread                        : 0.000000 
      [ 3858.993196]   .nr_spread_over                : 0 
      [ 3858.993200]   .nr_running                    : 0 
      [ 3858.993204]   .h_nr_running                  : 0 
      [ 3858.993207]   .idle_nr_running               : 0 
      [ 3858.993211]   .idle_h_nr_running             : 0 
      [ 3858.993215]   .load                          : 0 
      [ 3858.993219]   .load_avg                      : 0 
      [ 3858.993223]   .runnable_avg                  : 0 
      [ 3858.993227]   .util_avg                      : 0 
      [ 3858.993230]   .util_est                      : 0 
      [ 3858.993234]   .removed.load_avg              : 0 
      [ 3858.993237]   .removed.util_avg              : 0 
      [ 3858.993241]   .removed.runnable_avg          : 0 
      [ 3858.993245]   .tg_load_avg_contrib           : 0 
      [ 3858.993248]   .tg_load_avg                   : 0 
      [ 3858.993252]   .throttled                     : 0 
      [ 3858.993256]   .throttle_count                : 0 
      [ 3858.993260]   .se->exec_start                : 3692575.389525 
      [ 3858.993265]   .se->vruntime                  : 360180.172341 
      [ 3858.993269]   .se->sum_exec_runtime          : 223.714022 
      [ 3858.993273]   .se->load.weight               : 2 
      [ 3858.993277]   .se->avg.load_avg              : 0 
      [ 3858.993281]   .se->avg.util_avg              : 0 
      [ 3858.993284]   .se->avg.runnable_avg          : 0 
      [ 3858.993288]  
      [ 3858.993294] cfs_rq[0]:/system.slice/systemd-journald.service 
      [ 3858.993298]   .exec_clock                    : 0.000000 
      [ 3858.993304]   .left_deadline                 : 0.000001 
      [ 3858.993308]   .left_vruntime                 : 0.000001 
      [ 3858.993312]   .min_vruntime                  : 1321.594502 
      [ 3858.993316]   .avg_vruntime                  : 1321.594502 
      [ 3858.993320]   .right_vruntime                : 0.000001 
      [ 3858.993324]   .spread                        : 0.000000 
      [ 3858.993328]   .nr_spread_over                : 0 
      [ 3858.993332]   .nr_running                    : 1 
      [ 3858.993335]   .h_nr_running                  : 1 
      [ 3858.993339]   .idle_nr_running               : 0 
      [ 3858.993342]   .idle_h_nr_running             : 0 
      [ 3858.993346]   .load                          : 1048576 
      [ 3858.993350]   .load_avg                      : 1016 
      [ 3858.993354]   .runnable_avg                  : 1016 
      [ 3858.993358]   .util_avg                      : 1016 
      [ 3858.993362]   .util_est                      : 0 
      [ 3858.993366]   .removed.load_avg              : 0 
      [ 3858.993370]   .removed.util_avg              : 0 
      [ 3858.993373]   .removed.runnable_avg          : 0 
      [ 3858.993377]   .tg_load_avg_contrib           : 1013 
      [ 3858.993381]   .tg_load_avg                   : 1013 
      [ 3858.993385]   .throttled                     : 0 
      [ 3858.993388]   .throttle_count                : 0 
      [ 3858.993392]   .se->exec_start                : 3692866.386680 
      [ 3858.993396]   .se->vruntime                  : 360445.311043 
      [ 3858.993401]   .se->sum_exec_runtime          : 1322.746337 
      [ 3858.993405]   .se->load.weight               : 1048576 
      [ 3858.993409]   .se->avg.load_avg              : 101 5         1.085226 E         1.093799         0.750000         0.028003         2   100         0.000000         0.028003         0.000000         0.000000 0 0 / 
      [ 3858.993782]  Ikworker/R-slub_     6         1.287873 E         1.296453         0.750000         0.027306         2   100         0.000000         0.027306         0.000000         0.000000 0 0 / 
      [ 3858.993807]  Ikworker/R-netns     7         1.433996 E         1.442576         0.750000         0.039801         2   100         0.000000         0.039801         0.000000         0.000000 0 0 / 
      [ 3858.993831]  I   kworker/0:0H    10       931.473354 E       931.506038         3.000000         0.184754         4   100         0.000000         0.184754         0.000000         0.000000 0 0 / 
      [ 3858.993858]  Ircu_tasks_rude_    14     12208.785216 E     12211.712879         3.000000         1.587415        12   120         0.000000         1.587415         0.000000         0.000000 0 0 / 
      [ 3858.993883]  Ircu_tasks_trace    15        17.065203 E        17.799953         0    : 0.000001 
      [ 3858.994485]   .spread                        : 0.000000 
      [ 3858.994489]   .nr_spread_over                : 0 
      [ 3858.994492]   .nr_running                    : 0 
      [ 3858.994496]   .h_nr_running                  : 0 
      [ 3858.994500]   .idle_nr_running               : 0 
      [ 3858.994504]   .idle_h_nr_running             : 0 
      [ 3858.994507]   .load                          : 0 
      [ 3858.994511]   .load_avg                      : 0 
      [ 3858.994534]   .runnable_avg                  : 0 
      [ 3858.994538]   .util_avg                      : 0 
      [ 3858.994542]   .util_est                      : 0 
      [ 3858.994546]   .removed.load_avg              : 0 
      [ 3858.994550]   .removed.util_avg              : 0 
      [ 3858.994553]   .removed.runnable_avg          : 0 
      [ 3858.994557]   .tg_load_avg_contrib           : 0 
      [ 3858.994561]   .tg_load_avg                   : 0 
      [ 3858.994564]   .throttled                     : 0 
      [ 3858.994568]   .throttle_count                : 0 
      [ 3858.994572]   .se->exec_start                : 3795009.309177 
      [ 3858.994576]   .se->vruntime         120         0.000000        14.915686         0.000000         0.000000 0 0 / 
      [ 3858.994906]  S  idle_inject/1    25        -1.050556 E         0.300556         0.750000         0.020412         3    49         0.000000         0.020412         0.000000         0.000000 0 0 / 
      [ 3858.994931]  S    migration/1    26        50.320008 E        51.060691         0.750000        68.186190      1666     0         0.000000        68.186190         0.000000         0.000000 0 0 / 
      [ 3858.994957]  S    ksoftirqd/1    27    760520.403918 E    760523.384586         3.000000      3216.902988     18303   120         0.000000      3216.902988         0.000000         0.000000 0 0 / 
      [ 3858.994982]  I   kworker/1:0H    29      2722.582580 E      2722.616293         3.000000         0.225820         4   100         0.000000         0.225820         0.000000         0.000000 0 0 / 
      [ 3858.995033]  S     irq/9-acpi   271       374.620341 E       377.620341         3.000000         0.787460         3    49         0.000000         0.787460            0.000000         0.000000 0 0 / 
      [ 3858.995594]  S    migration/2    32        53.184765 E        53.925368         0.750000        59.151864      1569     0         0.000000        59.151864         0.000000         0.000000 0 0 / 
      [ 3858.995619]  S    ksoftirqd/2    33    446321.801958 E    446324.801958         3.000000      2848.615781     16436   120         0.000000      2848.615781         0.000000         0.000000 0 0 / 
      [ 3858.995644]  I   kworker/2:0H    35      1026.178007 E      1026.211146         3.000000         0.150918         4   100         0.000000         0.150918         0.000000         0.000000 0 0 / 
      [ 3858.995682]  Ikworker/R-inet_   246       348.085972 E       348.120581         3.000000         0.481285         2   100         0.000000         0.481285         0.000000         0.000000 0 0 / 
      [ 3858.995708]  S        kswapd0   281       353.577333 E       356.510133         3.000000         0.311571         4   120         0.000000         0.311571         0.000000         0.000000 0 0 / 
      [ 3858.995735]  I   kworker/2:1H   512    load_avg              : 0 
      [ 3858.996260]   .removed.util_avg              : 0 
      [ 3858.996263]   .removed.runnable_avg          : 0 
      [ 3858.996268]   .tg_load_avg_contrib           : 0 
      [ 3858.996271]   .tg_load_avg                   : 2341 
      [ 3858.996275]   .throttled                     : 0 
      [ 3858.996279]   .throttle_count                : 0 
      [ 3858.996283]   .se->exec_start                : 3820057.397756 
      [ 3858.996287]   .se->vruntime                  : 387097.042047 
      [ 3858.996291]   .se->sum_exec_runtime          : 116254.998677 
      [ 3858.996295]   .se->load.weight               : 2 
      [ 3858.996299]   .se->avg.load_avg              : 0 
      [ 3858.996303]   .se->avg.util_avg              : 0 
      [ 3858.996306]   .se->avg.runnable_avg          : 0 
      [ 3858.996310]  
      [ 3858.996314] cfs_rq[3]:/ 
      [ 3858.996318]   .exec_clock                    : 0.000000 
      [ 3858.996323]   .left_deadline                 : 0.000001 
      [ 3858.996327]   .left_vruntime                 : 0.000001 
      [ 3858.996331]   .min_vruntime                  : 387097.042047 
      [    100         0.000000         0.037845         0.000000         0.000000 0 0 / 
      [ 3858.996820]  S   stratis-wt-5  1513         1.451254 E         4.423099         3.000000         1.208909         6   120         0.000000         1.208909         0.000000         0.000000 0 0 /system.slice/stratisd.service 
      [ 3858.996847]  S  stratis-wt-18  1526         1.423099 E         4.386453         3.000000         1.290921         3   120         0.000000         1.290921         0.000000         0.000000 0 0 /system.slice/stratisd.service 
      [ 3858.996876]  S       lvmdbusd 23624     10212.097834 E     10214.956333         3.000000      1319.737936      5039   120         0.000000      1319.737936         0.000000         0.000000 0 0 /system.slice/lvm2-lvmdbusd.service 
      [ 3858.996903]  I    kworker/3:1 26355    362938.475184 E    362941.459911         3.000000        69.653606       274   120         0.000000        69.653606         0.000000         0.000000 0 0 / 
      [ 3858.996929]  I    kworker/3:0 33217    387096.738807 E    387099.721348         3.000000       377.278runtime                  : 345556.579258 
      [ 3858.997284]   .se->sum_exec_runtime          : 87968.095719 
      [ 3858.997288]   .se->load.weight               : 2 
      [ 3858.997292]   .se->avg.load_avg              : 0 
      [ 3858.997296]   .se->avg.util_avg              : 0 
      [ 3858.997299]   .se->avg.runnable_avg          : 0 
      [ 3858.997303]  
      [ 3858.997307] cfs_rq[4]:/ 
      [ 3858.997311]   .exec_clock                    : 0.000000 
      [ 3858.997316]   .left_deadline                 : 0.000001 
      [ 3858.997320]   .left_vruntime                 : 0.000001 
      [ 3858.997324]   .min_vruntime                  : 345556.783807 
      [ 3858.997328]   .avg_vruntime                  : 345556.783807 
      [ 3858.997332]   .right_vruntime                : 0.000001 
      [ 3858.997336]   .spread                        : 0.000000 
      [ 3858.997340]   .nr_spread_over                : 0 
      [ 3858.997344]   .nr_running                    : 0 
      [ 3858.997347]   .h_nr_running                  : 0 
      [ 3858.997351]   .idle_nr_running               : 0 
      [ 3858.997354]   .idle_h_nr_running              0.000000         1.586989         0.000000         0.000000 0 0 / 
      [ 3858.997872]  
      [ 3858.997876] cpu#5, 2100.000 MHz 
      [ 3858.997880]   .nr_running                    : 0 
      [ 3858.997884]   .nr_switches                   : 201938 
      [ 3858.997888]   .nr_uninterruptible            : -38 
      [ 3858.997892]   .next_balance                  : 4298.524052 
      [ 3858.997896]   .curr->pid                     : 0 
      [ 3858.997900]   .clock                         : 3858997.566085 
      [ 3858.997904]   .clock_task                    : 3832208.893516 
      [ 3858.997908]   .avg_idle                      : 1000000 
      [ 3858.997912]   .max_idle_balance_cost         : 500000 
      [ 3858.997916]  
      [ 3858.997921] cfs_rq[5]:/ 
      [ 3858.997925]   .exec_clock                    : 0.000000 
      [ 3858.997930]   .left_deadline                 : 0.000001 
      [ 3858.997934]   .left_vruntime                 : 0.000001 
      [ 3858.997938]   .min_vruntime                  : 289316.811503 
      [ 3858.997942]   .avg_vruntime                  : 289316.811503 
      [ 3858.997946]   .right_vruntime                : 0.000001 
      [ 3858.running                    : 0 
      [ 3858.998575]   .nr_switches                   : 200755 
      [ 3858.998579]   .nr_uninterruptible            : -43 
      [ 3858.998583]   .next_balance                  : 4298.524053 
      [ 3858.998587]   .curr->pid                     : 0 
      [ 3858.998591]   .clock                         : 3858998.535953 
      [ 3858.998596]   .clock_task                    : 3815245.131107 
      [ 3858.998600]   .avg_idle                      : 1000000 
      [ 3858.998604]   .max_idle_balance_cost         : 500000 
      [ 3858.998608]  
      [ 3858.998613] cfs_rq[6]:/system.slice/stratisd.service 
      [ 3858.998617]   .exec_clock                    : 0.000000 
      [ 3858.998622]   .left_deadline                 : 0.000001 
      [ 3858.998626]   .left_vruntime                 : 0.000001 
      [ 3858.998630]   .min_vruntime                  : 326.060502 
      [ 3858.998635]   .avg_vruntime                  : 326.060502 
      [ 3858.998639]   .right_vruntime                : 0.000001 
      [ 3858.998643]   .spread                        : 0.000000 
      [ 3858.998646]   .nr_spread_over                          : 0 
      [ 3858.998958]   .throttle_count                : 0 
      [ 3858.998962]   .se->exec_start                : 3815239.913128 
      [ 3858.998966]   .se->vruntime                  : 222947.991607 
      [ 3858.998970]   .se->sum_exec_runtime          : 71678.190486 
      [ 3858.998974]   .se->load.weight               : 2 
      [ 3858.998978]   .se->avg.load_avg              : 0 
      [ 3858.998981]   .se->avg.util_avg              : 0 
      [ 3858.998985]   .se->avg.runnable_avg          : 0 
      [ 3858.998989]  
      [ 3858.998993] cfs_rq[6]:/ 
      [ 3858.998997]   .exec_clock                    : 0.000000 
      [ 3858.999002]   .left_deadline                 : 0.000001 
      [ 3858.999006]   .left_vruntime                 : 0.000001 
      [ 3858.999010]   .min_vruntime                  : 222947.991607 
      [ 3858.999014]   .avg_vruntime                  : 222947.991607 
      [ 3858.999017]   .right_vruntime                : 0.000001 
      [ 3858.999021]   .spread                        : 0.000000 
      [ 3858.999025]   .nr_spread_over                : 0 
      [ 3858.999029]   .nr_running                    : 0 
      [ 3858.999032] 7175         3.000000         0.188019         2   100         0.000000         0.188019         0.000000         0.000000 0 0 / 
      [ 3858.999511]  I    kworker/6:1 15809    222943.885979 E    222946.787669         3.000000       797.421966      4484   120         0.000000       797.421966         0.000000         0.000000 0 0 / 
      [ 3858.999557]  I    kworker/6:2 25837    219545.462346 E    219548.284768         3.000000        44.350298       137   120         0.000000        44.350298         0.000000         0.000000 0 0 / 
      [ 3858.999584]  I    kworker/6:0 37240    212966.260632 E    212968.337672         3.000000         1.236946         4   120         0.000000         1.236946         0.000000         0.000000 0 0 / 
      [ 3858.999608]  I    kworker/6:3 37241    213023.208849 E    213026.208849         3.000000         3.563834         8   120         0.000000         3.563834         0.000000         0.000000 0 0 / 
      [ 3858.999634]  
      [ 3858.999639] cpu#7, 2100.000 MHz 
      [ 3858.999643]   .nr_running                    : 0 
      [ 3858.99964: 239153.617671 
      [ 3858.999964]   .right_vruntime                : 0.000001 
      [ 3858.999967]   .spread                        : 0.000000 
      [ 3858.999971]   .nr_spread_over                : 0 
      [ 3858.999975]   .nr_running                    : 0 
      [ 3858.999978]   .h_nr_running                  : 0 
      [ 3858.999982]   .idle_nr_running               : 0 
      [ 3858.999985]   .idle_h_nr_running             : 0 
      [ 3858.999989]   .load                          : 0 
      [ 3858.999993]   .load_avg                      : 0 
      [ 3858.999996]   .runnable_avg                  : 0 
      [ 3859.000000]   .util_avg                      : 0 
      [ 3859.000003]   .util_est                      : 0 
      [ 3859.000007]   .removed.load_avg              : 0 
      [ 3859.000011]   .removed.util_avg              : 0 
      [ 3859.000014]   .removed.runnable_avg          : 0 
      [ 3859.000018]   .tg_load_avg_contrib           : 0 
      [ 3859.000022]   .tg_load_avg                   : 0 
      [ 3859.000025]   .throttled                     : 0 
      [ 3859.000029]   .throttle_c_rq[8]: 
      [ 3859.000662]   .rt_nr_running                 : 0 
      [ 3859.000666]   .rt_throttled                  : 0 
      [ 3859.000669]   .rt_time                       : 0.000000 
      [ 3859.000673]   .rt_runtime                    : 950.000000 
      [ 3859.000677]  
      [ 3859.000680] dl_rq[8]: 
      [ 3859.000683]   .dl_nr_running                 : 0 
      [ 3859.000687]   .dl_bw->bw                     : 996147 
      [ 3859.000691]   .dl_bw->total_bw               : 0 
      [ 3859.000694]  
      [ 3859.000697] runnable tasks: 
      [ 3859.000700]  S            task   PID         tree-key  switches  prio     wait-time             sum-exec        sum-sleep 
      [ 3859.000704] ------------------------------------------------------------------------------------------------------------- 
      [ 3859.000723]  S        cpuhp/8    66     25405.274490 E     25408.274490         3.000000        31.643638        29   120         0.000000        31.643638         0.000000         0.000000 1 0 / 
      [ 3859.000746]  S  idle_inject/8    67        -1.028589 E         1.956047         3.000000         0.051328         3    49         0.000000         0.051328         0.859.001149]   .se->avg.util_avg              : 0 
      [ 3859.001152]   .se->avg.runnable_avg          : 0 
      [ 3859.001155]  
      [ 3859.001159] cfs_rq[9]:/system.slice 
      [ 3859.001163]   .exec_clock                    : 0.000000 
      [ 3859.001167]   .left_deadline                 : 0.000001 
      [ 3859.001171]   .left_vruntime                 : 0.000001 
      [ 3859.001174]   .min_vruntime                  : 234467.270090 
      [ 3859.001177]   .avg_vruntime                  : 234467.270090 
      [ 3859.001181]   .right_vruntime                : 0.000001 
      [ 3859.001184]   .spread                        : 0.000000 
      [ 3859.001188]   .nr_spread_over                : 0 
      [ 3859.001191]   .nr_running                    : 0 
      [ 3859.001194]   .h_nr_running                  : 0 
      [ 3859.001197]   .idle_nr_running               : 0 
      [ 3859.001200]   .idle_h_nr_running             : 0 
      [ 3859.001203]   .load                          : 0 
      [ 3859.001206]   .load_avg                      : 0 
      [ 3859.001209]   .runnable_avg                  : 0 
      734938         3.000000         0.054484         3   120         0.000000         0.054484         0.000000         0.000000 1 0 / 
      [ 3859.001601]  S   stratis-wt-7  1515       121.411323 E       124.288515         3.000000       283.409898      3277   120         0.000000       283.409898         0.000000         0.000000 1 0 /system.slice/stratisd.service 
      [ 3859.001628]  S        systemd  1575      3051.948363 E      3053.810751         3.000000     29670.079310      3461   120         0.000000     29670.079310         0.000000         0.000000 1 0 /user.slice/user-0.slice/user@0.service/init.scope 
      [ 3859.001659]  I    kworker/9:0  8387    332907.910781 E    332910.873487         3.000000       919.116241      3813   120         0.000000       919.116241         0.000000         0.000000 1 0 / 
      [ 3859.001688]  I    kworker/9:2 33615    380246.736637 E    380249.736637         3.000000       357.304694      1091   120         0.000000       357.304694         0.000000         0.000000 1 0 / 
      [ 3859.001714]  
      [ 3859.001719] cpu#10, 2100.000 MHz 
      [ 3859.001723]   .nr_running                    :000         0.035080         2   100         0.000000         0.035080         0.000000         0.000000 1 0 / 
      [ 3859.002155]  S  stratis-wt-30  1538        72.240494 E        75.175352         3.000000       463.001225      5703   120         0.000000       463.001225         0.000000         0.000000 1 1538 /system.slice/stratisd.service 
      [ 3859.002183]  S       gssproxy  1605         0.145055 E         2.804379         3.000000        53.740648        76   120         0.000000        53.740648         0.000000         0.000000 1 0 /system.slice/gssproxy.service 
      [ 3859.002210]  S         agetty  1616        10.314630 E        11.544923         3.000000       137.560930        17   120         0.000000       137.560930         0.000000         0.000000 1 0 /system.slice/system-serial\x2dgetty.slice 
      [ 3859.002239]  I   kworker/10:0 24277    328414.223058 E    328417.210793         3.000000       523.737381      2833   120         0.000000       523.737381         0.000000         0.000000 1 0 / 
      [ 3859.002265]  I   kworker/10:1 31123    312248.663366 E    312250.717174      .000000 1 0 /system.slice/stratisd.service 
      [ 3859.002976]  S  stratis-wt-17  1525        10.448120 E        13.410753         3.000000         0.991404         3   120         0.000000         0.991404         0.000000         0.000000 1 0 /system.slice/stratisd.service 
      [ 3859.003001]  S  stratis-wt-20  1528        10.477894 E        13.448120         3.000000         2.070874         4   120         0.000000         2.070874         0.000000         0.000000 1 0 /system.slice/stratisd.service 
      [ 3859.003031]  I   kworker/11:1 30250    364758.691998 E    364761.635363         3.000000        63.580302       132   120         0.000000        63.580302         0.000000         0.000000 1 0 / 
      [ 3859.003057]  I   kworker/11:3 33477    364819.552094 E    364822.507192         3.000000       217.209187       839   120         0.000000       217.209187         0.000000         0.000000 1 0 / 
      [ 3859.003083]  I   kworker/11:0 37383    383672.849813 E    383675.839953         3.000000        65.980934       362   120         0.000000        65.980934         0.000000         0.000000 1 0 / 
      [ 3859.0031ultipathd.service 
      [ 3859.003548]  I   kworker/12:0 16756    281185.996959 E    281188.839793         3.000000       926.784594      4574   120         0.000000       926.784594         0.000000         0.000000 1 0 / 
      [ 3859.003576]  I   kworker/12:2 32116    262196.869926 E    262199.803373         3.000000         4.107350         9   120         0.000000         4.107350         0.000000         0.000000 1 0 / 
      [ 3859.003602]  I   kworker/12:1 36916    262196.851747 E    262199.841986         3.000000         0.087547         2   120         0.000000         0.087547         0.000000         0.000000 1 0 / 
      [ 3859.003629]  S    run_plugins 38995    101933.634157 E    101936.197082         3.000000       137.605652        11   120         0.000000       137.605652         0.000000         0.000000 1 0 /system.slice/restraintd.service 
      [ 3859.003656]  
      [ 3859.003660] cpu#13, 2100.000 MHz 
      
      
      
      
      Sep 18 17:13:04 storageqe-68 kernel: runnable tasks:
      Sep 18 17:13:04 storageqe-68 kernel: S            task   PID         tree-key  switches  prio     wait-time             sum-exec        sum-sleep
      Sep 18 17:13:04 storageqe-68 kernel: -------------------------------------------------------------------------------------------------------------
      Sep 18 17:13:04 storageqe-68 kernel: S       cpuhp/31   205     23441.886318 E     23444.869405         3.000000        21.716434        28   120         0.000000        21.716434         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: S idle_inject/31   206        -1.015508 E         1.974199         3.000000         0.047656         3    49         0.000000         0.047656         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: S   migration/31   207       160.959234 E       163.948101         3.000000        42.937285      1608     0         0.000000        42.937285         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: S   ksoftirqd/31   208    498940.254509 E    498943.254509         3.000000      1940.587506      6598   120         0.000000      1940.587506         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: I  kworker/31:0H   210       684.543926 E       684.577475         3.000000         0.218475         4   100         0.000000         0.218475         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: S     kcompactd1   253    498942.096075 E    498945.014632         3.000000       349.914140      7644   120         0.000000       349.914140         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: I  kworker/31:1H   509    495871.425235 E    495871.459222         3.000000        42.369922       924   100         0.000000        42.369922         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: S  stratis-wt-33  1541         0.958499 E         3.860585         3.000000         3.831129         9   120         0.000000         3.831129         0.000000         0.000000 1 0 /system.slice/stratisd.service
      Sep 18 17:13:04 storageqe-68 kernel: S       rsyslogd  1550         0.039918 E         2.970654         3.000000       124.207756        28   120         0.000000       124.207756         0.000000         0.000000 1 0 /system.slice/rsyslog.service
      Sep 18 17:13:04 storageqe-68 kernel: I NFSv4 callback  1790    286065.303893 E    286068.282540         3.000000         0.051519         2   120         0.000000         0.051519         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: I   kworker/31:0  7609    498942.096075 E    498945.096075         3.000000      1025.572978      6370   120         0.000000      1025.572978         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: I   kworker/31:2 28521    447608.260609 E    447611.213476         3.000000         0.954961         7   120         0.000000         0.954961         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: I   kworker/31:1 33587    447607.327361 E    447610.314623         3.000000         0.036751         2   120         0.000000         0.036751         0.000000         0.000000 1 0 /
      Sep 18 17:13:04 storageqe-68 kernel: 
      Sep 18 17:13:04 storageqe-68 kernel: #012Showing all locks held in the system:
      Sep 18 17:13:04 storageqe-68 kernel: 2 locks held by pr/ttyS0/17:
      Sep 18 17:13:04 storageqe-68 kernel: 3 locks held by in:imjournal/1555:
      Sep 18 17:13:04 storageqe-68 kernel: 3 locks held by 20_sysinfo/39087:
      Sep 18 17:13:04 storageqe-68 kernel: #0: ffff8881fd456440 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0xfb/0x1d0
      Sep 18 17:13:04 storageqe-68 kernel: #1: ffffffffa2d39600 (rcu_read_lock){....}-{1:2}, at: __handle_sysrq+0x77/0x100
      Sep 18 17:13:04 storageqe-68 kernel: #2: ffffffffa2d39600 (rcu_read_lock){....}-{1:2}, at: rcu_lock_acquire.constprop.0+0x7/0x30
      Sep 18 17:13:04 storageqe-68 kernel: 
      Sep 18 17:13:04 storageqe-68 kernel: =============================================
      Sep 18 17:13:04 storageqe-68 kernel: Showing busy workqueues and worker pools:
      Sep 18 17:13:04 storageqe-68 kernel: workqueue events_freezable: flags=0x4
      Sep 18 17:13:04 storageqe-68 kernel:  pwq 82: cpus=20 node=0 flags=0x0 nice=0 active=1 refcnt=2
      Sep 18 17:13:04 storageqe-68 kernel:    pending: pci_pme_list_scan
      Sep 18 17:13:04 storageqe-68 kernel: workqueue events_power_efficient: flags=0x80
      Sep 18 17:13:04 storageqe-68 kernel:  pwq 82: cpus=20 node=0 flags=0x0 nice=0 active=1 refcnt=2
      Sep 18 17:13:04 storageqe-68 kernel:    pending: fb_flashcursor
      Sep 18 17:13:07 storageqe-68 logger[39548]: List of t Tasks: Stop
      Sep 18 17:13:09 storageqe-68 logger[39550]: List of w Tasks: Start
      Sep 18 17:13:10 storageqe-68 kernel: sysrq: Show Blocked State
      Sep 18 17:13:13 storageqe-68 logger[39560]: List of w Tasks: Stop

      https://beaker.engineering.redhat.com/recipes/17030988#task184175767

      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2024/09/98856/9885633/17030988/184175771/messages

      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2024/09/98856/9885633/17030988/184175770/journalctl

      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2024/09/98856/9885633/17030988/184175770/ps-lwd.log

      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2024/09/98856/9885633/17030988/console.log

      https://beaker-archive.prod.engineering.redhat.com/beaker-logs/2024/09/98856/9885633/17030988/184175770/taskout.log

       

              vtrefny@redhat.com Vojtěch Trefný
              guazhang@redhat.com Guangwu Zhang
              Vojtěch Trefný Vojtěch Trefný
              storage-qe storage-qe
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: