-
Bug
-
Resolution: Won't Do
-
Critical
-
None
-
rhel-8.8.0
-
ZStream
-
sst_cs_software_management
-
ssg_core_services
-
12
-
None
-
False
-
-
No
-
None
-
Approved Blocker
-
-
None
-
None
-
Release Note Not Required
-
-
Unspecified
-
None
In https://issues.redhat.com/browse/OCPBUGS-9685?focusedCommentId=21882015&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-21882015 we discovered that sometimes rpm-ostree was segfaulting when trying to override with the RT kernel.
Narrowing things down a bit, it's not related to the rt kernel; reproduction steps so far seem to be:
- boot rhel8 host
- queue a rebase to rhel9
- layer a package
Stack trace looks like this:
```
PID: 263873 (rpm-ostree)
UID: 0 (root)
GID: 0 (root)
Signal: 11 (SEGV)
Timestamp: Thu 2023-03-09 23:03:03 UTC (2min 46s ago)
Command Line: /usr/bin/rpm-ostree start-daemon
Executable: /usr/bin/rpm-ostree
Control Group: /
Slice: -.slice
Boot ID: 3eb1772866404a42abb9abd231bbb0a1
Machine ID: 17248ec74f0145ef8e3115c54d37bc2a
Hostname: cosa-devsh
Storage: /var/lib/systemd/coredump/core.rpm-ostree.0.3eb1772866404a42abb9abd231bbb0a1.263873.1678402983000000.lz4
Message: Process 263873 (rpm-ostree) of user 0 dumped core.
Stack trace of thread 443865:
#0 0x00007ffad342c0bc hex2bin (librpm.so.8)
#1 0x00007ffad342fdd7 rpmfilesNew (librpm.so.8)
#2 0x00007ffad34307bd rpmfiNewPool (librpm.so.8)
#3 0x0000559c271d391a rpmostree_context_assemble (rpm-ostree)
#4 0x0000559c27202878 rpmostree_sysroot_upgrader_deploy (rpm-ostree)
#5 0x0000559c271c072c _ZL26deploy_transaction_executeP22_RpmostreedTransactionP13_GCancellablePP7_GError (rpm-ostree)
#6 0x0000559c271b8453 _ZL26transaction_execute_threadP6_GTaskPvS1_P13_GCancellable (rpm-ostree)
#7 0x00007ffad3c69357 g_task_thread_pool_thread (libgio-2.0.so.0)
#8 0x00007ffad36df9d3 g_thread_pool_thread_proxy (libglib-2.0.so.0)
#9 0x00007ffad36defca g_thread_proxy (libglib-2.0.so.0)
#10 0x00007ffad0cb71cf start_thread (libpthread.so.0)
#11 0x00007ffad0923dd3 __clone (libc.so.6)
Stack trace of thread 263873:
#0 0x00007ffad0a19a07 epoll_wait (libc.so.6)
#1 0x0000559c27166d26 _ZN5tokio2io6driver6Driver4turn17h9a20fe9d16a70024E.llvm.9154779605146092572 (rpm-ostree)
#2 0x0000559c271636f2 _ZN5tokio4time6driver15Driver$LT$P$GT$13park_internal17he11018871cd3c611E.llvm.7853487799161909216 (rpm-ostree)
#3 0x0000559c2716bc3d ZN78$LT$tokio..park..either..Either$LT$A$C$B$GT$$u20$as$u20$tokio..park..Park$GT$4park17h8d360b7d05da848aE (rpm-ostree)
#4 0x0000559c2717a3b9 _ZN5tokio7runtime15basic_scheduler7Context4park17h6d96f78c085bf685E (rpm-ostree)
#5 0x0000559c26e6d7fc _ZN5tokio6macros10scoped_tls18ScopedKey$LT$T$GT$3set17h9304ae0e2f3349d3E (rpm-ostree)
#6 0x0000559c26e47954 _ZN5tokio7runtime15basic_scheduler14BasicScheduler8block_on17h334695d20fab50d0E (rpm-ostree)
#7 0x0000559c26e6e72c _ZN5tokio7runtime7Runtime8block_on17h6bfe3f9a1752a5d1E (rpm-ostree)
#8 0x0000559c26edb073 _ZN10rpm_ostree4main17h410db1bc1923be7aE (rpm-ostree)
#9 0x0000559c26ed4b03 ZN3std10sys_common9backtrace28_rust_begin_short_backtrace17ha07cd638c2ad92c5E (rpm-ostree)
#10 0x0000559c26e3d4d9 ZN3std2rt10lang_start28$u7b$$u7b$closure$u7d$$u7d$17hf0d73452748f8331E.llvm.1177766809197949552 (rpm-ostree)
#11 0x0000559c2713301e _ZN3std2rt19lang_start_internal17ha9d47c9583ae6f7eE (rpm-ostree)
#12 0x0000559c26edb2e8 main (rpm-ostree)
#13 0x00007ffad0924cf3 __libc_start_main (libc.so.6)
#14 0x0000559c26c3a34e _start (rpm-ostree)
Stack trace of thread 263876:
#0 0x00007ffad0a0eac1 __poll (libc.so.6)
#1 0x00007ffad36b6c86 g_main_context_iterate.isra.20 (libglib-2.0.so.0)
#2 0x00007ffad36b7042 g_main_loop_run (libglib-2.0.so.0)
#3 0x00007ffad3cac56a gdbus_shared_thread_func (libgio-2.0.so.0)
#4 0x00007ffad36defca g_thread_proxy (libglib-2.0.so.0)
#5 0x00007ffad0cb71cf start_thread (libpthread.so.0)
#6 0x00007ffad0923dd3 __clone (libc.so.6)
Stack trace of thread 443866:
#0 0x00007ffad092391d syscall (libc.so.6)
#1 0x00007ffad36fde3e g_cond_wait_until (libglib-2.0.so.0)
#2 0x00007ffad3689191 g_async_queue_pop_intern_unlocked (libglib-2.0.so.0)
#3 0x00007ffad36dfb12 g_thread_pool_thread_proxy (libglib-2.0.so.0)
#4 0x00007ffad36defca g_thread_proxy (libglib-2.0.so.0)
#5 0x00007ffad0cb71cf start_thread (libpthread.so.0)
#6 0x00007ffad0923dd3 __clone (libc.so.6)
Stack trace of thread 263875:
#0 0x00007ffad0a0eac1 __poll (libc.so.6)
#1 0x00007ffad36b6c86 g_main_context_iterate.isra.20 (libglib-2.0.so.0)
#2 0x00007ffad36b6db0 g_main_context_iteration (libglib-2.0.so.0)
#3 0x00007ffad36b6e01 glib_worker_main (libglib-2.0.so.0)
#4 0x00007ffad36defca g_thread_proxy (libglib-2.0.so.0)
#5 0x00007ffad0cb71cf start_thread (libpthread.so.0)
#6 0x00007ffad0923dd3 __clone (libc.so.6)
Stack trace of thread 263874:
#0 0x00007ffad0a0eac1 __poll (libc.so.6)
#1 0x00007ffad36b6c86 g_main_context_iterate.isra.20 (libglib-2.0.so.0)
#2 0x00007ffad36b6db0 g_main_context_iteration (libglib-2.0.so.0)
#3 0x0000559c271b16bc rpmostreed_daemon_run_until_idle_exit (rpm-ostree)
#4 0x0000559c271a81b8 rpmostree_builtin_start_daemon (rpm-ostree)
#5 0x0000559c2719d889 _ZN12rpmostreecxx14rpmostree_mainEN4rust10cxxbridge15SliceIKNS1_3StrEEE (rpm-ostree)
#6 0x0000559c271976c7 rpmostreecxx$cxxbridge1$rpmostree_main (rpm-ostree)
#7 0x0000559c26ead73e ZN102$LT$tokio..runtime..blocking..task..BlockingTask$LT$T$GT$$u20$as$u20$core..future..future..Future$GT$4poll17hf624d895f71b5ee7E (rpm-ostree)
#8 0x0000559c26eb8c03 _ZN5tokio7runtime4task7harness20Harness$LT$T$C$S$GT$4poll17ha6c1caddcd64e06fE (rpm-ostree)
#9 0x0000559c27173182 _ZN5tokio7runtime8blocking4pool5Inner3run17h3e8406aa9e4c45e2E (rpm-ostree)
#10 0x0000559c27166000 ZN3std10sys_common9backtrace28_rust_begin_short_backtrace17ha83e312e4406ac5dE.llvm.9154779605146092572 (rpm-ostree)
#11 0x0000559c27168617 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h2e98583ffc825ff9E (rpm-ostree)
#12 0x0000559c27146545 _ZN3std3sys4unix6thread6Thread3new12thread_start17h30bda5701f7abd82E (rpm-ostree)
#13 0x00007ffad0cb71cf start_thread (libpthread.so.0)
#14 0x00007ffad0923dd3 __clone (libc.so.6)
```