Uploaded image for project: 'RHEL'
  1. RHEL
  2. RHEL-53208

[NMCI] NetworkManager crash during ethernet_keep_mtu_on_reboot

    • No
    • None
    • rhel-sst-network-management
    • ssg_networking
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • Hide

      Given a NetworkManager engineer is running the ethernet_keep_mtu_on_reboot test,

      When the test is executed repeatedly in a loop,

      Then, NetworkManager should not crash at any point during the test and the system should handle MTU preservation across reboots without any crashes.

      Definition of Done:

      • The implementation meets the acceptance criteria
      • The code is part of a downstream build attached to an errata
      Show
      Given a NetworkManager engineer is running the ethernet_keep_mtu_on_reboot test, When the test is executed repeatedly in a loop, Then, NetworkManager should not crash at any point during the test and the system should handle MTU preservation across reboots without any crashes. Definition of Done: The implementation meets the acceptance criteria The code is part of a downstream build attached to an errata
    • None
    • None
    • None

      What were you trying to do that didn't work?

      We detected the following crash during ethernet_keep_mtu_on_reboot test:
      PID: 206772 (NetworkManager)
      UID: 0 (root)
      GID: 0 (root)
      Signal: 6 (ABRT)
      Timestamp: Mon 2024-08-05 11:15:09 UTC (1min 40s ago)
      Command Line: /usr/sbin/NetworkManager --no-daemon
      Executable: /usr/sbin/NetworkManager
      Control Group: /system.slice/NetworkManager.service
      Unit: NetworkManager.service
      Slice: system.slice
      Boot ID: 3d16393d34e046b68add6792fb06bb21
      Machine ID: 355cc52ace57448aabc47a247ecafd4e
      Hostname: n27-1-139.pool.ci.centos.org
      Storage: /var/lib/systemd/coredump/core.NetworkManager.0.3d16393d34e046b68add6792fb06bb21.206772.1722856509000000.zst (present)
      Size on Disk: 1.7M
      Message: Process 206772 (NetworkManager) of user 0 dumped core.

      Stack trace of thread 206772:
      #0 0x00007f6780c8b94c __pthread_kill_implementation (libc.so.6 + 0x8b94c)
      #1 0x00007f6780c3e646 __GI_raise (libc.so.6 + 0x3e646)
      #2 0x00007f6780c287f3 __GI_abort (libc.so.6 + 0x287f3)
      #3 0x00007f6780f31d6c g_assertion_message (libglib-2.0.so.0 + 0x1ed6c)
      #4 0x00007f6780f8ce2f g_assertion_message_expr (libglib-2.0.so.0 + 0x79e2f)
      #5 0x0000560bd01386ef _nm_l3cfg_notify_platform_change (NetworkManager + 0x2546ef)
      #6 0x00007f677fcbf8d6 ffi_call_unix64 (libffi.so.8 + 0x78d6)
      #7 0x00007f677fcbc556 ffi_call_int (libffi.so.8 + 0x4556)
      #8 0x00007f6781067b6d g_cclosure_marshal_generic (libgobject-2.0.so.0 + 0x19b6d)
      #9 0x00007f6781061c7f g_closure_invoke (libgobject-2.0.so.0 + 0x13c7f)
      #10 0x00007f678107df96 signal_emit_unlocked_R (libgobject-2.0.so.0 + 0x2ff96)
      #11 0x00007f678107f85a g_signal_emit_valist (libgobject-2.0.so.0 + 0x3185a)
      #12 0x00007f678107fa73 g_signal_emit (libgobject-2.0.so.0 + 0x31a73)
      #13 0x0000560bd010147e nm_platform_cache_update_emit_signal (NetworkManager + 0x21d47e)
      #14 0x0000560bd01599c4 _rtnl_handle_msg (NetworkManager + 0x2759c4)
      #15 0x0000560bd015b904 event_handler_read_netlink (NetworkManager + 0x277904)
      #16 0x0000560bd015c31e do_request_link_no_delayed_actions (NetworkManager + 0x27831e)
      #17 0x0000560bd015dadc delayed_action_handle_REFRESH_LINK (NetworkManager + 0x279adc)
      #18 0x0000560bd015df18 delayed_action_handle_all (NetworkManager + 0x279f18)
      #19 0x0000560bd015e810 do_change_link (NetworkManager + 0x27a810)
      #20 0x0000560bd015f320 link_change_flags (NetworkManager + 0x27b320)
      #21 0x0000560bd0225ac4 nm_platform_link_change_flags (NetworkManager + 0x341ac4)
      #22 0x0000560bd023202b _set_state_full (NetworkManager + 0x34e02b)
      #23 0x0000560bd0255d41 nm_device_state_changed (NetworkManager + 0x371d41)
      #24 0x0000560bd0256209 platform_link_added (NetworkManager + 0x372209)
      #25 0x0000560bd0258642 platform_query_devices (NetworkManager + 0x374642)
      #26 0x0000560bcff392ad main (NetworkManager + 0x552ad)
      #27 0x00007f6780c29590 __libc_start_call_main (libc.so.6 + 0x29590)
      #28 0x00007f6780c29640 __libc_start_main_impl (libc.so.6 + 0x29640)
      #29 0x0000560bcff3a8a5 _start (NetworkManager + 0x568a5)

      Stack trace of thread 206773:
      #0 0x00007f6780d019ff _GI__poll (libc.so.6 + 0x1019ff)
      #1 0x00007f6780fbd1fc g_main_context_poll (libglib-2.0.so.0 + 0xaa1fc)
      #2 0x00007f6780f65713 g_main_context_iteration (libglib-2.0.so.0 + 0x52713)
      #3 0x00007f6780f65761 glib_worker_main (libglib-2.0.so.0 + 0x52761)
      #4 0x00007f6780f96762 g_thread_proxy (libglib-2.0.so.0 + 0x83762)
      #5 0x00007f6780c89c02 start_thread (libc.so.6 + 0x89c02)
      #6 0x00007f6780d0ec40 __clone3 (libc.so.6 + 0x10ec40)

      Stack trace of thread 206774:
      #0 0x00007f6780d019ff _GI__poll (libc.so.6 + 0x1019ff)
      #1 0x00007f6780fbd1fc g_main_context_poll (libglib-2.0.so.0 + 0xaa1fc)
      #2 0x00007f6780f675a3 g_main_loop_run (libglib-2.0.so.0 + 0x545a3)
      #3 0x00007f67811bb46a gdbus_shared_thread_func (libgio-2.0.so.0 + 0x11246a)
      #4 0x00007f6780f96762 g_thread_proxy (libglib-2.0.so.0 + 0x83762)
      #5 0x00007f6780c89c02 start_thread (libc.so.6 + 0x89c02)
      #6 0x00007f6780d0ec40 __clone3 (libc.so.6 + 0x10ec40)

      Stack trace of thread 206775:
      #0 0x00007f6780d0713d syscall (libc.so.6 + 0x10713d)
      #1 0x00007f6780fb6d4c g_cond_wait_until (libglib-2.0.so.0 + 0xa3d4c)
      #2 0x00007f6780f38091 g_async_queue_pop_intern_unlocked (libglib-2.0.so.0 + 0x25091)
      #3 0x00007f6780f38216 g_async_queue_timeout_pop (libglib-2.0.so.0 + 0x25216)
      #4 0x00007f6780f996f9 g_thread_pool_wait_for_new_pool (libglib-2.0.so.0 + 0x866f9)
      #5 0x00007f6780f96762 g_thread_proxy (libglib-2.0.so.0 + 0x83762)
      #6 0x00007f6780c89c02 start_thread (libc.so.6 + 0x89c02)
      #7 0x00007f6780d0ec40 __clone3 (libc.so.6 + 0x10ec40)
      ELF object binary architecture: AMD x86-64

      Please provide the package NVR for which bug is seen:

      1.49.3-33409.copr.5f64f292e6.el9

      How reproducible:

      very rare, hard to reproduce

      Steps to reproduce

      run the following in loop until fail? (so far only one occurence)

      1. ./test_run.sh ethernet_keep_mtu_on_reboot

      Expected results

      there should be no crash

      Actual results

      https://jenkins-networkmanager.apps.ocp.cloud.ci.centos.org/job/NetworkManager-main-c9s/2169/artifact/FAIL-report_NetworkManager-ci-M0_Test0459_ethernet_keep_mtu_on_reboot.html#toggle=3d65

              rh-ee-sfaye Stanislas Faye
              fpokryvk@redhat.com Filip Pokryvka
              Network Management Team Network Management Team
              Vladimir Benes Vladimir Benes
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated: