Uploaded image for project: 'Fast Datapath Product'
  1. Fast Datapath Product
  2. FDP-2643

Upstream: Create multiple logical routers in a single iteration results in an OVN sanitizer crash

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • OVN
    • None
    • 8
    • Hide

      None

      Show
      None
    • Hide

      Please mark each item below with ( / ) if completed or ( x ) if incomplete:
      ( ) Unit test or Integration test case are written and pass successfully


      ( ) The upstream pull request is merged upstream and pass CI

      Show
      Please mark each item below with ( / ) if completed or ( x ) if incomplete: ( ) Unit test or Integration test case are written and pass successfully ( ) The upstream pull request is merged upstream and pass CI
    • rhel-9
    • None
    • rhel-net-ovn
    • OVN FDP Sprint 12
    • 1

      This is tracking the upstream effort needed to deliver the solution to the bug described below.


       Problem Description: Clearly explain the issue.

      Creating multiple OVN logical routers in a single ovn-nbctl command results in an OVN sanitizer crash

       Impact Assessment: Describe the severity and impact (e.g., network down,availability of a workaround, etc.).

      network down

       Software Versions: Specify the exact versions in use (e.g.,openvswitch3.1-3.1.0-147.el8fdp).

       

      OVN main and OVN 25.09

        Issue Type: Indicate whether this is a new issue or a regression (if a regression, state the last known working version).

      Regression

       Reproducibility: Confirm if the issue can be reproduced consistently. If not, describe how often it occurs.

       

      Always

       Reproduction Steps: Provide detailed steps or scripts to replicate the issue.

       

      cmd=""
      for i in {1..4097..1}; do
          cmd="${cmd} -- lr-add lr-${i}"
          if test $(($i % 100)) -eq 0; then
              check ovn-nbctl $cmd
              cmd=""
          fi
      done
      
      check ovn-nbctl --wait=sb $cmd
      

       

       Expected Behavior: Describe what should happen under normal circumstances.

       

       Observed Behavior: Explain what actually happens.

       

       Troubleshooting Actions: Outline the steps taken to diagnose or resolve the issue so far.

       

       Logs: If you collected logs please provide them (e.g. sos report, /var/log/openvswitch/* , testpmd console)

       

      =================================================================
      ==52991==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x7bce82430100 at pc 0x0000004eae83 bp 0x7ffd7306f980 sp 0x7ffd7306f978
      READ of size 8 at 0x7bce82430100 thread T0
          #0 0x0000004eae82 in bitmap_is_set /home/lorenzo/workspace/ovn/ovs/lib/bitmap.h:91
          #1 0x0000004eae82 in lflow_table_add_lflow northd/lflow-mgr.c:765
          #2 0x00000046c075 in build_adm_ctrl_flows_for_lrouter northd/northd.c:13759
          #3 0x00000046c075 in build_lswitch_and_lrouter_iterate_by_lr northd/northd.c:18591
          #4 0x000000479805 in lflow_handle_northd_lr_changes northd/northd.c:19299
          #5 0x00000049bcc0 in lflow_northd_handler northd/en-lflow.c:158
          #6 0x000000508895 in engine_compute lib/inc-proc-eng.c:474
          #7 0x000000508895 in engine_run_node lib/inc-proc-eng.c:546
          #8 0x000000508895 in engine_run lib/inc-proc-eng.c:575
          #9 0x0000004e0cff in inc_proc_northd_run northd/inc-proc-northd.c:602
          #10 0x0000004077b4 in main northd/ovn-northd.c:1104
          #11 0x7fae83523574 in __libc_start_call_main (/lib64/libc.so.6+0x3574) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
          #12 0x7fae83523627 in __libc_start_main@GLIBC_2.2.5 (/lib64/libc.so.6+0x3627) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
          #13 0x00000040ae74 in _start (/home/lorenzo/workspace/ovn/northd/ovn-northd+0x40ae74) (BuildId: 5373e3f3823362d2c1a220082395cf8a9aae28bc)
      
      0x7bce82430100 is located 0 bytes after 16-byte region [0x7bce824300f0,0x7bce82430100)
      allocated by thread T0 here:
          #0 0x7fae83ee68a3 in calloc (/lib64/libasan.so.8+0xe68a3) (BuildId: cab80046dbc1c97c6e14490acc37d079701f8d9a)
          #1 0x00000077873e in xcalloc__ lib/util.c:125
          #2 0x00000077873e in xzalloc__ lib/util.c:135
          #3 0x00000077873e in xzalloc lib/util.c:169
          #4 0x0000004ea05b in bitmap_allocate /home/lorenzo/workspace/ovn/ovs/lib/bitmap.h:51
          #5 0x0000004ea05b in ovn_lflow_init northd/lflow-mgr.c:901
          #6 0x0000004ea05b in do_ovn_lflow_add northd/lflow-mgr.c:1028
          #7 0x0000004ea05b in lflow_table_add_lflow northd/lflow-mgr.c:730
          #8 0x00000046c075 in build_adm_ctrl_flows_for_lrouter northd/northd.c:13759
          #9 0x00000046c075 in build_lswitch_and_lrouter_iterate_by_lr northd/northd.c:18591
          #10 0x000000479805 in lflow_handle_northd_lr_changes northd/northd.c:19299
          #11 0x00000049bcc0 in lflow_northd_handler northd/en-lflow.c:158
          #12 0x000000508895 in engine_compute lib/inc-proc-eng.c:474
          #13 0x000000508895 in engine_run_node lib/inc-proc-eng.c:546
          #14 0x000000508895 in engine_run lib/inc-proc-eng.c:575
          #15 0x0000004e0cff in inc_proc_northd_run northd/inc-proc-northd.c:602
          #16 0x0000004077b4 in main northd/ovn-northd.c:1104
          #17 0x7fae83523574 in __libc_start_call_main (/lib64/libc.so.6+0x3574) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
          #18 0x7fae83523627 in __libc_start_main@GLIBC_2.2.5 (/lib64/libc.so.6+0x3627) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
          #19 0x00000040ae74 in _start (/home/lorenzo/workspace/ovn/northd/ovn-northd+0x40ae74) (BuildId: 5373e3f3823362d2c1a220082395cf8a9aae28bc)
      

              lorenzobianconi lorenzo bianconi
              nstbot NST Bot
              OVN QE OVN QE
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: