This is tracking the upstream effort needed to deliver the solution to the bug described below.
Problem Description: Clearly explain the issue.
Creating multiple OVN logical routers in a single ovn-nbctl command results in an OVN sanitizer crash
Impact Assessment: Describe the severity and impact (e.g., network down,availability of a workaround, etc.).
network down
Software Versions: Specify the exact versions in use (e.g.,openvswitch3.1-3.1.0-147.el8fdp).
OVN main and OVN 25.09
Issue Type: Indicate whether this is a new issue or a regression (if a regression, state the last known working version).
Regression
Reproducibility: Confirm if the issue can be reproduced consistently. If not, describe how often it occurs.
Always
Reproduction Steps: Provide detailed steps or scripts to replicate the issue.
cmd="" for i in {1..4097..1}; do cmd="${cmd} -- lr-add lr-${i}" if test $(($i % 100)) -eq 0; then check ovn-nbctl $cmd cmd="" fi done check ovn-nbctl --wait=sb $cmd
Expected Behavior: Describe what should happen under normal circumstances.
Observed Behavior: Explain what actually happens.
Troubleshooting Actions: Outline the steps taken to diagnose or resolve the issue so far.
Logs: If you collected logs please provide them (e.g. sos report, /var/log/openvswitch/* , testpmd console)
=================================================================
==52991==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x7bce82430100 at pc 0x0000004eae83 bp 0x7ffd7306f980 sp 0x7ffd7306f978
READ of size 8 at 0x7bce82430100 thread T0
#0 0x0000004eae82 in bitmap_is_set /home/lorenzo/workspace/ovn/ovs/lib/bitmap.h:91
#1 0x0000004eae82 in lflow_table_add_lflow northd/lflow-mgr.c:765
#2 0x00000046c075 in build_adm_ctrl_flows_for_lrouter northd/northd.c:13759
#3 0x00000046c075 in build_lswitch_and_lrouter_iterate_by_lr northd/northd.c:18591
#4 0x000000479805 in lflow_handle_northd_lr_changes northd/northd.c:19299
#5 0x00000049bcc0 in lflow_northd_handler northd/en-lflow.c:158
#6 0x000000508895 in engine_compute lib/inc-proc-eng.c:474
#7 0x000000508895 in engine_run_node lib/inc-proc-eng.c:546
#8 0x000000508895 in engine_run lib/inc-proc-eng.c:575
#9 0x0000004e0cff in inc_proc_northd_run northd/inc-proc-northd.c:602
#10 0x0000004077b4 in main northd/ovn-northd.c:1104
#11 0x7fae83523574 in __libc_start_call_main (/lib64/libc.so.6+0x3574) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
#12 0x7fae83523627 in __libc_start_main@GLIBC_2.2.5 (/lib64/libc.so.6+0x3627) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
#13 0x00000040ae74 in _start (/home/lorenzo/workspace/ovn/northd/ovn-northd+0x40ae74) (BuildId: 5373e3f3823362d2c1a220082395cf8a9aae28bc)
0x7bce82430100 is located 0 bytes after 16-byte region [0x7bce824300f0,0x7bce82430100)
allocated by thread T0 here:
#0 0x7fae83ee68a3 in calloc (/lib64/libasan.so.8+0xe68a3) (BuildId: cab80046dbc1c97c6e14490acc37d079701f8d9a)
#1 0x00000077873e in xcalloc__ lib/util.c:125
#2 0x00000077873e in xzalloc__ lib/util.c:135
#3 0x00000077873e in xzalloc lib/util.c:169
#4 0x0000004ea05b in bitmap_allocate /home/lorenzo/workspace/ovn/ovs/lib/bitmap.h:51
#5 0x0000004ea05b in ovn_lflow_init northd/lflow-mgr.c:901
#6 0x0000004ea05b in do_ovn_lflow_add northd/lflow-mgr.c:1028
#7 0x0000004ea05b in lflow_table_add_lflow northd/lflow-mgr.c:730
#8 0x00000046c075 in build_adm_ctrl_flows_for_lrouter northd/northd.c:13759
#9 0x00000046c075 in build_lswitch_and_lrouter_iterate_by_lr northd/northd.c:18591
#10 0x000000479805 in lflow_handle_northd_lr_changes northd/northd.c:19299
#11 0x00000049bcc0 in lflow_northd_handler northd/en-lflow.c:158
#12 0x000000508895 in engine_compute lib/inc-proc-eng.c:474
#13 0x000000508895 in engine_run_node lib/inc-proc-eng.c:546
#14 0x000000508895 in engine_run lib/inc-proc-eng.c:575
#15 0x0000004e0cff in inc_proc_northd_run northd/inc-proc-northd.c:602
#16 0x0000004077b4 in main northd/ovn-northd.c:1104
#17 0x7fae83523574 in __libc_start_call_main (/lib64/libc.so.6+0x3574) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
#18 0x7fae83523627 in __libc_start_main@GLIBC_2.2.5 (/lib64/libc.so.6+0x3627) (BuildId: 48c4b9b1efb1df15da8e787f489128bf31893317)
#19 0x00000040ae74 in _start (/home/lorenzo/workspace/ovn/northd/ovn-northd+0x40ae74) (BuildId: 5373e3f3823362d2c1a220082395cf8a9aae28bc)
- is cloned by
-
FDP-2687 CLONE [ovn26.03 fast-datapath-rhel-9] - Upstream: Create multiple logical routers in a single iteration results in an OVN sanitizer crash
-
- New
-
-
FDP-2690 CLONE [ovn26.03 fast-datapath-rhel-10] - Upstream: Create multiple logical routers in a single iteration results in an OVN sanitizer crash
-
- New
-
-
FDP-2694 CLONE [ovn25.09 fast-datapath-rhel-9] - Upstream: Create multiple logical routers in a single iteration results in an OVN sanitizer crash
-
- New
-
-
FDP-2702 CLONE [ovn25.09 fast-datapath-rhel-10] - Upstream: Create multiple logical routers in a single iteration results in an OVN sanitizer crash
-
- New
-