Uploaded image for project: 'Fast Datapath Product'
  1. Fast Datapath Product
  2. FDP-2476

Upstream: [ice][balance-tcp]ipv4 traffic dissappear when balance-tcp rollback to AB mode

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Hide

      Please mark each item below with ( / ) if completed or ( x ) if incomplete:
      ( ) Unit test or Integration test case are written and pass successfully

      ( ) The upstream pull request is merged upstream and pass CI

      Show
      Please mark each item below with ( / ) if completed or ( x ) if incomplete: ( ) Unit test or Integration test case are written and pass successfully ( ) The upstream pull request is merged upstream and pass CI
    • None
    • rhel-net-ovs-dpdk
    • Moderate

      This is tracking the upstream effort needed to deliver the solution to the bug described below.

      Description:

      when running 
      ovs_bonding_balance_tcp_bond_primary, using iperf3 send ipv4/6 traffic to peer site and clean channel group/ re-configure channel group on switch site. Only ipv6 traffic existed.
       
      FDP version:
      openvswitch2.17-2.17.0-126.el9fdp
      openvswitch3.1-3.1.0-73.el9fdp
      openvswitch3.2-3.2.0-40.el9fdp
       
      Nic info:
      [root@dell-per740-17 ovs_bond_function]# ethtool -i enp94s0
      driver: ice
      version: 5.14.0-284.44.1.rt14.329.el9_2.
      firmware-version: 4.30 0x8001af25 1.3429.0
      expansion-rom-version: 
      bus-info: 0000:5e:00.0
      supports-statistics: yes
      supports-test: yes
      supports-eeprom-access: yes
      supports-register-dump: yes
      supports-priv-flags: yes
       
      [root@dell-per740-17 ovs_bond_function]# ethtool -i enp97s0
      driver: ice
      version: 5.14.0-284.44.1.rt14.329.el9_2.
      firmware-version: 4.30 0x8001af25 1.3429.0
      expansion-rom-version: 
      bus-info: 0000:61:00.0
      supports-statistics: yes
      supports-test: yes
      supports-eeprom-access: yes
      supports-register-dump: yes
      supports-priv-flags: yes
       
      Step:
      1. each PF create one vf, and set vf trust on, spoof checking off.

      [root@dell-per740-17 ovs_bond_function]# ip link show enp94s0
8: enp94s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 40:a6:b7:9e:e4:f8 brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 7e:07:9c:66:0b:2d brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state auto, trust on
[root@dell-per740-17 ovs_bond_function]# ip link show enp97s0
9: enp97s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 40:a6:b7:9e:e4:fc brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 76:a5:39:0e:9e:27 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state auto, trust on

      2. create ovs topo as below:

      [root@dell-per740-17 ovs_bond_function]# ovs-vsctl show
9ef74c68-370e-48ba-8060-5a1f606c45b0
    Bridge guestbridge
        Port g3_92ad99_o
            Interface g3_92ad99_o
        Port patchguest
            Interface patchguest
                type: patch
                options: {peer=patchbond}
        Port g2_513a9e_o
            Interface g2_513a9e_o
        Port g1_e41402_o
            Interface g1_e41402_o
        Port guestbridge
            Interface guestbridge
                type: internal
    Bridge bondbridge
        Port balance-tcp
            Interface enp94s0v0
            Interface enp97s0v0
        Port patchbond
            Interface patchbond
                type: patch
                options: {peer=patchguest}
        Port bondbridge
            Interface bondbridge
                type: internal
    ovs_version: "3.2.2"  [root@dell-per740-17 ovs_bond_function]# ovs-vsctl list port balance-tcp
_uuid               : 7cec33b9-e265-4d78-bbae-b6a7c30034dc
bond_active_slave   : "76:a5:39:0e:9e:27"
bond_downdelay      : 0
bond_fake_iface     : false
bond_mode           : balance-tcp
bond_updelay        : 0
cvlans              : []
external_ids        : {}
fake_bridge         : false
interfaces          : [b10b5573-ed70-405c-bc00-d02bce58f90f, f011be1c-6209-4d36-9dc0-7c14ebf3660b]
lacp                : active
mac                 : []
name                : balance-tcp
other_config        : {bond-primary=enp97s0v0, bond-rebalance-interval="1000", lacp-fallback-ab="true", lacp-time=fast}
protected           : false
qos                 : []
rstp_statistics     : {}
rstp_status         : {}
statistics          : {}
status              : {}
tag                 : []
trunks              : []
vlan_mode           : []

      3. remove channel group from switch site.
      4. check flows on ovs site.

      [root@dell-per740-17 ovs_bond_function]# ovs-appctl dpif/dump-flows -m guestbridge
ufid:21b0c57f-818f-408c-869f-8adc1b68ca37 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g2_513a9e_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:12,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=later), packets:2345, bytes:211050, used:0.013s, actions:enp97s0v0
ufid:17b1c85f-07d8-47e3-a083-e938b841d063 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g1_e41402_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:02,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=no), packets:0, bytes:0, used:never, actions:enp97s0v0
ufid:88847d93-3e73-45c7-a2dd-4eb2ba719405 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g2_513a9e_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:12,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=first), packets:2345, bytes:21137830, used:0.013s, actions:enp97s0v0
ufid:38e057cb-464e-43b3-90af-a9202e82431a recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g1_e41402_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:02,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=later), packets:2392, bytes:215280, used:0.008s, actions:enp97s0v0
ufid:c803e9b4-f910-4784-b1a2-3df6f518462f recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g1_e41402_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:02,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=first), packets:2391, bytes:21552474, used:0.008s, actions:enp97s0v0

      5. recover lacp passive mode on peer switch site.
      6. check flow on ovs site.

      [root@dell-per740-17 ovs_bond_function]# ovs-appctl dpif/dump-flows -m guestbridge
ufid:21b0c57f-818f-408c-869f-8adc1b68ca37 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g2_513a9e_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:12,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=later), packets:7991, bytes:719190, used:0.015s, actions:hash(l4(0)),recirc(0x1)
ufid:88847d93-3e73-45c7-a2dd-4eb2ba719405 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g2_513a9e_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:12,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=first), packets:7991, bytes:72030874, used:0.015s, actions:hash(l4(0)),recirc(0x1)
ufid:38e057cb-464e-43b3-90af-a9202e82431a recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g1_e41402_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:02,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=later), packets:8037, bytes:723330, used:0.010s, actions:hash(l4(0)),recirc(0x1)
ufid:c803e9b4-f910-4784-b1a2-3df6f518462f recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(g1_e41402_o),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:de:ad:24:02:02,dst=00:07:43:4a:94:e0),eth_type(0x86dd),ipv6(src=::/::,dst=::/::,label=0/0,proto=0/0,tclass=0/0,hlimit=0/0,frag=first), packets:8036, bytes:72436504, used:0.010s, actions:hash(l4(0)),recirc(0x1)

      7. check iperf3 process still running after testing.

      [root@dell-per740-17 ovs_bond_function]# ps -aux | grep iperf
root       66635  0.0  0.0   5692  1368 pts/1    Ss+  21:07   0:00 iperf3 -c 172.36.36.1 -l 8972 -4 -p 5204 -t 1000 -b 2M
root       66674  0.0  0.0   5692  1388 pts/1    Ss+  21:07   0:00 iperf3 -c 172.36.36.1 -l 8972 -4 -p 5203 -t 1000 -b 2M
root       66713  0.1  0.0   5692  1408 pts/2    Ss+  21:07   0:00 iperf3 -c 2001:db8:36:36::1 -l 8972 -6 -u -p 5202 -t 1000 -b 2M
root       66753  0.1  0.0   5692  1404 pts/2    Ss+  21:07   0:00 iperf3 -c 2001:db8:36:36::1 -l 8972 -6 -u -p 5201 -t 1000 -b 2M

      Beaker job:
      https://beaker.engineering.redhat.com/jobs/8749405
      task log:
      https://beaker-archive.host.prod.eng.bos.redhat.com/beaker-logs/2024/01/87494/8749405/15280162/171161298/taskout.log
      ovs log:
      https://beaker-archive.host.prod.eng.bos.redhat.com/beaker-logs/2024/01/87494/8749405/15280162/171161298/ovs-vswitchd.log
       
      snippet of ovs log:

      ovs_bonding_balance_tcp_bond_primary_kernel_vf_bond_1to1_OVS_lacpactive_Switch_lacppassive_start
2024-01-03T17:17:40.327Z|00001|vlog|INFO|opened log file /var/log/openvswitch/ovs-vswitchd.log
2024-01-03T17:17:40.453Z|00002|ovs_numa|INFO|Discovered 24 CPU cores on NUMA node 1
2024-01-03T17:17:40.453Z|00003|ovs_numa|INFO|Discovered 24 CPU cores on NUMA node 0
2024-01-03T17:17:40.453Z|00004|ovs_numa|INFO|Discovered 2 NUMA nodes and 48 CPU cores
2024-01-03T17:17:40.453Z|00005|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connecting...
2024-01-03T17:17:40.454Z|00006|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connected
2024-01-03T17:17:40.455Z|00007|dpdk|INFO|DPDK Disabled - Use other_config:dpdk-init to enable
2024-01-03T17:17:40.464Z|00008|bridge|INFO|ovs-vswitchd (Open vSwitch) 3.2.2
2024-01-03T17:17:41.302Z|00009|dpif_netlink|INFO|Datapath dispatch mode: per-cpu
2024-01-03T17:17:41.303Z|00010|ofproto_dpif|INFO|system@ovs-system: Datapath supports recirculation
2024-01-03T17:17:41.303Z|00011|ofproto_dpif|INFO|system@ovs-system: VLAN header stack length probed as 2
2024-01-03T17:17:41.303Z|00012|ofproto_dpif|INFO|system@ovs-system: MPLS label stack length probed as 3
2024-01-03T17:17:41.303Z|00013|ofproto_dpif|INFO|system@ovs-system: Datapath supports truncate action
2024-01-03T17:17:41.303Z|00014|ofproto_dpif|INFO|system@ovs-system: Datapath supports unique flow ids
2024-01-03T17:17:41.303Z|00015|ofproto_dpif|INFO|system@ovs-system: Datapath supports clone action
2024-01-03T17:17:41.304Z|00016|ofproto_dpif|INFO|system@ovs-system: Max sample nesting level probed as 10
2024-01-03T17:17:41.304Z|00017|ofproto_dpif|INFO|system@ovs-system: Datapath supports eventmask in conntrack action
2024-01-03T17:17:41.304Z|00018|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_clear action
2024-01-03T17:17:41.304Z|00019|ofproto_dpif|INFO|system@ovs-system: Max dp_hash algorithm probed to be 1
2024-01-03T17:17:41.304Z|00020|ofproto_dpif|INFO|system@ovs-system: Datapath supports check_pkt_len action
2024-01-03T17:17:41.304Z|00021|ofproto_dpif|INFO|system@ovs-system: Datapath supports timeout policy in conntrack action
2024-01-03T17:17:41.304Z|00022|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_zero_snat
2024-01-03T17:17:41.304Z|00023|ofproto_dpif|INFO|system@ovs-system: Datapath supports add_mpls action
2024-01-03T17:17:41.304Z|00024|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_state
2024-01-03T17:17:41.304Z|00025|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_zone
2024-01-03T17:17:41.304Z|00026|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_mark
2024-01-03T17:17:41.305Z|00027|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_label
2024-01-03T17:17:41.305Z|00028|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_state_nat
2024-01-03T17:17:41.305Z|00029|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_orig_tuple
2024-01-03T17:17:41.305Z|00030|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_orig_tuple6
2024-01-03T17:17:41.305Z|00031|ofproto_dpif|INFO|system@ovs-system: Datapath does not support IPv6 ND Extensions
2024-01-03T17:17:41.305Z|00032|ofproto_dpif_upcall|INFO|Overriding n-handler-threads to 5, setting n-revalidator-threads to 2
2024-01-03T17:17:41.305Z|00033|ofproto_dpif_upcall|INFO|Starting 7 threads
2024-01-03T17:17:41.329Z|00034|bridge|INFO|bridge bondbridge: added interface bondbridge on port 65534
2024-01-03T17:17:41.329Z|00035|bridge|INFO|bridge bondbridge: using datapath ID 000002a3e48edd4d
2024-01-03T17:17:41.329Z|00036|connmgr|INFO|bondbridge: added service controller "punix:/var/run/openvswitch/bondbridge.mgmt"
2024-01-03T17:17:42.311Z|00037|bridge|INFO|bridge bondbridge: added interface enp94s0v0 on port 1
2024-01-03T17:17:42.312Z|00038|bridge|INFO|bridge bondbridge: added interface enp97s0v0 on port 2
2024-01-03T17:17:42.451Z|00039|bridge|INFO|bridge bondbridge: added interface patchbond on port 3
2024-01-03T17:17:43.459Z|00040|bond|DBG|bond balance-tcp:
2024-01-03T17:17:44.808Z|00041|bond|DBG|bond balance-tcp:
2024-01-03T17:17:44.831Z|00042|connmgr|INFO|bondbridge<->unix#20: 1 flow_mods in the last 0 s (1 deletes)
2024-01-03T17:17:44.975Z|00043|connmgr|INFO|bondbridge<->unix#23: 1 flow_mods in the last 0 s (1 adds)
2024-01-03T17:17:45.976Z|00044|bond|DBG|bond balance-tcp:
2024-01-03T17:17:46.465Z|00045|bond|INFO|member enp94s0v0: link state up
2024-01-03T17:17:46.465Z|00046|bond|INFO|member enp94s0v0: enabled
2024-01-03T17:17:46.465Z|00047|bond|INFO|member enp97s0v0: link state up
2024-01-03T17:17:46.465Z|00048|bond|INFO|member enp97s0v0: enabled
2024-01-03T17:17:46.466Z|00049|bond|INFO|bond balance-tcp: active member is now enp97s0v0
2024-01-03T17:17:47.064Z|00050|bond|DBG|bond balance-tcp: enp97s0v0 0kB (h248: 0kB), enp94s0v0 0kB (h149: 0kB)
2024-01-03T17:17:47.286Z|00051|bridge|INFO|bridge bondbridge: added interface mibalance-tcp on port 4
2024-01-03T17:17:47.460Z|00052|bridge|INFO|bridge bondbridge: deleted interface mibalance-tcp on port 4
2024-01-03T17:17:48.268Z|00053|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h82: 0kB + h149: 0kB), enp97s0v0 0kB (h248: 0kB)
2024-01-03T17:17:49.108Z|00054|bridge|INFO|bridge guestbridge: added interface guestbridge on port 65534
2024-01-03T17:17:49.112Z|00055|bridge|INFO|bridge guestbridge: using datapath ID 00009678604d5f48
2024-01-03T17:17:49.113Z|00056|connmgr|INFO|guestbridge: added service controller "punix:/var/run/openvswitch/guestbridge.mgmt"
2024-01-03T17:17:49.225Z|00057|bridge|INFO|bridge guestbridge: added interface patchguest on port 1
2024-01-03T17:17:49.402Z|00058|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h82: 0kB + h149: 0kB), enp97s0v0 0kB (h248: 0kB)
2024-01-03T17:17:50.392Z|00059|memory|INFO|179772 kB peak resident set size after 10.1 seconds
2024-01-03T17:17:50.393Z|00060|memory|INFO|handlers:5 idl-cells-Open_vSwitch:381 ports:6 revalidators:2 rules:266 udpif keys:15
2024-01-03T17:17:50.894Z|00061|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h82: 0kB + h149: 0kB), enp97s0v0 0kB (h186: 0kB + h248: 0kB)
2024-01-03T17:17:51.554Z|00062|bridge|INFO|bridge guestbridge: added interface g1_814c1c_o on port 2
2024-01-03T17:17:52.165Z|00063|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h19: 0kB + h187: 0kB + h80: 0kB + h82: 0kB + h149: 0kB), enp97s0v0 0kB (h186: 0kB + h248: 0kB)
2024-01-03T17:17:52.210Z|00064|bridge|INFO|bridge guestbridge: added interface g2_8361a0_o on port 3
2024-01-03T17:17:52.858Z|00065|bridge|INFO|bridge guestbridge: added interface g3_f44757_o on port 4
2024-01-03T17:17:53.503Z|00066|bond|DBG|bond balance-tcp: enp94s0v0 1kB (h31: 0kB + h44: 0kB + h19: 0kB + h15: 0kB + h62: 0kB + h89: 0kB + h254: 0kB + h187: 0kB + h80: 0kB + h82: 0kB + h149: 0kB), enp97s0v0 0kB (h248: 0kB + h11: 0kB + h75: 0kB + h243: 0kB + h186: 0kB)
2024-01-03T17:17:54.509Z|00067|bond|DBG|bond balance-tcp: enp94s0v0 1kB (h31: 0kB + h210: 0kB + h44: 0kB + h164: 0kB + h94: 0kB + h19: 0kB + h15: 0kB + h62: 0kB + h89: 0kB + h254: 0kB + h187: 0kB + h80: 0kB + h82: 0kB + h149: 0kB), enp97s0v0 0kB (h106: 0kB + h175: 0kB + h248: 0kB + h11: 0kB + h75: 0kB + h243: 0kB + h186: 0kB)
2024-01-03T17:17:55.510Z|00068|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h210: 0kB + h44: 0kB + h36: 0kB + h164: 0kB + h94: 0kB + h19: 0kB + h15: 0kB + h62: 0kB + h89: 0kB + h254: 0kB + h187: 0kB + h80: 0kB + h82: 0kB), enp97s0v0 0kB (h237: 0kB + h247: 0kB + h106: 0kB + h175: 0kB + h248: 0kB + h11: 0kB + h75: 0kB + h243: 0kB + h186: 0kB)
2024-01-03T17:17:56.510Z|00069|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h210: 0kB + h44: 0kB + h36: 0kB + h164: 0kB + h94: 0kB + h19: 0kB + h15: 0kB + h62: 0kB + h89: 0kB + h254: 0kB + h187: 0kB + h80: 0kB), enp97s0v0 0kB (h237: 0kB + h110: 0kB + h247: 0kB + h106: 0kB + h175: 0kB + h248: 0kB + h11: 0kB + h75: 0kB + h186: 0kB + h243: 0kB)
2024-01-03T17:17:57.518Z|00070|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h187: 0kB + h31: 0kB + h210: 0kB + h44: 0kB + h36: 0kB + h164: 0kB + h94: 0kB + h15: 0kB + h19: 0kB + h62: 0kB + h89: 0kB + h254: 0kB + h80: 0kB), enp97s0v0 0kB (h237: 0kB + h110: 0kB + h247: 0kB + h106: 0kB + h175: 0kB + h11: 0kB + h75: 0kB + h248: 0kB + h186: 0kB + h243: 0kB)
2024-01-03T17:17:58.520Z|00071|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h62: 0kB + h187: 0kB + h31: 0kB + h210: 0kB + h44: 0kB + h36: 0kB + h164: 0kB + h94: 0kB + h15: 0kB + h19: 0kB + h89: 0kB + h254: 0kB + h80: 0kB), enp97s0v0 0kB (h237: 0kB + h110: 0kB + h247: 0kB + h106: 0kB + h175: 0kB + h11: 0kB + h75: 0kB + h186: 0kB + h243: 0kB + h248: 0kB)
2024-01-03T17:17:59.520Z|00072|bond|DBG|bond balance-tcp: enp97s0v0 0kB (h106: 0kB + h237: 0kB + h110: 0kB + h247: 0kB + h175: 0kB + h11: 0kB + h75: 0kB + h186: 0kB + h243: 0kB + h248: 0kB), enp94s0v0 0kB (h62: 0kB + h187: 0kB + h31: 0kB + h210: 0kB + h44: 0kB + h36: 0kB + h94: 0kB + h164: 0kB + h15: 0kB + h19: 0kB + h89: 0kB + h254: 0kB)
2024-01-03T17:17:59.638Z|00073|connmgr|INFO|guestbridge<->unix#51: 1 flow_mods in the last 0 s (1 deletes)
2024-01-03T17:17:59.779Z|00074|connmgr|INFO|guestbridge<->unix#54: 1 flow_mods in the last 0 s (1 adds)
2024-01-03T17:18:00.783Z|00075|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h62: 0kB + h187: 0kB + h210: 0kB + h44: 0kB + h36: 0kB + h94: 0kB + h164: 0kB), enp97s0v0 0kB (h106: 0kB + h237: 0kB + h110: 0kB + h247: 0kB + h175: 0kB)
2024-01-03T17:18:01.790Z|00076|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h62: 0kB + h187: 0kB + h210: 0kB + h44: 0kB + h36: 0kB), enp97s0v0 0kB (h106: 0kB + h237: 0kB + h110: 0kB + h247: 0kB)
2024-01-03T17:18:02.789Z|00077|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h62: 0kB + h187: 0kB + h44: 0kB + h210: 0kB), enp97s0v0 0kB (h106: 0kB + h237: 0kB + h110: 0kB)
2024-01-03T17:18:03.793Z|00078|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h62: 0kB + h187: 0kB), enp97s0v0 0kB (h106: 0kB + h237: 0kB)
2024-01-03T17:18:05.042Z|00079|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB + h62: 0kB), enp97s0v0 0kB (h106: 0kB + h237: 0kB)
2024-01-03T17:18:06.042Z|00080|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB), enp97s0v0 0kB (h106: 0kB)
2024-01-03T17:18:07.043Z|00081|bond|DBG|bond balance-tcp: enp94s0v0 0kB (h31: 0kB), enp97s0v0 0kB
2024-01-03T17:18:08.044Z|00082|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:18:09.046Z|00083|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:18:10.052Z|00084|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:18:11.053Z|00085|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:18:12.055Z|00086|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:18:13.057Z|00087|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:18:14.125Z|00088|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:18:15.323Z|00089|bond|INFO|member enp97s0v0: link state down
2024-01-03T17:18:15.323Z|00090|bond|INFO|member enp97s0v0: disabled
2024-01-03T17:18:15.324Z|00091|bond|INFO|bond balance-tcp: active member is now enp94s0v0
2024-01-03T17:18:15.327Z|00001|bond(revalidator7)|DBG|bond balance-tcp: member enp97s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: false, enabled: false, LACP status: negotiated
2024-01-03T17:18:15.328Z|00002|bond(revalidator7)|DBG|bond balance-tcp: member enp97s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: false, enabled: false, LACP status: negotiated
2024-01-03T17:18:15.328Z|00003|bond(revalidator7)|DBG|bond balance-tcp: member enp97s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: false, enabled: false, LACP status: negotiated
2024-01-03T17:18:15.328Z|00004|bond(revalidator7)|DBG|bond balance-tcp: member enp97s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: false, enabled: false, LACP status: negotiated
2024-01-03T17:18:15.328Z|00005|bond(revalidator7)|DBG|bond balance-tcp: member enp97s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: false, enabled: false, LACP status: negotiated
2024-01-03T17:18:15.329Z|00092|bond|DBG|bond balance-tcp: enp94s0v0 0kB
2024-01-03T17:18:16.324Z|00093|bond|INFO|member enp94s0v0: link state down
2024-01-03T17:18:16.324Z|00094|bond|INFO|member enp94s0v0: disabled
2024-01-03T17:18:16.325Z|00095|bond|INFO|bond balance-tcp: all members disabled
2024-01-03T17:18:16.329Z|00096|bond|DBG|bond balance-tcp:
2024-01-03T17:18:17.330Z|00097|bond|DBG|bond balance-tcp:
2024-01-03T17:18:18.332Z|00098|bond|DBG|bond balance-tcp:
2024-01-03T17:18:19.184Z|00099|bond|INFO|member enp94s0v0: link state up
2024-01-03T17:18:19.184Z|00100|bond|INFO|member enp94s0v0: enabled
2024-01-03T17:18:19.184Z|00101|bond|INFO|member enp97s0v0: link state up
2024-01-03T17:18:19.184Z|00102|bond|INFO|member enp97s0v0: enabled
2024-01-03T17:18:19.184Z|00103|bond|INFO|bond balance-tcp: active member is now enp97s0v0
2024-01-03T17:19:18.339Z|00001|bond(revalidator8)|DBG|Dropped 111 log messages in last 63 seconds (most recently, 14 seconds ago) due to excessive rate
2024-01-03T17:19:18.340Z|00002|bond(revalidator8)|DBG|bond balance-tcp: member enp94s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: true, enabled: true, LACP status: configured
2024-01-03T17:20:24.491Z|00001|bond(handler6)|DBG|Dropped 3 log messages in last 65 seconds (most recently, 65 seconds ago) due to excessive rate
2024-01-03T17:20:24.492Z|00002|bond(handler6)|DBG|bond balance-tcp: member enp94s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: true, enabled: true, LACP status: configured
2024-01-03T17:21:18.662Z|00003|bond(handler6)|DBG|Dropped 34 log messages in last 55 seconds (most recently, 5 seconds ago) due to excessive rate
2024-01-03T17:21:18.663Z|00004|bond(handler6)|DBG|bond balance-tcp: member enp94s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: true, enabled: true, LACP status: configured
2024-01-03T17:22:19.304Z|00104|bond|INFO|member enp97s0v0: link state down
2024-01-03T17:22:19.304Z|00105|bond|INFO|member enp97s0v0: disabled
2024-01-03T17:22:19.304Z|00106|bond|INFO|bond balance-tcp: active member is now enp94s0v0
2024-01-03T17:22:19.309Z|00107|bond|INFO|member enp94s0v0: link state down
2024-01-03T17:22:19.309Z|00108|bond|INFO|member enp94s0v0: disabled
2024-01-03T17:22:19.309Z|00109|bond|INFO|bond balance-tcp: all members disabled
2024-01-03T17:22:19.310Z|00006|bond(revalidator7)|DBG|Dropped 50 log messages in last 60 seconds (most recently, 24 seconds ago) due to excessive rate
2024-01-03T17:22:19.310Z|00007|bond(revalidator7)|DBG|bond balance-tcp: member enp97s0v0: admissibility verdict is to drop pkt, active member: false, may_enable: false, enabled: false, LACP status: negotiated
2024-01-03T17:22:19.310Z|00008|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:24534bd3-feca-4570-ada0-ff0bd97f97a6 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:15:4d:13:04:24,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=172.20.133.3,tip=172.20.133.2,op=1,sha=00:15:4d:13:04:24/00:00:00:00:00:00,tha=00:00:00:00:00:00/00:00:00:00:00:00)
2024-01-03T17:22:19.311Z|00003|dpif(revalidator8)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:67191b34-f023-46b9-b72c-21523b7e4c13 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=96:4d:b6:30:62:2a,dst=33:33:00:00:00:16),eth_type(0x86dd),ipv6(src=fe80::4456:fefe:cba:8996/::,dst=ff02::16/::,label=0/0,proto=58/0,tclass=0/0,hlimit=1/0,frag=no),icmpv6(type=143/0,code=0/0)
2024-01-03T17:22:19.311Z|00004|dpif(revalidator8)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:b298e487-57f8-45ab-8824-64566b58a99b recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=b2:fd:e0:44:af:0d,dst=33:33:00:00:00:16),eth_type(0x86dd),ipv6(src=fe80::42a6:c165:aa06:493f/::,dst=ff02::16/::,label=0/0,proto=58/0,tclass=0/0,hlimit=1/0,frag=no),icmpv6(type=143/0,code=0/0)
2024-01-03T17:22:19.312Z|00009|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:e11b13e3-0c99-48d3-a967-1eabc62ce302 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:02:c9:52:27:27,dst=33:33:00:00:00:01),eth_type(0x86dd),ipv6(src=fe80::202:c9ff:fe52:2727/::,dst=ff02::1/::,label=0/0,proto=58/0,tclass=0/0,hlimit=255/0,frag=no),icmpv6(type=134/0,code=0/0)
2024-01-03T17:22:19.312Z|00010|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:e0920f96-3a82-4439-9f29-07fb9caa281a recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:15:4d:13:04:24,dst=33:33:ff:00:00:02),eth_type(0x86dd),ipv6(src=2009:133:10::1/::,dst=ff02::1:ff00:2/::,label=0/0,proto=58/0,tclass=0/0,hlimit=255/0,frag=no),icmpv6(type=135/0,code=0/0),nd(target=2009:133:10::2/::,sll=00:15:4d:13:04:24/00:00:00:00:00:00,tll=00:00:00:00:00:00/00:00:00:00:00:00)
2024-01-03T17:22:20.318Z|00110|bond|DBG|bond balance-tcp:
2024-01-03T17:22:21.310Z|00111|bond|INFO|member enp94s0v0: link state up
2024-01-03T17:22:21.310Z|00112|bond|INFO|member enp94s0v0: enabled
2024-01-03T17:22:21.310Z|00113|bond|INFO|member enp97s0v0: link state up
2024-01-03T17:22:21.310Z|00114|bond|INFO|member enp97s0v0: enabled
2024-01-03T17:22:21.310Z|00115|bond|INFO|bond balance-tcp: active member is now enp97s0v0
2024-01-03T17:22:21.314Z|00011|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:24534bd3-feca-4570-ada0-ff0bd97f97a6 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:15:4d:13:04:24,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=172.20.133.3,tip=172.20.133.2,op=1,sha=00:15:4d:13:04:24/00:00:00:00:00:00,tha=00:00:00:00:00:00/00:00:00:00:00:00), actions:1,4,5,6,7
2024-01-03T17:22:21.315Z|00005|dpif(revalidator8)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:67191b34-f023-46b9-b72c-21523b7e4c13 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=96:4d:b6:30:62:2a,dst=33:33:00:00:00:16),eth_type(0x86dd),ipv6(src=fe80::4456:fefe:cba:8996/::,dst=ff02::16/::,label=0/0,proto=58/0,tclass=0/0,hlimit=1/0,frag=no),icmpv6(type=143/0,code=0/0), actions:1,4,5,6,7
2024-01-03T17:22:21.315Z|00012|dpif(revalidator7)|WARN|system@ovs-system: failed to flow_del (No such file or directory) ufid:818f34e7-ed88-401d-897a-2e90612962ec recirc_id(0),dp_hash(0),skb_priority(0),in_port(2),skb_mark(0),ct_state(0),ct_zone(0),ct_mark(0),ct_label(0),eth(src=00:15:4d:13:04:24,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=172.20.133.3,tip=172.20.133.2,op=1,sha=00:15:4d:13:04:24,tha=00:00:00:00:00:00)
2024-01-03T17:22:21.315Z|00006|dpif(revalidator8)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:850d0dd5-05f9-45b6-89a1-dc8097f8f4f9 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(2),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=b2:fd:e0:44:af:0d,dst=33:33:00:00:00:16),eth_type(0x86dd),ipv6(src=fe80::42a6:c165:aa06:493f/::,dst=ff02::16/::,label=0/0,proto=58/0,tclass=0/0,hlimit=1/0,frag=no),icmpv6(type=143/0,code=0/0), actions:1,4,5,6,7
2024-01-03T17:22:21.315Z|00013|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:e11b13e3-0c99-48d3-a967-1eabc62ce302 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:02:c9:52:27:27,dst=33:33:00:00:00:01),eth_type(0x86dd),ipv6(src=fe80::202:c9ff:fe52:2727/::,dst=ff02::1/::,label=0/0,proto=58/0,tclass=0/0,hlimit=255/0,frag=no),icmpv6(type=134/0,code=0/0), actions:1,4,5,6,7
2024-01-03T17:22:21.315Z|00007|dpif(revalidator8)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:b298e487-57f8-45ab-8824-64566b58a99b recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=b2:fd:e0:44:af:0d,dst=33:33:00:00:00:16),eth_type(0x86dd),ipv6(src=fe80::42a6:c165:aa06:493f/::,dst=ff02::16/::,label=0/0,proto=58/0,tclass=0/0,hlimit=1/0,frag=no),icmpv6(type=143/0,code=0/0), actions:1,4,5,6,7
2024-01-03T17:22:21.815Z|00116|bond|DBG|bond balance-tcp: enp94s0v0 0kB, enp97s0v0 0kB
2024-01-03T17:22:22.817Z|00117|bond|DBG|bond balance-tcp: enp94s0v0 1004kB (h163: 1004kB + h196: 0kB), enp97s0v0 418kB (h76: 417kB + h102: 0kB)
2024-01-03T17:22:23.819Z|00118|bond|DBG|bond balance-tcp: enp94s0v0 751kB (h163: 751kB + h196: 0kB), enp97s0v0 457kB (h76: 457kB + h102: 0kB)
2024-01-03T17:22:24.820Z|00119|bond|DBG|bond balance-tcp: enp94s0v0 624kB (h163: 624kB + h196: 0kB), enp97s0v0 477kB (h76: 477kB + h102: 0kB)
2024-01-03T17:22:25.822Z|00120|bond|DBG|bond balance-tcp: enp94s0v0 552kB (h163: 552kB + h196: 0kB), enp97s0v0 487kB (h76: 487kB + h102: 0kB)
2024-01-03T17:22:26.824Z|00121|bond|DBG|bond balance-tcp: enp94s0v0 525kB (h163: 525kB + h196: 0kB), enp97s0v0 492kB (h76: 492kB + h102: 0kB)
2024-01-03T17:22:27.825Z|00122|bond|DBG|bond balance-tcp: enp94s0v0 511kB (h163: 511kB + h196: 0kB), enp97s0v0 495kB (h76: 495kB + h102: 0kB)
2024-01-03T17:22:28.826Z|00123|bond|DBG|bond balance-tcp: enp94s0v0 504kB (h163: 504kB + h196: 0kB), enp97s0v0 496kB (h76: 496kB + h102: 0kB)
2024-01-03T17:22:29.828Z|00124|bond|DBG|bond balance-tcp: enp94s0v0 501kB (h163: 501kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:22:30.829Z|00125|bond|DBG|bond balance-tcp: enp94s0v0 499kB (h163: 499kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:22:31.830Z|00126|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:22:32.833Z|00127|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:22:33.839Z|00128|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 489kB (h163: 489kB)
2024-01-03T17:22:34.841Z|00129|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:22:35.844Z|00130|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:22:36.844Z|00131|bond|DBG|bond balance-tcp: enp94s0v0 496kB (h163: 496kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:22:37.847Z|00132|bond|DBG|bond balance-tcp: enp94s0v0 524kB (h163: 524kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:22:38.847Z|00133|bond|DBG|bond balance-tcp: enp94s0v0 510kB (h163: 510kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:22:39.849Z|00134|bond|DBG|bond balance-tcp: enp97s0v0 496kB (h76: 496kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:22:40.850Z|00135|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 496kB (h163: 496kB)
2024-01-03T17:22:41.853Z|00136|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 497kB (h163: 497kB)
2024-01-03T17:22:42.853Z|00137|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 497kB (h163: 497kB)
2024-01-03T17:22:43.855Z|00138|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:22:44.857Z|00139|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:22:45.858Z|00140|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:22:46.860Z|00141|bond|DBG|bond balance-tcp: enp97s0v0 496kB (h76: 496kB), enp94s0v0 488kB (h163: 488kB)
2024-01-03T17:22:47.861Z|00142|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:22:48.863Z|00143|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB + h93: 0kB)
2024-01-03T17:22:49.864Z|00144|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 496kB (h163: 496kB + h93: 0kB)
2024-01-03T17:22:50.865Z|00145|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 497kB (h163: 497kB + h93: 0kB)
2024-01-03T17:22:52.143Z|00146|bond|DBG|bond balance-tcp: enp97s0v0 568kB (h76: 568kB), enp94s0v0 542kB (h163: 542kB + h93: 0kB)
2024-01-03T17:22:53.145Z|00147|bond|DBG|bond balance-tcp: enp94s0v0 546kB (h163: 546kB + h93: 0kB), enp97s0v0 533kB (h76: 533kB)
2024-01-03T17:22:54.146Z|00148|bond|DBG|bond balance-tcp: enp94s0v0 522kB (h163: 522kB + h93: 0kB), enp97s0v0 506kB (h76: 506kB)
2024-01-03T17:22:55.148Z|00149|bond|DBG|bond balance-tcp: enp94s0v0 510kB (h163: 510kB + h93: 0kB), enp97s0v0 502kB (h76: 502kB)
2024-01-03T17:22:56.151Z|00150|bond|DBG|bond balance-tcp: enp94s0v0 503kB (h163: 503kB), enp97s0v0 500kB (h76: 500kB)
2024-01-03T17:22:57.646Z|00151|bond|DBG|bond balance-tcp: enp97s0v0 623kB (h76: 623kB), enp94s0v0 616kB (h163: 616kB)
2024-01-03T17:22:58.647Z|00152|bond|DBG|bond balance-tcp: enp97s0v0 560kB (h76: 560kB), enp94s0v0 557kB (h163: 557kB)
2024-01-03T17:22:59.649Z|00153|bond|DBG|bond balance-tcp: enp97s0v0 529kB (h76: 529kB), enp94s0v0 527kB (h163: 527kB)
2024-01-03T17:23:01.144Z|00154|bond|DBG|bond balance-tcp: enp97s0v0 638kB (h76: 638kB), enp94s0v0 610kB (h163: 610kB)
2024-01-03T17:23:02.146Z|00155|bond|DBG|bond balance-tcp: enp94s0v0 580kB (h163: 580kB), enp97s0v0 559kB (h76: 559kB)
2024-01-03T17:23:03.147Z|00156|bond|DBG|bond balance-tcp: enp94s0v0 539kB (h163: 539kB), enp97s0v0 528kB (h76: 528kB)
2024-01-03T17:23:04.644Z|00157|bond|DBG|bond balance-tcp: enp97s0v0 637kB (h76: 637kB), enp94s0v0 616kB (h163: 616kB)
2024-01-03T17:23:05.647Z|00158|bond|DBG|bond balance-tcp: enp94s0v0 574kB (h163: 574kB), enp97s0v0 567kB (h76: 567kB)
2024-01-03T17:23:06.647Z|00159|bond|DBG|bond balance-tcp: enp94s0v0 536kB (h163: 536kB), enp97s0v0 532kB (h76: 532kB)
2024-01-03T17:23:07.650Z|00160|bond|DBG|bond balance-tcp: enp94s0v0 517kB (h163: 517kB + h188: 0kB), enp97s0v0 515kB (h76: 515kB)
2024-01-03T17:23:09.143Z|00161|bond|DBG|bond balance-tcp: enp97s0v0 622kB (h76: 622kB), enp94s0v0 605kB (h163: 605kB + h188: 0kB)
2024-01-03T17:23:10.145Z|00162|bond|DBG|bond balance-tcp: enp94s0v0 578kB (h163: 578kB + h188: 0kB), enp97s0v0 560kB (h76: 560kB)
2024-01-03T17:23:11.147Z|00163|bond|DBG|bond balance-tcp: enp94s0v0 538kB (h163: 538kB + h188: 0kB), enp97s0v0 528kB (h76: 528kB)
2024-01-03T17:23:12.148Z|00164|bond|DBG|bond balance-tcp: enp97s0v0 513kB (h76: 513kB), enp94s0v0 509kB (h163: 509kB + h188: 0kB)
2024-01-03T17:23:13.150Z|00165|bond|DBG|bond balance-tcp: enp97s0v0 505kB (h76: 505kB), enp94s0v0 503kB (h163: 503kB + h188: 0kB)
2024-01-03T17:23:14.644Z|00166|bond|DBG|bond balance-tcp: enp97s0v0 626kB (h76: 626kB), enp94s0v0 598kB (h163: 598kB + h93: 0kB + h188: 0kB)
2024-01-03T17:23:16.143Z|00167|bond|DBG|bond balance-tcp: enp97s0v0 677kB (h76: 677kB), enp94s0v0 672kB (h163: 672kB + h93: 0kB)
2024-01-03T17:23:17.145Z|00168|bond|DBG|bond balance-tcp: enp94s0v0 611kB (h163: 611kB + h93: 0kB), enp97s0v0 587kB (h76: 587kB)
2024-01-03T17:23:18.147Z|00169|bond|DBG|bond balance-tcp: enp94s0v0 554kB (h163: 554kB + h93: 0kB), enp97s0v0 542kB (h76: 542kB)
2024-01-03T17:23:19.148Z|00170|bond|DBG|bond balance-tcp: enp97s0v0 520kB (h76: 520kB), enp94s0v0 517kB (h163: 517kB + h93: 0kB)
2024-01-03T17:23:20.149Z|00171|bond|DBG|bond balance-tcp: enp97s0v0 509kB (h76: 509kB), enp94s0v0 507kB (h163: 507kB + h93: 0kB)
2024-01-03T17:23:21.151Z|00172|bond|DBG|bond balance-tcp: enp97s0v0 503kB (h76: 503kB), enp94s0v0 502kB (h163: 502kB + h93: 0kB)
2024-01-03T17:23:22.152Z|00173|bond|DBG|bond balance-tcp: enp97s0v0 500kB (h76: 500kB), enp94s0v0 500kB (h163: 500kB)
2024-01-03T17:23:23.153Z|00174|bond|DBG|bond balance-tcp: enp97s0v0 499kB (h76: 499kB), enp94s0v0 499kB (h163: 499kB)
2024-01-03T17:23:24.156Z|00175|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB), enp97s0v0 489kB (h76: 489kB)
2024-01-03T17:23:25.156Z|00176|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:23:26.157Z|00177|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:23:27.159Z|00178|bond|DBG|bond balance-tcp: enp97s0v0 496kB (h76: 496kB), enp94s0v0 489kB (h163: 489kB)
2024-01-03T17:23:28.162Z|00179|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:23:29.162Z|00180|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:23:30.164Z|00181|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 496kB (h163: 496kB)
2024-01-03T17:23:31.165Z|00182|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:23:32.166Z|00183|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:23:33.168Z|00184|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:23:34.169Z|00185|bond|DBG|bond balance-tcp: enp97s0v0 496kB (h76: 496kB), enp94s0v0 488kB (h163: 488kB)
2024-01-03T17:23:35.172Z|00186|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:23:36.172Z|00187|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:23:37.174Z|00188|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 496kB (h163: 496kB)
2024-01-03T17:23:38.174Z|00189|bond|DBG|bond balance-tcp: enp97s0v0 515kB (h76: 515kB), enp94s0v0 497kB (h163: 497kB)
2024-01-03T17:23:39.180Z|00190|bond|DBG|bond balance-tcp: enp97s0v0 506kB (h76: 506kB), enp94s0v0 497kB (h163: 497kB)
2024-01-03T17:23:40.182Z|00191|bond|DBG|bond balance-tcp: enp97s0v0 502kB (h76: 502kB), enp94s0v0 497kB (h163: 497kB)
2024-01-03T17:23:41.183Z|00192|bond|DBG|bond balance-tcp: enp97s0v0 500kB (h76: 500kB), enp94s0v0 488kB (h163: 488kB + h93: 0kB)
2024-01-03T17:23:42.185Z|00193|bond|DBG|bond balance-tcp: enp97s0v0 498kB (h76: 498kB), enp94s0v0 493kB (h163: 493kB + h93: 0kB)
2024-01-03T17:23:43.185Z|00194|bond|DBG|bond balance-tcp: enp97s0v0 498kB (h76: 498kB), enp94s0v0 495kB (h163: 495kB + h93: 0kB)
2024-01-03T17:23:44.186Z|00195|bond|DBG|bond balance-tcp: enp94s0v0 496kB (h163: 496kB + h93: 0kB), enp97s0v0 489kB (h76: 489kB)
2024-01-03T17:23:45.188Z|00196|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:23:46.189Z|00197|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:23:47.190Z|00198|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:23:48.192Z|00199|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 497kB (h76: 497kB)
2024-01-03T17:23:49.193Z|00200|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 488kB (h163: 488kB)
2024-01-03T17:23:50.194Z|00201|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:23:51.196Z|00202|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:23:52.198Z|00203|bond|DBG|bond balance-tcp: enp94s0v0 496kB (h163: 496kB + h188: 0kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:23:53.199Z|00204|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h188: 0kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:23:54.200Z|00205|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h188: 0kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:23:55.202Z|00206|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h188: 0kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:23:56.202Z|00207|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 488kB (h163: 488kB + h188: 0kB)
2024-01-03T17:23:57.205Z|00208|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB + h188: 0kB)
2024-01-03T17:23:58.205Z|00209|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB + h188: 0kB)
2024-01-03T17:23:59.207Z|00210|bond|DBG|bond balance-tcp: enp94s0v0 496kB (h163: 496kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:24:00.209Z|00211|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:24:01.210Z|00212|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:24:02.212Z|00213|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:24:03.215Z|00214|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 488kB (h163: 488kB)
2024-01-03T17:24:04.216Z|00215|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:24:05.217Z|00216|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:24:06.219Z|00217|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 496kB (h163: 496kB)
2024-01-03T17:24:07.221Z|00218|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:24:08.223Z|00219|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:24:09.223Z|00220|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:24:10.225Z|00221|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:24:11.226Z|00222|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 488kB (h163: 488kB + h93: 0kB)
2024-01-03T17:24:12.227Z|00223|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB + h93: 0kB)
2024-01-03T17:24:13.229Z|00224|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB + h93: 0kB)
2024-01-03T17:24:14.231Z|00225|bond|DBG|bond balance-tcp: enp94s0v0 496kB (h163: 496kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:24:15.233Z|00226|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:24:16.645Z|00227|bond|DBG|bond balance-tcp: enp94s0v0 595kB (h163: 595kB), enp97s0v0 593kB (h76: 593kB)
2024-01-03T17:24:17.646Z|00228|bond|DBG|bond balance-tcp: enp94s0v0 573kB (h163: 573kB), enp97s0v0 545kB (h76: 545kB)
2024-01-03T17:24:18.648Z|00229|bond|DBG|bond balance-tcp: enp94s0v0 526kB (h163: 526kB), enp97s0v0 521kB (h76: 521kB)
2024-01-03T17:24:19.651Z|00230|bond|DBG|bond balance-tcp: enp94s0v0 512kB (h163: 512kB), enp97s0v0 509kB (h76: 509kB)
2024-01-03T17:24:20.651Z|00231|bond|DBG|bond balance-tcp: enp94s0v0 505kB (h163: 505kB), enp97s0v0 503kB (h76: 503kB)
2024-01-03T17:24:21.653Z|00232|bond|DBG|bond balance-tcp: enp94s0v0 501kB (h163: 501kB), enp97s0v0 500kB (h76: 500kB)
2024-01-03T17:24:22.655Z|00233|bond|DBG|bond balance-tcp: enp94s0v0 499kB (h163: 499kB), enp97s0v0 490kB (h76: 490kB)
2024-01-03T17:24:23.657Z|00234|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB), enp97s0v0 494kB (h76: 494kB)
2024-01-03T17:24:24.657Z|00235|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:24:25.660Z|00236|bond|DBG|bond balance-tcp: enp97s0v0 496kB (h76: 496kB), enp94s0v0 489kB (h163: 489kB)
2024-01-03T17:24:26.662Z|00237|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:24:27.662Z|00238|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:24:28.664Z|00239|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 496kB (h163: 496kB)
2024-01-03T17:24:29.666Z|00240|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 497kB (h163: 497kB)
2024-01-03T17:24:30.668Z|00241|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:24:31.669Z|00242|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:24:32.671Z|00243|bond|DBG|bond balance-tcp: enp97s0v0 495kB (h76: 495kB), enp94s0v0 489kB (h163: 488kB + h93: 0kB)
2024-01-03T17:24:33.673Z|00244|bond|DBG|bond balance-tcp: enp97s0v0 496kB (h76: 496kB), enp94s0v0 493kB (h163: 493kB + h93: 0kB)
2024-01-03T17:24:34.674Z|00245|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB + h93: 0kB)
2024-01-03T17:24:35.888Z|00246|bond|DBG|bond balance-tcp: enp97s0v0 568kB (h76: 568kB), enp94s0v0 550kB (h163: 550kB + h93: 0kB)
2024-01-03T17:24:36.890Z|00247|bond|DBG|bond balance-tcp: enp97s0v0 533kB (h76: 533kB), enp94s0v0 523kB (h163: 523kB + h93: 0kB)
2024-01-03T17:24:37.892Z|00248|bond|DBG|bond balance-tcp: enp97s0v0 515kB (h76: 515kB), enp94s0v0 502kB (h163: 502kB + h188: 0kB + h93: 0kB)
2024-01-03T17:24:38.893Z|00249|bond|DBG|bond balance-tcp: enp97s0v0 506kB (h76: 506kB), enp94s0v0 500kB (h163: 499kB + h188: 0kB + h93: 0kB)
2024-01-03T17:24:39.895Z|00250|bond|DBG|bond balance-tcp: enp97s0v0 502kB (h76: 502kB), enp94s0v0 498kB (h163: 498kB + h188: 0kB)
2024-01-03T17:24:40.896Z|00251|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB + h188: 0kB), enp97s0v0 491kB (h76: 491kB)
2024-01-03T17:24:41.898Z|00252|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB + h188: 0kB), enp97s0v0 494kB (h76: 494kB)
2024-01-03T17:24:42.900Z|00253|bond|DBG|bond balance-tcp: enp94s0v0 498kB (h163: 498kB + h188: 0kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:24:43.902Z|00254|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h188: 0kB), enp97s0v0 497kB (h76: 497kB)
2024-01-03T17:24:44.904Z|00255|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 489kB (h163: 489kB)
2024-01-03T17:24:45.905Z|00256|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:24:46.907Z|00257|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:24:47.909Z|00258|bond|DBG|bond balance-tcp: enp94s0v0 496kB (h163: 496kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:24:48.912Z|00259|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:24:49.914Z|00260|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:24:50.914Z|00261|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:24:51.916Z|00262|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 488kB (h163: 488kB)
2024-01-03T17:24:52.918Z|00263|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:24:53.920Z|00264|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:24:54.920Z|00265|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 496kB (h163: 496kB)
2024-01-03T17:24:55.923Z|00266|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 488kB (h76: 488kB)
2024-01-03T17:24:56.923Z|00267|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 493kB (h76: 493kB)
2024-01-03T17:24:57.925Z|00268|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB), enp97s0v0 495kB (h76: 495kB)
2024-01-03T17:24:58.925Z|00269|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h93: 0kB), enp97s0v0 496kB (h76: 496kB)
2024-01-03T17:24:59.927Z|00270|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 488kB (h163: 488kB + h93: 0kB)
2024-01-03T17:25:00.928Z|00271|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 493kB (h163: 493kB + h93: 0kB)
2024-01-03T17:25:01.930Z|00272|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB), enp94s0v0 495kB (h163: 495kB + h93: 0kB)
2024-01-03T17:25:03.406Z|00273|bond|DBG|bond balance-tcp: enp97s0v0 631kB (h76: 613kB + h138: 17kB + h195: 0kB), enp94s0v0 621kB (h163: 621kB + h110: 0kB + h241: 0kB + h93: 0kB)
2024-01-03T17:25:04.408Z|00274|bond|DBG|bond balance-tcp: enp97s0v0 564kB (h76: 555kB + h138: 8kB + h195: 0kB), enp94s0v0 559kB (h163: 559kB + h110: 0kB + h241: 0kB + h93: 0kB)
2024-01-03T17:25:05.408Z|00275|bond|DBG|bond balance-tcp: enp97s0v0 531kB (h76: 526kB + h138: 4kB + h195: 0kB), enp94s0v0 528kB (h163: 528kB + h110: 0kB + h241: 0kB + h93: 0kB)
2024-01-03T17:25:06.411Z|00276|bond|DBG|bond balance-tcp: enp97s0v0 514kB (h76: 512kB + h138: 2kB + h195: 0kB), enp94s0v0 513kB (h163: 513kB + h110: 0kB + h241: 0kB)
2024-01-03T17:25:07.411Z|00277|bond|DBG|bond balance-tcp: enp97s0v0 523kB (h76: 505kB + h138: 18kB + h195: 0kB), enp94s0v0 496kB (h163: 496kB + h245: 0kB + h110: 0kB + h241: 0kB)
2024-01-03T17:25:08.413Z|00278|bond|DBG|bond balance-tcp: enp97s0v0 510kB (h76: 501kB + h138: 9kB + h195: 0kB), enp94s0v0 497kB (h163: 497kB + h110: 0kB + h241: 0kB + h245: 0kB)
2024-01-03T17:25:09.416Z|00279|bond|DBG|bond balance-tcp: enp97s0v0 504kB (h76: 499kB + h138: 4kB + h195: 0kB), enp94s0v0 497kB (h163: 497kB + h110: 0kB + h241: 0kB + h245: 0kB)
2024-01-03T17:25:10.417Z|00280|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h110: 0kB + h241: 0kB + h245: 0kB), enp97s0v0 492kB (h76: 489kB + h138: 2kB + h195: 0kB)
2024-01-03T17:25:11.417Z|00281|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h110: 0kB + h241: 0kB + h245: 0kB), enp97s0v0 495kB (h76: 493kB + h138: 1kB + h195: 0kB)
2024-01-03T17:25:12.420Z|00282|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h110: 0kB + h241: 0kB + h245: 0kB), enp97s0v0 496kB (h76: 495kB + h138: 0kB + h195: 0kB)
2024-01-03T17:25:13.422Z|00283|bond|DBG|bond balance-tcp: enp94s0v0 497kB (h163: 497kB + h110: 0kB + h241: 0kB), enp97s0v0 497kB (h76: 496kB + h138: 0kB + h195: 0kB)
2024-01-03T17:25:14.424Z|00284|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB + h138: 0kB + h195: 0kB), enp94s0v0 488kB (h163: 488kB + h110: 0kB + h241: 0kB)
2024-01-03T17:25:15.425Z|00285|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB + h138: 0kB), enp94s0v0 493kB (h163: 493kB)
2024-01-03T17:25:16.426Z|00286|bond|DBG|bond balance-tcp: enp97s0v0 497kB (h76: 497kB + h138: 0kB), enp94s0v0 495kB (h163: 495kB)
2024-01-03T17:25:17.428Z|00287|bond|DBG|bond balance-tcp: enp97s0v0 373kB (h76: 373kB + h135: 0kB + h138: 0kB), enp94s0v0 373kB (h163: 372kB + h193: 0kB + h222: 0kB + h85: 0kB + h113: 0kB + h62: 0kB + h229: 0kB)
2024-01-03T17:25:18.429Z|00288|bond|DBG|bond balance-tcp: enp97s0v0 204kB (h76: 186kB + h138: 17kB + h135: 0kB), enp94s0v0 186kB (h163: 186kB + h193: 0kB + h222: 0kB + h85: 0kB + h113: 0kB + h62: 0kB + h229: 0kB)
2024-01-03T17:25:19.432Z|00289|bond|DBG|bond balance-tcp: enp97s0v0 102kB (h76: 93kB + h138: 8kB + h135: 0kB), enp94s0v0 93kB (h163: 93kB + h193: 0kB + h222: 0kB + h85: 0kB + h113: 0kB + h62: 0kB + h229: 0kB)
2024-01-03T17:25:19.472Z|00290|bridge|INFO|bridge guestbridge: deleted interface g1_814c1c_o on port 2
2024-01-03T17:25:19.497Z|00014|dpif(revalidator7)|WARN|Dropped 4 log messages in last 178 seconds (most recently, 178 seconds ago) due to excessive rate
2024-01-03T17:25:19.497Z|00015|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:24534bd3-feca-4570-ada0-ff0bd97f97a6 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:15:4d:13:04:24,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=172.20.133.3,tip=172.20.133.2,op=1,sha=00:15:4d:13:04:24/00:00:00:00:00:00,tha=00:00:00:00:00:00/00:00:00:00:00:00), actions:1,4,6,7
2024-01-03T17:25:19.497Z|00008|dpif(revalidator8)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:67191b34-f023-46b9-b72c-21523b7e4c13 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=96:4d:b6:30:62:2a,dst=33:33:00:00:00:16),eth_type(0x86dd),ipv6(src=fe80::4456:fefe:cba:8996/::,dst=ff02::16/::,label=0/0,proto=58/0,tclass=0/0,hlimit=1/0,frag=no),icmpv6(type=143/0,code=0/0), actions:1,4,6,7
2024-01-03T17:25:19.498Z|00016|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:e11b13e3-0c99-48d3-a967-1eabc62ce302 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(3),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:02:c9:52:27:27,dst=33:33:00:00:00:01),eth_type(0x86dd),ipv6(src=fe80::202:c9ff:fe52:2727/::,dst=ff02::1/::,label=0/0,proto=58/0,tclass=0/0,hlimit=255/0,frag=no),icmpv6(type=134/0,code=0/0), actions:1,4,6,7
2024-01-03T17:25:19.498Z|00009|dpif(revalidator8)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:850d0dd5-05f9-45b6-89a1-dc8097f8f4f9 recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(2),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=b2:fd:e0:44:af:0d,dst=33:33:00:00:00:16),eth_type(0x86dd),ipv6(src=fe80::42a6:c165:aa06:493f/::,dst=ff02::16/::,label=0/0,proto=58/0,tclass=0/0,hlimit=1/0,frag=no),icmpv6(type=143/0,code=0/0), actions:1,4,6,7
2024-01-03T17:25:19.498Z|00017|dpif(revalidator7)|WARN|system@ovs-system: failed to put[modify] (No such file or directory) ufid:8e7bf2fc-ec9a-47b7-8d5e-62f95f77dc7a recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(2),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=00:02:c9:52:27:27,dst=33:33:00:00:00:01),eth_type(0x86dd),ipv6(src=fe80::202:c9ff:fe52:2727/::,dst=ff02::1/::,label=0/0,proto=58/0,tclass=0/0,hlimit=255/0,frag=no),icmpv6(type=134/0,code=0/0), actions:1,4,6,7
2024-01-03T17:25:19.759Z|00291|bridge|INFO|bridge guestbridge: deleted interface g2_8361a0_o on port 3
2024-01-03T17:25:20.035Z|00292|bridge|INFO|bridge guestbridge: deleted interface g3_f44757_o on port 4
2024-01-03T17:25:20.292Z|00293|bridge|INFO|bridge guestbridge: deleted interface guestbridge on port 65534
2024-01-03T17:25:20.292Z|00294|bridge|INFO|bridge guestbridge: deleted interface patchguest on port 1
2024-01-03T17:25:20.786Z|00295|bond|INFO|member enp94s0v0: disabled
2024-01-03T17:25:20.786Z|00296|bond|INFO|member enp97s0v0: disabled
2024-01-03T17:25:20.786Z|00297|bond|INFO|bond balance-tcp: all members disabled
2024-01-03T17:25:20.787Z|00298|bridge|INFO|bridge bondbridge: deleted interface enp94s0v0 on port 1
2024-01-03T17:25:20.787Z|00299|bridge|INFO|bridge bondbridge: deleted interface enp97s0v0 on port 2
2024-01-03T17:25:20.926Z|00300|bridge|INFO|bridge bondbridge: deleted interface bondbridge on port 65534
2024-01-03T17:25:20.926Z|00301|bridge|INFO|bridge bondbridge: deleted interface patchbond on port 3
ovs_bonding_balance_tcp_bond_primary_kernel_vf_bond_1to1_OVS_lacpactive_Switch_lacppassive_end

       

              rh-ee-mpattric Mike Pattrick
              nstbot NST Bot
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: