Uploaded image for project: 'Fast Datapath Product'
  1. Fast Datapath Product
  2. FDP-1495

[Investigation spike] [Intel][Sierra Forest (e-core)] ovs dpdk connection reassmbly does not work

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • dpdk, openvswitch3.5
    • None
    • 5
    • False
    • Hide

      None

      Show
      None
    • False
    • rhel-9
    • None
    • rhel-net-ovs-dpdk

      Both ipv4/ipv6 have this issue

      Server side

      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: ovs_conn_reassmbly_ipv4_test
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

      :: [ 08:29:11 ] :: [ BEGIN ] :: Running 'test_cleanup'
      :: [ 08:29:11 ] :: [ PASS ] :: Command 'test_cleanup' (Expected 0, got 0)
      :: [ 08:29:11 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_setup'
      :: [ 08:29:41 ] :: [ PASS ] :: Command 'tenant_as_client_forward_setup' (Expected 0, got 0)
      :: [ 08:29:41 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_test'
      SYNC_NC: sync_set client test_begin
      SYNC_NC: sent "test_begin" to wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      PING 10.167.54.2 (10.167.54.2) 56(84) bytes of data.
      64 bytes from 10.167.54.2: icmp_seq=1 ttl=64 time=0.530 ms
      64 bytes from 10.167.54.2: icmp_seq=2 ttl=64 time=0.316 ms
      64 bytes from 10.167.54.2: icmp_seq=3 ttl=64 time=0.189 ms
      64 bytes from 10.167.54.2: icmp_seq=4 ttl=64 time=0.191 ms
      64 bytes from 10.167.54.2: icmp_seq=5 ttl=64 time=0.177 ms
      64 bytes from 10.167.54.2: icmp_seq=6 ttl=64 time=0.204 ms
      64 bytes from 10.167.54.2: icmp_seq=7 ttl=64 time=0.186 ms
      64 bytes from 10.167.54.2: icmp_seq=8 ttl=64 time=0.185 ms
      64 bytes from 10.167.54.2: icmp_seq=9 ttl=64 time=0.158 ms
      64 bytes from 10.167.54.2: icmp_seq=10 ttl=64 time=0.175 ms

      — 10.167.54.2 ping statistics —
      10 packets transmitted, 10 received, 0% packet loss, time 9254ms
      rtt min/avg/max/mdev = 0.158/0.231/0.530/0.107 ms
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: server->client forward to g1 IPv4
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      PING 2001:db8:ffff:54::2(2001:db8:ffff:54::2) 56 data bytes
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=1 ttl=64 time=0.180 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=2 ttl=64 time=0.221 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=3 ttl=64 time=0.181 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=4 ttl=64 time=0.197 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=5 ttl=64 time=0.262 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=6 ttl=64 time=0.160 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=7 ttl=64 time=0.213 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=8 ttl=64 time=0.198 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=9 ttl=64 time=0.347 ms
      64 bytes from 2001:db8:ffff:54::2: icmp_seq=10 ttl=64 time=0.180 ms

      — 2001:db8:ffff:54::2 ping statistics —
      10 packets transmitted, 10 received, 0% packet loss, time 9213ms
      rtt min/avg/max/mdev = 0.160/0.213/0.347/0.051 ms
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: server->client forward to g1 IPv6
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      SYNC_NC: sync_wait client test_end
      SYNC_NC: waiting "wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_end" from wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      :: [ 08:30:19 ] :: [ PASS ] :: Command 'tenant_as_client_forward_test' (Expected 0, got 0)
      :: [ 08:30:20 ] :: [ BEGIN ] :: Running 'ovs_conn_reassmbly_ipv4_test'
      SYNC_NC: sync_set client test_begin
      SYNC_NC: sent "test_begin" to wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      SYNC_NC: sync_wait client test_end
      SYNC_NC: waiting "wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_end" from wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      0a1
      > XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ FAIL ] :: acl allow by nc [tcp] [4096] IPv4
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ 08:30:44 ] :: [ FAIL ] :: Command 'ovs_conn_reassmbly_ipv4_test' (Expected 0, got 1)
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: Duration: 93s
      :: Assertions: 3 good, 1 bad
      :: RESULT: FAIL (ovs_conn_reassmbly_ipv4_test)

        • ovs-conn-reassmbly-ipv4-test FAIL Score:1
          Uploading resultoutputfile.log .done

      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: ovs_conn_reassmbly_ipv6_test
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

      :: [ 08:30:46 ] :: [ BEGIN ] :: Running 'test_cleanup'
      :: [ 08:30:46 ] :: [ PASS ] :: Command 'test_cleanup' (Expected 0, got 0)
      :: [ 08:30:46 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_setup'
      :: [ 08:31:16 ] :: [ PASS ] :: Command 'tenant_as_client_forward_setup' (Expected 0, got 0)
      :: [ 08:31:16 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_test'
      SYNC_NC: sync_set client test_begin
      SYNC_NC: sent "test_begin" to wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      PING 10.167.54.2 (10.167.54.2) 56(84) bytes of data.
      From 10.167.54.1 icmp_seq=1 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=2 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=3 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=4 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=5 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=6 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=7 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=8 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=9 Destination Host Unreachable
      From 10.167.54.1 icmp_seq=10 Destination Host Unreachable

      — 10.167.54.2 ping statistics —
      10 packets transmitted, 0 received, +10 errors, 100% packet loss, time 9253ms
      pipe 3
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ FAIL ] :: server->client forward to g1 IPv4
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      PING 2001:db8:ffff:54::2(2001:db8:ffff:54::2) 56 data bytes
      From 2001:db8:ffff:54::1 icmp_seq=1 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=2 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=3 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=4 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=5 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=6 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=7 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=8 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=9 Destination unreachable: Address unreachable
      From 2001:db8:ffff:54::1 icmp_seq=10 Destination unreachable: Address unreachable

      — 2001:db8:ffff:54::2 ping statistics —
      10 packets transmitted, 0 received, +10 errors, 100% packet loss, time 9214ms

      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ FAIL ] :: server->client forward to g1 IPv6
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      SYNC_NC: sync_wait client test_end
      SYNC_NC: waiting "wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_end" from wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      :: [ 08:32:54 ] :: [ FAIL ] :: Command 'tenant_as_client_forward_test' (Expected 0, got 1)
      :: [ 08:32:55 ] :: [ BEGIN ] :: Running 'ovs_conn_reassmbly_ipv6_test'
      SYNC_NC: sync_set client test_begin
      SYNC_NC: sent "test_begin" to wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      SYNC_NC: sync_wait client test_end
      SYNC_NC: waiting "wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_end" from wsfd-advnetlab127.anl.eng.bos2.dc.redhat.com
      0a1
      > XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ FAIL ] :: acl allow by nc [tcp] [4096] IPv4
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ 08:33:22 ] :: [ FAIL ] :: Command 'ovs_conn_reassmbly_ipv6_test' (Expected 0, got 1)
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: Duration: 156s
      :: Assertions: 2 good, 2 bad
      :: RESULT: FAIL (ovs_conn_reassmbly_ipv6_test)

      Client side

      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: ovs_conn_reassmbly_ipv4_test
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

      :: [ 08:29:10 ] :: [ BEGIN ] :: Running 'test_cleanup'
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=0.010s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=0 actions=NORMAL
      cookie=0x0, duration=0.005s, table=100, n_packets=0, n_bytes=0, idle_age=0, priority=100 actions=drop
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip -4 addr flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 addr flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -4 route flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 route flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      spawn virsh console g2
      Connected to domain 'g2'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip -4 addr flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 addr flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -4 route flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 route flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      spawn virsh console g3
      Connected to domain 'g3'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip -4 addr flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 addr flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -4 route flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 route flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      :: [ 08:29:17 ] :: [ PASS ] :: Command 'test_cleanup' (Expected 0, got 0)
      :: [ 08:29:17 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_setup'
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip addr add 10.167.54.2/24 dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip addr add 2001:db8:ffff:54::2/64 dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip link set $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/

      {gsub(":","",$2); print $2}

      ') up
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      :: [ 08:29:49 ] :: [ PASS ] :: Command 'tenant_as_client_forward_setup' (Expected 0, got 0)
      :: [ 08:29:49 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_test'
      SYNC_NC: sync_wait server test_begin
      SYNC_NC: waiting "intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_begin" from intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping 10.167.54.1 -c 10
      [?2004l
      PING 10.167.54.1 (10.167.54.1) 56(84) bytes of data.
      64 bytes from 10.167.54.1: icmp_seq=1 ttl=64 time=0.202 ms
      64 bytes from 10.167.54.1: icmp_seq=2 ttl=64 time=0.169 ms
      64 bytes from 10.167.54.1: icmp_seq=3 ttl=64 time=0.164 ms
      64 bytes from 10.167.54.1: icmp_seq=4 ttl=64 time=0.166 ms
      64 bytes from 10.167.54.1: icmp_seq=5 ttl=64 time=0.159 ms
      64 bytes from 10.167.54.1: icmp_seq=6 ttl=64 time=0.173 ms
      64 bytes from 10.167.54.1: icmp_seq=7 ttl=64 time=0.167 ms
      64 bytes from 10.167.54.1: icmp_seq=8 ttl=64 time=0.172 ms
      64 bytes from 10.167.54.1: icmp_seq=9 ttl=64 time=0.164 ms
      64 bytes from 10.167.54.1: icmp_seq=10 ttl=64 time=0.152 ms

      — 10.167.54.1 ping statistics —
      10 packets transmitted, 10 received, 0% packet loss, time 9250ms
      rtt min/avg/max/mdev = 0.152/0.168/0.202/0.012 ms
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: client->server forward from g1 IPv4
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping6 2001:db8:ffff:54::1 -c 10
      [?2004l
      PING 2001:db8:ffff:54::1(2001:db8:ffff:54::1) 56 data bytes
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=1 ttl=64 time=0.196 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=2 ttl=64 time=0.174 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=3 ttl=64 time=0.201 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=4 ttl=64 time=0.228 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=5 ttl=64 time=0.180 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=6 ttl=64 time=0.439 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=7 ttl=64 time=0.191 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=8 ttl=64 time=0.168 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=9 ttl=64 time=0.129 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=10 ttl=64 time=0.207 ms

      — 2001:db8:ffff:54::1 ping statistics —
      10 packets transmitted, 10 received, 0% packet loss, time 9211ms
      rtt min/avg/max/mdev = 0.129/0.211/0.439/0.079 ms
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: client->server forward from g1 IPv6
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      SYNC_NC: sync_set server test_end
      SYNC_NC: sent "test_end" to intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      :: [ 08:30:19 ] :: [ PASS ] :: Command 'tenant_as_client_forward_test' (Expected 0, got 0)
      :: [ 08:30:19 ] :: [ BEGIN ] :: Running 'ovs_conn_reassmbly_ipv4_test'
      +++ driverctl list-overrides
      +++ grep vfio-pci
      +++ awk '

      {print $1}'
      ++ all_vfio_pci_list=0000:86:00.0
      ++ for temp_pci in ${all_vfio_pci_list[@]}
      ++ driverctl unset-override 0000:86:00.0
      ++ set +x
      driverctl: setting driver override for 0000:86:00.0: vfio-pci
      driverctl: loading driver vfio-pci
      driverctl: unbinding previous driver i40e
      driverctl: reprobing driver for 0000:86:00.0
      driverctl: saving driver override for 0000:86:00.0
      0000:86:00.0 vfio-pci
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=0.020s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_state=-trk,ip actions=ct(table=1)
      cookie=0x0, duration=0.025s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=10,arp actions=NORMAL
      cookie=0x0, duration=0.030s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=1 actions=drop
      cookie=0x0, duration=0.015s, table=1, n_packets=0, n_bytes=0, idle_age=0, ct_state=+new+trk,ip,in_port=11 actions=ct(commit),output:10
      cookie=0x0, duration=0.009s, table=1, n_packets=0, n_bytes=0, idle_age=0, ct_state=+est+trk,ip,in_port=11 actions=output:10
      cookie=0x0, duration=0.004s, table=1, n_packets=0, n_bytes=0, idle_age=0, ct_state=+est+trk,ip,in_port=10 actions=output:11
      memory before is 113508
      SYNC_NC: sync_wait server test_begin
      SYNC_NC: waiting "intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_begin" from intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ncat 10.167.54.1 2000 < /tmp/4096.pkt
      [?2004l
      Ncat: No route to host.
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      1
      [?2004h[root@localhost ~]#
      SYNC_NC: sync_set server test_end
      SYNC_NC: sent "test_end" to intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      memory after is 113508
      memory leak size is 0
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: There is no memory leak after conntrack reassmbly,pass
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=12.927s, table=0, n_packets=0, n_bytes=0, idle_age=12, priority=100,ct_state=-trk,ip actions=ct(table=1)
      cookie=0x0, duration=12.932s, table=0, n_packets=6, n_bytes=252, idle_age=4, priority=10,arp actions=NORMAL
      cookie=0x0, duration=12.937s, table=0, n_packets=1, n_bytes=90, idle_age=12, priority=1 actions=drop
      cookie=0x0, duration=12.922s, table=1, n_packets=0, n_bytes=0, idle_age=12, ct_state=+new+trk,ip,in_port=11 actions=ct(commit),output:10
      cookie=0x0, duration=12.916s, table=1, n_packets=0, n_bytes=0, idle_age=12, ct_state=+est+trk,ip,in_port=11 actions=output:10
      cookie=0x0, duration=12.911s, table=1, n_packets=0, n_bytes=0, idle_age=12, ct_state=+est+trk,ip,in_port=10 actions=output:11
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=0.005s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=0 actions=NORMAL
      :: [ 08:30:43 ] :: [ PASS ] :: Command 'ovs_conn_reassmbly_ipv4_test' (Expected 0, got 0)
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: Duration: 93s
      :: Assertions: 4 good, 0 bad
      :: RESULT: PASS (ovs_conn_reassmbly_ipv4_test)

      ** ovs-conn-reassmbly-ipv4-test PASS Score:0
      Uploading resultoutputfile.log .done

      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: ovs_conn_reassmbly_ipv6_test
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

      :: [ 08:30:45 ] :: [ BEGIN ] :: Running 'test_cleanup'
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=0.010s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=0 actions=NORMAL
      cookie=0x0, duration=0.004s, table=100, n_packets=0, n_bytes=0, idle_age=0, priority=100 actions=drop
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip -4 addr flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 addr flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -4 route flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 route flush dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      spawn virsh console g2
      Connected to domain 'g2'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip -4 addr flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 addr flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -4 route flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 route flush dev $(ip link show|grep -i 00:00:00:01:04:02 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      spawn virsh console g3
      Connected to domain 'g3'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip -4 addr flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 addr flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -4 route flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip -6 route flush dev $(ip link show|grep -i 00:00:00:01:04:03 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      :: [ 08:30:52 ] :: [ PASS ] :: Command 'test_cleanup' (Expected 0, got 0)
      :: [ 08:30:52 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_setup'
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ip addr add 10.167.54.2/24 dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip addr add 2001:db8:ffff:54::2/64 dev $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}')
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]# ip link set $(ip link show|grep -i 00:00:00:01:04:01 -B 1|awk '/^[0-9]+/ {gsub(":","",$2); print $2}') up
      [?2004l
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      :: [ 08:31:24 ] :: [ PASS ] :: Command 'tenant_as_client_forward_setup' (Expected 0, got 0)
      :: [ 08:31:24 ] :: [ BEGIN ] :: Running 'tenant_as_client_forward_test'
      SYNC_NC: sync_wait server test_begin
      SYNC_NC: waiting "intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_begin" from intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping 10.167.54.1 -c 10
      [?2004l
      PING 10.167.54.1 (10.167.54.1) 56(84) bytes of data.
      From 10.167.54.2 icmp_seq=1 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=2 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=3 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=4 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=5 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=6 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=7 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=8 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=9 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=10 Destination Host Unreachable

      — 10.167.54.1 ping statistics —
      10 packets transmitted, 0 received, +10 errors, 100% packet loss, time 9254ms
      pipe 4
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      1
      [?2004h[root@localhost ~]#
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping 10.167.54.1 -c 10
      [?2004l
      PING 10.167.54.1 (10.167.54.1) 56(84) bytes of data.
      From 10.167.54.2 icmp_seq=1 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=2 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=3 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=4 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=5 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=6 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=7 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=8 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=9 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=10 Destination Host Unreachable

      — 10.167.54.1 ping statistics —
      10 packets transmitted, 0 received, +10 errors, 100% packet loss, time 9215ms
      pipe 4
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      1
      [?2004h[root@localhost ~]#
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping 10.167.54.1 -c 10
      [?2004l
      PING 10.167.54.1 (10.167.54.1) 56(84) bytes of data.
      From 10.167.54.2 icmp_seq=1 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=2 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=3 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=4 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=5 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=6 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=7 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=8 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=9 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=10 Destination Host Unreachable

      — 10.167.54.1 ping statistics —
      10 packets transmitted, 0 received, +10 errors, 100% packet loss, time 9215ms
      pipe 4
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      1
      [?2004h[root@localhost ~]#
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping 10.167.54.1 -c 10
      [?2004l
      PING 10.167.54.1 (10.167.54.1) 56(84) bytes of data.
      From 10.167.54.2 icmp_seq=1 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=2 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=3 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=4 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=5 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=6 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=7 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=8 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=9 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=10 Destination Host Unreachable

      — 10.167.54.1 ping statistics —
      10 packets transmitted, 0 received, +10 errors, 100% packet loss, time 9214ms
      pipe 3
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      1
      [?2004h[root@localhost ~]#
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping 10.167.54.1 -c 10
      [?2004l
      PING 10.167.54.1 (10.167.54.1) 56(84) bytes of data.
      From 10.167.54.2 icmp_seq=1 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=2 Destination Host Unreachable
      From 10.167.54.2 icmp_seq=3 Destination Host Unreachable
      64 bytes from 10.167.54.1: icmp_seq=4 ttl=64 time=1024 ms
      64 bytes from 10.167.54.1: icmp_seq=6 ttl=64 time=0.205 ms
      64 bytes from 10.167.54.1: icmp_seq=7 ttl=64 time=0.165 ms
      64 bytes from 10.167.54.1: icmp_seq=8 ttl=64 time=0.209 ms
      64 bytes from 10.167.54.1: icmp_seq=9 ttl=64 time=0.168 ms
      64 bytes from 10.167.54.1: icmp_seq=10 ttl=64 time=0.242 ms

      — 10.167.54.1 ping statistics —
      10 packets transmitted, 6 received, +3 errors, 40% packet loss, time 9215ms
      rtt min/avg/max/mdev = 0.165/170.888/1024.340/381.675 ms, pipe 4
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: client->server forward from g1 IPv4
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ping6 2001:db8:ffff:54::1 -c 10
      [?2004l
      PING 2001:db8:ffff:54::1(2001:db8:ffff:54::1) 56 data bytes
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=1 ttl=64 time=0.476 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=2 ttl=64 time=0.130 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=3 ttl=64 time=0.149 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=4 ttl=64 time=0.131 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=5 ttl=64 time=0.134 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=6 ttl=64 time=0.173 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=7 ttl=64 time=0.187 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=8 ttl=64 time=0.122 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=9 ttl=64 time=0.309 ms
      64 bytes from 2001:db8:ffff:54::1: icmp_seq=10 ttl=64 time=0.134 ms

      — 2001:db8:ffff:54::1 ping statistics —
      10 packets transmitted, 10 received, 0% packet loss, time 9211ms
      rtt min/avg/max/mdev = 0.122/0.194/0.476/0.107 ms
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      0
      [?2004h[root@localhost ~]#
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: client->server forward from g1 IPv6
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      SYNC_NC: sync_set server test_end
      SYNC_NC: sent "test_end" to intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      :: [ 08:32:54 ] :: [ PASS ] :: Command 'tenant_as_client_forward_test' (Expected 0, got 0)
      :: [ 08:32:54 ] :: [ BEGIN ] :: Running 'ovs_conn_reassmbly_ipv6_test'
      +++ driverctl list-overrides
      +++ grep vfio-pci
      +++ awk '{print $1}

      '
      ++ all_vfio_pci_list=0000:86:00.0
      ++ for temp_pci in ${all_vfio_pci_list[@]}
      ++ driverctl unset-override 0000:86:00.0
      ++ set +x
      driverctl: setting driver override for 0000:86:00.0: vfio-pci
      driverctl: loading driver vfio-pci
      driverctl: unbinding previous driver i40e
      driverctl: reprobing driver for 0000:86:00.0
      driverctl: saving driver override for 0000:86:00.0
      0000:86:00.0 vfio-pci
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=0.036s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=200,icmp6,icmp_type=135 actions=NORMAL
      cookie=0x0, duration=0.030s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=200,icmp6,icmp_type=136 actions=NORMAL
      cookie=0x0, duration=0.025s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_state=-trk,ipv6 actions=ct(table=1)
      cookie=0x0, duration=0.005s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=1 actions=drop
      cookie=0x0, duration=0.020s, table=1, n_packets=0, n_bytes=0, idle_age=0, ct_state=+new+trk,ipv6,in_port=11 actions=ct(commit),output:10
      cookie=0x0, duration=0.015s, table=1, n_packets=0, n_bytes=0, idle_age=0, ct_state=+est+trk,ipv6,in_port=11 actions=output:10
      cookie=0x0, duration=0.010s, table=1, n_packets=0, n_bytes=0, idle_age=0, ct_state=+est+trk,ipv6,in_port=10 actions=output:11
      memory before is 113452
      SYNC_NC: sync_wait server test_begin
      SYNC_NC: waiting "intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com"
      SYNC_NC: got "test_begin" from intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      spawn virsh console g1
      Connected to domain 'g1'
      Escape character is ^] (Ctrl + ])

      [?2004l
      [?2004h[root@localhost ~]# ncat 2001:db8:ffff:54::1 2000 < /tmp/4096.pkt
      [?2004l
      Ncat: No route to host.
      [?2004h[root@localhost ~]# echo $?
      [?2004l
      1
      [?2004h[root@localhost ~]#
      SYNC_NC: sync_set server test_end
      SYNC_NC: sent "test_end" to intel-birchstream-srf-sp-05.khw.eng.bos2.dc.redhat.com
      memory after is 113452
      memory leak size is 0
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: [ PASS ] :: There is no memory leak after conntrack reassmbly,pass
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=15.905s, table=0, n_packets=6, n_bytes=516, idle_age=7, priority=200,icmp6,icmp_type=135 actions=NORMAL
      cookie=0x0, duration=15.899s, table=0, n_packets=0, n_bytes=0, idle_age=15, priority=200,icmp6,icmp_type=136 actions=NORMAL
      cookie=0x0, duration=15.894s, table=0, n_packets=1, n_bytes=90, idle_age=15, priority=100,ct_state=-trk,ipv6 actions=ct(table=1)
      cookie=0x0, duration=15.874s, table=0, n_packets=0, n_bytes=0, idle_age=15, priority=1 actions=drop
      cookie=0x0, duration=15.889s, table=1, n_packets=0, n_bytes=0, idle_age=15, ct_state=+new+trk,ipv6,in_port=11 actions=ct(commit),output:10
      cookie=0x0, duration=15.884s, table=1, n_packets=0, n_bytes=0, idle_age=15, ct_state=+est+trk,ipv6,in_port=11 actions=output:10
      cookie=0x0, duration=15.879s, table=1, n_packets=0, n_bytes=0, idle_age=15, ct_state=+est+trk,ipv6,in_port=10 actions=output:11
      NXST_FLOW reply (xid=0x4):
      cookie=0x0, duration=0.005s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=0 actions=NORMAL
      :: [ 08:33:21 ] :: [ PASS ] :: Command 'ovs_conn_reassmbly_ipv6_test' (Expected 0, got 0)
      ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
      :: Duration: 156s
      :: Assertions: 4 good, 0 bad
      :: RESULT: PASS (ovs_conn_reassmbly_ipv6_test)

      Here is the job link
      https://beaker.engineering.redhat.com/jobs/11271054

      ovs : openvswitch3.5-3.5.0-19.el9fdp
      kernel : kernel-5.14.0-570.19.1.el9_6
      dpdk : dpdk-24.11.1-2.el9

              ovsdpdk-triage ovsdpdk triage
              rhn-support-hewang Hekai Wang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: