[DEBUG] 2019-07-01 18:15:35.724 [main] Configurator - set property UDP.mcast_group_addr to default value /228.8.8.8 [DEBUG] 2019-07-01 18:15:35.726 [main] Configurator - set property UDP.bind_addr to default value /192.168.109.72 [DEBUG] 2019-07-01 18:15:35.727 [main] Configurator - set property UDP.diagnostics_addr to default value /224.0.75.75 [DEBUG] 2019-07-01 18:15:35.840 [main] UDP - thread pool min/max/keep-alive: 0/20/30000 use_fork_join=false, internal pool: 0/8/30000 (8 cores available) [TRACE] 2019-07-01 18:15:35.915 [main] NAKACK2 - null: set max_xmit_req_size from 0 to 511600 [TRACE] 2019-07-01 18:15:35.915 [main] UNICAST3 - null: set max_xmit_req_size from 0 to 511600 [DEBUG] 2019-07-01 18:15:36.129 [main] UDP - sockets will use interface 192.168.109.72 [DEBUG] 2019-07-01 18:15:36.427 [main] UDP - socket information: mcast_addr=228.8.8.8:45588, bind_addr=/192.168.109.72, ttl=4 sock: bound to 192.168.109.72:63961, receive buffer size=5000000, send buffer size=5000000 mcast_sock: bound to 192.168.109.72:45588, send buffer size=5000000, receive buffer size=5000000 [TRACE] 2019-07-01 18:15:36.499 [main] UDP - joined /224.0.75.75:7500 on lo [TRACE] 2019-07-01 18:15:36.505 [main] UDP - joined /224.0.75.75:7500 on eth3 [TRACE] 2019-07-01 18:15:36.531 [main] STABLE - IM9072-20539: stable task started ------------------------------------------------------------------- GMS: address=IM9072-20539, cluster=test, physical address=192.168.109.72:63961 ------------------------------------------------------------------- [TRACE] 2019-07-01 18:15:36.536 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.542 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [3004301b-85ea-7d6a-b6d3-d2551ffad483 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.543 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from 3004301b-85ea-7d6a-b6d3-d2551ffad483: 3004301b-85ea-7d6a-b6d3-d2551ffad483, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:36.544 [main] GMS - IM9072-20539: discovery took 9 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:36.544 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:36.545 [main] UNICAST3 - IM9072-20539: created sender window for IM9072-5099 (conn-id=0) [TRACE] 2019-07-01 18:15:36.546 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#1, conn_id=0, first) [TRACE] 2019-07-01 18:15:36.546 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=1, first, TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.553 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_SOCK: I_HAVE_SOCK, mbr=IM9072-5099, sock_addr=192.168.109.72:63680, TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.554 [jgroups-10,test,IM9072-20539] FD_SOCK - IM9072-20539: i-have-sock: IM9072-5099 --> 192.168.109.72:63680 (cache is IM9072-5099: 192.168.109.72:63680 (0 ms old) IM9072-20539: 192.168.109.72:63702 (19 ms old) ) [TRACE] 2019-07-01 18:15:36.554 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are FD_SOCK: WHO_HAS_SOCK, mbr=IM9072-20539, TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.554 [jgroups-11,test,IM9072-20539] FD_SOCK - IM9072-20539: who-has-sock IM9072-20539 [TRACE] 2019-07-01 18:15:36.554 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 108 bytes, flags=OOB], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=2, rsp_expected=true, FORK: fork:fork, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.554 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are FD_SOCK: I_HAVE_SOCK, mbr=IM9072-20539, sock_addr=192.168.109.72:63702, TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.554 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: DATA(#1, conn_id=1, first) [TRACE] 2019-07-01 18:15:36.555 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539: created receiver window for IM9072-5099 at seqno=#1 for conn-id=1 [TRACE] 2019-07-01 18:15:36.555 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539: delivering IM9072-5099#1 [WARN ] 2019-07-01 18:15:36.555 [jgroups-10,test,IM9072-20539] FORK - IM9072-20539: fork-channel for id=fork not found; discarding message [TRACE] 2019-07-01 18:15:36.560 [FD_SOCK acceptor-9,test,IM9072-20539] FD_SOCK - IM9072-20539: accepted connection from /192.168.109.72:63703 [TRACE] 2019-07-01 18:15:36.979 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=1, ts=1, TP: [cluster=test] [TRACE] 2019-07-01 18:15:36.979 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#1, conn-id=0, ts=1) [TRACE] 2019-07-01 18:15:37.032 [Timer runner-2,test,IM9072-20539] UNICAST3 - IM9072-20539 --> IM9072-5099: ACK(#1) [TRACE] 2019-07-01 18:15:37.032 [Timer runner-2,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are UNICAST3: ACK, seqno=1, conn_id=1, ts=1, TP: [cluster=test] [WARN ] 2019-07-01 18:15:38.547 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 0 [TRACE] 2019-07-01 18:15:38.548 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:38.553 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:38.554 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:38.555 [main] GMS - IM9072-20539: discovery took 8 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:38.556 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:38.556 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#2, conn_id=0) [TRACE] 2019-07-01 18:15:38.556 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=2, TP: [cluster=test] [TRACE] 2019-07-01 18:15:38.983 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=2, ts=2, TP: [cluster=test] [TRACE] 2019-07-01 18:15:38.984 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#2, conn-id=0, ts=2) [WARN ] 2019-07-01 18:15:40.558 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 1 [TRACE] 2019-07-01 18:15:40.559 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:40.565 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:40.565 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:40.566 [main] GMS - IM9072-20539: discovery took 8 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:40.567 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:40.567 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#3, conn_id=0) [TRACE] 2019-07-01 18:15:40.568 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=3, TP: [cluster=test] [TRACE] 2019-07-01 18:15:40.987 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=3, ts=3, TP: [cluster=test] [TRACE] 2019-07-01 18:15:40.988 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#3, conn-id=0, ts=3) [WARN ] 2019-07-01 18:15:42.569 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 2 [TRACE] 2019-07-01 18:15:42.569 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:42.571 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:42.571 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:42.571 [main] GMS - IM9072-20539: discovery took 2 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:42.571 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:42.571 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#4, conn_id=0) [TRACE] 2019-07-01 18:15:42.572 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=4, TP: [cluster=test] [TRACE] 2019-07-01 18:15:42.990 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=4, ts=4, TP: [cluster=test] [TRACE] 2019-07-01 18:15:42.991 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#4, conn-id=0, ts=4) [TRACE] 2019-07-01 18:15:44.556 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster=test] [TRACE] 2019-07-01 18:15:44.556 [jgroups-10,test,IM9072-20539] FD_ALL - Received heartbeat from IM9072-5099 [WARN ] 2019-07-01 18:15:44.573 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 3 [TRACE] 2019-07-01 18:15:44.574 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:44.578 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:44.578 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:44.579 [main] GMS - IM9072-20539: discovery took 6 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:44.580 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:44.580 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#5, conn_id=0) [TRACE] 2019-07-01 18:15:44.581 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=5, TP: [cluster=test] [TRACE] 2019-07-01 18:15:44.996 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, ts=5, TP: [cluster=test] [TRACE] 2019-07-01 18:15:44.997 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#5, conn-id=0, ts=5) [WARN ] 2019-07-01 18:15:46.582 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 4 [TRACE] 2019-07-01 18:15:46.582 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:46.583 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:46.584 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:46.584 [main] GMS - IM9072-20539: discovery took 2 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:46.584 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:46.584 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#6, conn_id=0) [TRACE] 2019-07-01 18:15:46.584 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=6, TP: [cluster=test] [TRACE] 2019-07-01 18:15:47.000 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=6, ts=6, TP: [cluster=test] [TRACE] 2019-07-01 18:15:47.000 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#6, conn-id=0, ts=6) [WARN ] 2019-07-01 18:15:48.585 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 5 [TRACE] 2019-07-01 18:15:48.585 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:48.586 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:48.586 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:48.587 [main] GMS - IM9072-20539: discovery took 1 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:48.587 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:48.587 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#7, conn_id=0) [TRACE] 2019-07-01 18:15:48.587 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=7, TP: [cluster=test] [TRACE] 2019-07-01 18:15:49.005 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=7, ts=7, TP: [cluster=test] [TRACE] 2019-07-01 18:15:49.005 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#7, conn-id=0, ts=7) [WARN ] 2019-07-01 18:15:50.588 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 6 [TRACE] 2019-07-01 18:15:50.589 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:50.594 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:50.595 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:50.596 [main] GMS - IM9072-20539: discovery took 7 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:50.596 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:50.597 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#8, conn_id=0) [TRACE] 2019-07-01 18:15:50.597 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=8, TP: [cluster=test] [TRACE] 2019-07-01 18:15:51.009 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=8, ts=8, TP: [cluster=test] [TRACE] 2019-07-01 18:15:51.010 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#8, conn-id=0, ts=8) [TRACE] 2019-07-01 18:15:52.558 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster=test] [TRACE] 2019-07-01 18:15:52.559 [jgroups-10,test,IM9072-20539] FD_ALL - Received heartbeat from IM9072-5099 [WARN ] 2019-07-01 18:15:52.598 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 7 [TRACE] 2019-07-01 18:15:52.598 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:52.600 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:52.601 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:52.601 [main] GMS - IM9072-20539: discovery took 3 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:52.601 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:52.601 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#9, conn_id=0) [TRACE] 2019-07-01 18:15:52.602 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=9, TP: [cluster=test] [TRACE] 2019-07-01 18:15:53.014 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=9, ts=9, TP: [cluster=test] [TRACE] 2019-07-01 18:15:53.014 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#9, conn-id=0, ts=9) [WARN ] 2019-07-01 18:15:54.603 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 8 [TRACE] 2019-07-01 18:15:54.604 [main] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are PING: [GET_MBRS_REQ cluster=test initial_discovery=true], TP: [cluster=test] [TRACE] 2019-07-01 18:15:54.608 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 43 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are PING: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=test] [TRACE] 2019-07-01 18:15:54.609 [jgroups-10,test,IM9072-20539] PING - IM9072-20539: received GET_MBRS_RSP from IM9072-5099: IM9072-5099, name=IM9072-5099, addr=192.168.109.72:63960, coord [TRACE] 2019-07-01 18:15:54.609 [main] GMS - IM9072-20539: discovery took 6 ms, members: 1 rsps (1 coords) [done] [DEBUG] 2019-07-01 18:15:54.610 [main] GMS - IM9072-20539: sending JOIN(IM9072-20539) to IM9072-5099 [TRACE] 2019-07-01 18:15:54.610 [main] UNICAST3 - IM9072-20539 --> IM9072-5099: DATA(#10, conn_id=0) [TRACE] 2019-07-01 18:15:54.610 [main] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are GMS: GmsHeader[JOIN_REQ]: mbr=IM9072-20539, UNICAST3: DATA, seqno=10, TP: [cluster=test] [TRACE] 2019-07-01 18:15:55.019 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, ts=10, TP: [cluster=test] [TRACE] 2019-07-01 18:15:55.019 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: ACK(#10, conn-id=0, ts=10) [WARN ] 2019-07-01 18:15:56.612 [main] GMS - IM9072-20539: JOIN(IM9072-20539) sent to IM9072-5099 timed out (after 2000 ms), on try 9 [WARN ] 2019-07-01 18:15:56.612 [main] GMS - IM9072-20539: too many JOIN attempts (10): becoming singleton [DEBUG] 2019-07-01 18:15:56.615 [main] NAKACK2 - [IM9072-20539 setDigest()] existing digest: [] new digest: IM9072-20539: [0 (0)] resulting digest: IM9072-20539: [0 (0)] [DEBUG] 2019-07-01 18:15:56.615 [main] GMS - IM9072-20539: installing view [IM9072-20539|0] (1) [IM9072-20539] [DEBUG] 2019-07-01 18:15:56.621 [main] STABLE - resuming message garbage collection [TRACE] 2019-07-01 18:15:56.623 [main] UNICAST3 - IM9072-20539: closing connections of non members [IM9072-5099] [TRACE] 2019-07-01 18:15:56.635 [main] UFC - new membership: [IM9072-20539] [TRACE] 2019-07-01 18:15:56.638 [main] MFC - new membership: [IM9072-20539] [DEBUG] 2019-07-01 18:15:56.645 [main] STABLE - resuming message garbage collection [DEBUG] 2019-07-01 18:15:56.645 [main] GMS - IM9072-20539: created cluster (first member). My view is [IM9072-20539|0], impl is org.jgroups.protocols.pbcast.CoordGmsImpl [TRACE] 2019-07-01 18:15:56.646 [main] MessageDispatcher - setting local_addr (null) to IM9072-20539 [INFO ] 2019-07-01 18:15:56.648 [main] JChannelRunner - viewAccepted:start [TRACE] 2019-07-01 18:15:56.654 [main] RequestCorrelator - IM9072-20539: invoking multicast RPC [req-id=1] [TRACE] 2019-07-01 18:15:56.655 [main] UNICAST3 - IM9072-20539: created sender window for IM9072-20539 (conn-id=1) [TRACE] 2019-07-01 18:15:56.655 [main] UNICAST3 - IM9072-20539 --> IM9072-20539: DATA(#1, conn_id=1, first) [TRACE] 2019-07-01 18:15:56.655 [main] UDP - IM9072-20539: sending msg to IM9072-20539, src=IM9072-20539, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1, rsp_expected=true, FORK: fork:fork, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster=test] [TRACE] 2019-07-01 18:15:56.655 [main] UDP - IM9072-20539: looping back message [IM9072-20539 to IM9072-20539, 108 bytes, flags=OOB], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1, rsp_expected=true, FORK: fork:fork, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster=test] [TRACE] 2019-07-01 18:15:56.657 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-20539 to IM9072-20539, 108 bytes, flags=OOB], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1, rsp_expected=true, FORK: fork:fork, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster=test] [TRACE] 2019-07-01 18:15:56.657 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-20539: DATA(#1, conn_id=1, first) [TRACE] 2019-07-01 18:15:56.658 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539: delivering IM9072-20539#1 [TRACE] 2019-07-01 18:15:56.658 [jgroups-10,test,IM9072-20539] RequestCorrelator - calling (org.jgroups.blocks.RpcDispatcher) with request 1 [TRACE] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] MessageDispatcher - [sender=IM9072-20539], method_call: boeee() [INFO ] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] JChannelRunner - boe-1 [TRACE] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] RequestCorrelator - sending rsp for 1 to IM9072-20539 [TRACE] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 --> IM9072-20539: DATA(#2, conn_id=1) [TRACE] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-20539, src=IM9072-20539, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1, rsp_expected=true, FORK: fork:fork, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster=test] [TRACE] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: looping back message [IM9072-20539 to IM9072-20539, 1 bytes, flags=OOB], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1, rsp_expected=true, FORK: fork:fork, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster=test] [TRACE] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] UFC - IM9072-20539 used 108 credits, 1999892 remaining [TRACE] 2019-07-01 18:15:56.661 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539: delivering #2 - #2 (1 messages) [TRACE] 2019-07-01 18:15:56.661 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-20539 to IM9072-20539, 1 bytes, flags=OOB, transient_flags=OOB_DELIVERED], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1, rsp_expected=true, FORK: fork:fork, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster=test] [TRACE] 2019-07-01 18:15:56.662 [jgroups-11,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-20539: DATA(#2, conn_id=1) [TRACE] 2019-07-01 18:15:56.664 [jgroups-10,test,IM9072-20539] UFC - IM9072-20539 used 1 credits, 1999891 remaining [TRACE] 2019-07-01 18:15:56.665 [main] MessageDispatcher - dests=null, method_call=boeee(), options=mode=GET_ALL, timeout=0, anycasting=true, flags=OOB, responses: [IM9072-20539: received=true, suspected=false] [INFO ] 2019-07-01 18:15:56.665 [main] JChannelRunner - viewAccepted:end [TRACE] 2019-07-01 18:16:00.561 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster=test] [TRACE] 2019-07-01 18:16:00.562 [jgroups-10,test,IM9072-20539] FD_ALL - Received heartbeat from IM9072-5099 [TRACE] 2019-07-01 18:16:08.563 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster=test] [TRACE] 2019-07-01 18:16:08.563 [jgroups-10,test,IM9072-20539] FD_ALL - Received heartbeat from IM9072-5099 [TRACE] 2019-07-01 18:16:11.610 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are MERGE3: INFO: view_id=[IM9072-5099|1], logical_name=IM9072-5099, physical_addr=192.168.109.72:63960, TP: [cluster=test] [TRACE] 2019-07-01 18:16:14.065 [Timer runner-2,test,IM9072-20539] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are MERGE3: INFO: view_id=[IM9072-20539|0], logical_name=IM9072-20539, physical_addr=192.168.109.72:63961, TP: [cluster=test] [TRACE] 2019-07-01 18:16:16.565 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster=test] [TRACE] 2019-07-01 18:16:16.566 [jgroups-10,test,IM9072-20539] FD_ALL - Received heartbeat from IM9072-5099 [TRACE] 2019-07-01 18:16:16.577 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are VERIFY_SUSPECT: [VERIFY_SUSPECT: ARE_YOU_DEAD], TP: [cluster=test] [TRACE] 2019-07-01 18:16:16.578 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are VERIFY_SUSPECT: [VERIFY_SUSPECT: I_AM_NOT_DEAD], TP: [cluster=test] [TRACE] 2019-07-01 18:16:16.581 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_SOCK: UNSUSPECT, mbrs=[IM9072-20539], TP: [cluster=test] [TRACE] 2019-07-01 18:16:16.581 [jgroups-10,test,IM9072-20539] FD_SOCK - IM9072-20539: received UNSUSPECT message from IM9072-5099: mbrs=[IM9072-20539] [TRACE] 2019-07-01 18:16:16.582 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_SOCK: UNSUSPECT, mbrs=[IM9072-20539], TP: [cluster=test] [TRACE] 2019-07-01 18:16:16.582 [jgroups-11,test,IM9072-20539] FD_SOCK - IM9072-20539: received UNSUSPECT message from IM9072-5099: mbrs=[IM9072-20539] [TRACE] 2019-07-01 18:16:24.536 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 61 bytes, flags=INTERNAL], headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster=test] [TRACE] 2019-07-01 18:16:24.536 [jgroups-11,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: DATA(#2, conn_id=1) [TRACE] 2019-07-01 18:16:24.537 [jgroups-11,test,IM9072-20539] UNICAST3 - IM9072-20539: delivering #2 - #2 (1 messages) [TRACE] 2019-07-01 18:16:24.541 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received message batch of 1 messages from IM9072-5099 [WARN ] 2019-07-01 18:16:24.544 [jgroups-11,test,IM9072-20539] NAKACK2 - JGRP000011: IM9072-20539: dropped message batch from non-member IM9072-5099 (view=[IM9072-20539|0] (1) [IM9072-20539]) [TRACE] 2019-07-01 18:16:24.567 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=INTERNAL], headers are MERGE3: VIEW_REQ: , logical_name=null, physical_addr=null, TP: [cluster=test] [TRACE] 2019-07-01 18:16:24.568 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster=test] [TRACE] 2019-07-01 18:16:24.568 [jgroups-10,test,IM9072-20539] FD_ALL - Received heartbeat from IM9072-5099 [TRACE] 2019-07-01 18:16:24.568 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are MERGE3: VIEW_RSP: , logical_name=null, physical_addr=null, TP: [cluster=test] [TRACE] 2019-07-01 18:16:24.619 [Timer runner-2,test,IM9072-20539] UNICAST3 - IM9072-20539 --> IM9072-5099: ACK(#2) [TRACE] 2019-07-01 18:16:24.619 [Timer runner-2,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are UNICAST3: ACK, seqno=2, conn_id=1, ts=2, TP: [cluster=test] [TRACE] 2019-07-01 18:16:25.072 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to , 0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=1], TP: [cluster=test] [TRACE] 2019-07-01 18:16:26.539 [jgroups-11,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 63 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster=test] [TRACE] 2019-07-01 18:16:26.540 [jgroups-11,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: DATA(#3, conn_id=1) [TRACE] 2019-07-01 18:16:26.540 [jgroups-11,test,IM9072-20539] UNICAST3 - IM9072-20539: delivering IM9072-5099#3 [TRACE] 2019-07-01 18:16:26.541 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: received [IM9072-5099 to IM9072-20539, 0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=IM9072-5099, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster=test] [TRACE] 2019-07-01 18:16:26.541 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539 <-- IM9072-5099: DATA(#4, conn_id=1) [TRACE] 2019-07-01 18:16:26.542 [jgroups-10,test,IM9072-20539] UNICAST3 - IM9072-20539: delivering IM9072-5099#4 [TRACE] 2019-07-01 18:16:26.543 [jgroups-10,test,IM9072-20539] GMS - IM9072-20539: handleMembershipChange([LEAVE(IM9072-5099)]) [TRACE] 2019-07-01 18:16:26.543 [jgroups-10,test,IM9072-20539] GMS - IM9072-20539: found no members to add or remove, will not create new view [TRACE] 2019-07-01 18:16:26.623 [Timer runner-2,test,IM9072-20539] UNICAST3 - IM9072-20539 --> IM9072-5099: ACK(#4) [TRACE] 2019-07-01 18:16:26.623 [Timer runner-2,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are UNICAST3: ACK, seqno=4, conn_id=1, ts=3, TP: [cluster=test] [DEBUG] 2019-07-01 18:16:36.547 [Timer runner-2,test,IM9072-20539] UNICAST3 - IM9072-20539: removing expired connection to IM9072-5099 [TRACE] 2019-07-01 18:16:37.904 [Timer runner-2,test,IM9072-20539] UDP - IM9072-20539: sending msg to null, src=IM9072-20539, headers are MERGE3: INFO: view_id=[IM9072-20539|0], logical_name=IM9072-20539, physical_addr=192.168.109.72:63961, TP: [cluster=test] [TRACE] 2019-07-01 18:16:44.646 [jgroups-10,test,IM9072-20539] MERGE3 - IM9072-20539: merge participants are [IM9072-20539, IM9072-5099] [TRACE] 2019-07-01 18:16:44.647 [jgroups-10,test,IM9072-20539] UDP - IM9072-20539: sending msg to IM9072-5099, src=IM9072-20539, headers are MERGE3: VIEW_REQ: , logical_name=null, physical_addr=null, TP: [cluster=test] [INFO ] 2019-07-01 18:16:56.665 [main] JChannelRunner - close channel [TRACE] 2019-07-01 18:16:56.670 [main] GMS - IM9072-20539: no next-in-line coord found to send LEAVE req to; terminating [DEBUG] 2019-07-01 18:16:57.178 [main] UDP - IM9072-20539: closing sockets and stopping threads [DEBUG] 2019-07-01 18:16:57.179 [main] UDP - IM9072-20539: multicast socket closed [DEBUG] 2019-07-01 18:16:57.179 [mcast-receiver-8,test,IM9072-20539] UDP - IM9072-20539: receiver socket is closed, exception=socket closed [DEBUG] 2019-07-01 18:16:57.180 [ucast-receiver-7,test,IM9072-20539] UDP - IM9072-20539: receiver socket is closed, exception=socket closed [DEBUG] 2019-07-01 18:16:57.180 [mcast-receiver-8,test,IM9072-20539] UDP - mcast-receiver thread terminated [DEBUG] 2019-07-01 18:16:57.180 [ucast-receiver-7,test,IM9072-20539] UDP - ucast-receiver thread terminated