2011-12-05 04:38:10.250 [FINE] - REPL: Replication service activated 2011-12-05 04:38:10.281 [INFO] - REPL: Bind interface: eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]], Replica Id: 30f6405d144d 2011-12-05 04:38:10.312 [INFO] - REPL: Pinging NIC eth5 2011-12-05 04:38:10.842 [INFO] - REPL: NIC monitor Socket[addr=/10.120.180.64,port=60610,localport=60609] on eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]] 2011-12-05 04:38:10.842 [INFO] - REPL: Building replication channel 2011-12-05 04:38:12.075 [INFO] - REPL: Final JGroups protocol stack: 2011-12-05 04:38:12.137 [FINE] - ClassConfigurator: Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs 2011-12-05 04:38:12.246 [INFO] - JChannel: JGroups version: 2.12.2.Final 2011-12-05 04:38:12.371 [FINE] - GMS: changed role to org.jgroups.protocols.pbcast.ClientGmsImpl 2011-12-05 04:38:12.496 [INFO] - REPL: Initial transaction count and last sent incremental update id for 30f6405d144d: 1797, cec90b5e-1c0b-11e1-8d81-bb52670f143a 2011-12-05 04:38:12.527 [FINE] - FRAG2: received CONFIG event: {bind_addr=/10.120.180.64} 2011-12-05 04:38:13.822 [FINE] - FRAG2: received CONFIG event: {flush_supported=true} 2011-12-05 04:38:13.822 [FINE] - UDP: creating sockets 2011-12-05 04:38:13.822 [FINE] - UDP: sockets will use interface 10.120.180.64 2011-12-05 04:38:13.838 [FINE] - UDP: socket information: , mcast_addr=228.8.8.8:45588, bind_addr=/10.120.180.64, ttl=10 sock: bound to 10.120.180.64:7800, receive buffer size=20000000, send buffer size=640000 mcast_sock: bound to 0.0.0.0:45588, send buffer size=640000, receive buffer size=25000000 2011-12-05 04:38:13.853 [FINE] - REPL: Block received 2011-12-05 04:38:13.853 [FINE] - UDP: created unicast receiver thread 2011-12-05 04:38:13.853 [FINE] - UDP: created multicast receiver thread 2011-12-05 04:38:14.898 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|1], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-05 04:38:14.898 [FINE] - GMS: election results: {A-20274=1} 2011-12-05 04:38:14.898 [FINE] - GMS: sending handleJoin(C-27343) to A-20274 2011-12-05 04:38:15.023 [FINE] - NAKACK: [setDigest()] existing digest: [] new digest: B-36404: [4 : 5 (5)], A-20274: [19 : 24 (24)], C-27343: [0 : 0] resulting digest: B-36404: [4 : 5 (5)], A-20274: [19 : 24 (24)], C-27343: [0 : 0 (0)] 2011-12-05 04:38:15.023 [FINE] - GMS: [C-27343]: JoinRsp=[A-20274|2] [A-20274, B-36404, C-27343] [size=3] 2011-12-05 04:38:15.023 [FINE] - GMS: new_view=[A-20274|2] [A-20274, B-36404, C-27343] 2011-12-05 04:38:15.023 [FINE] - GMS: C-27343: view is [A-20274|2] [A-20274, B-36404, C-27343] 2011-12-05 04:38:15.023 [FINE] - FD_SOCK: VIEW_CHANGE received: [A-20274, B-36404, C-27343] 2011-12-05 04:38:15.039 [FINE] - STABLE: [ergonomics] setting max_bytes to 12MB (3 members) 2011-12-05 04:38:15.039 [FINE] - FD_SOCK: ping_dest is A-20274, pingable_mbrs=[A-20274, B-36404, C-27343] 2011-12-05 04:38:15.039 [FINE] - REPL: Accepted view: [A-20274|2] [A-20274, B-36404, C-27343] 2011-12-05 04:38:15.039 [INFO] - REPL: Member joined: A-20274 2011-12-05 04:38:15.039 [INFO] - REPL: Member joined: B-36404 2011-12-05 04:38:15.039 [INFO] - REPL: A-20274[UNSYNCED]: setting state to IN_PROGRESS 2011-12-05 04:38:15.039 [FINE] - REPL: Session snapshot: [A-20274[IN_PROGRESS]] 2011-12-05 04:38:15.039 [INFO] - REPL: B-36404[UNSYNCED]: setting state to IN_PROGRESS 2011-12-05 04:38:15.039 [FINE] - REPL: Session snapshot: [B-36404[IN_PROGRESS], A-20274[IN_PROGRESS]] 2011-12-05 04:38:15.039 [FINE] - FLUSH: C-27343: installing view [A-20274|2] [A-20274, B-36404, C-27343] 2011-12-05 04:38:15.039 [FINE] - GMS: C-27343: 2011-12-05 04:38:15.039 [FINE] - STREAMING_STATE_TRANSFER: GET_STATE: asking A-20274 for state, passing down a SUSPEND_STABLE event, timeout=0 2011-12-05 04:38:15.039 [FINE] - STABLE: suspending message garbage collection 2011-12-05 04:38:15.039 [FINE] - STABLE: resume task started, max_suspend_time=200000 2011-12-05 04:38:15.039 [FINE] - STREAMING_STATE_TRANSFER: Connecting to state provider /10.120.220.64:7810, original buffer size was 8192 and was reset to 16384 2011-12-05 04:38:15.039 [FINE] - STREAMING_STATE_TRANSFER: Connected to state provider, my end of the socket is /10.120.180.64:60613 passing inputstream up... 2011-12-05 04:38:19.142 [INFO] - REPL: B-36404[IN_PROGRESS]: setting state to SYNCED 2011-12-05 04:38:19.142 [FINE] - REPL: Session snapshot: [B-36404[SYNCED], A-20274[IN_PROGRESS]] 2011-12-05 04:38:19.142 [INFO] - REPL: A-20274[IN_PROGRESS]: setting state to SYNCED 2011-12-05 04:38:19.142 [FINE] - REPL: Session snapshot: [B-36404[SYNCED], A-20274[SYNCED]] 2011-12-05 04:38:19.142 [INFO] - REPL: SLAVE: Successfully processed BATCH synchronization(s) in 3 seconds 2011-12-05 04:38:19.142 [FINE] - STREAMING_STATE_TRANSFER: State reader is closing the socket 2011-12-05 04:38:19.142 [FINE] - STREAMING_STATE_TRANSFER: STATE_TRANSFER_INPUTSTREAM_CLOSED received 2011-12-05 04:38:19.142 [FINE] - FLUSH: C-27343: received RESUME, sending STOP_FLUSH to all 2011-12-05 04:38:19.142 [FINE] - STABLE: resuming message garbage collection 2011-12-05 04:38:19.142 [FINE] - FLUSH: C-27343: received STOP_FLUSH, unblocking FLUSH.down() and sending UNBLOCK up 2011-12-05 04:38:19.142 [FINE] - REPL: Unblock received 2011-12-05 04:38:19.142 [INFO] - REPL: Monitoring Socket[addr=/10.120.180.64,port=60610,localport=60609] for connection reset ... Normal operations (nothing to report) ... --- Application terminated at 2011-12-06 04:09:47.059 --- 2011-12-06 04:16:10.445 [FINE] - REPL: Replication service activated 2011-12-06 04:16:10.476 [INFO] - REPL: Bind interface: eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]], Replica Id: 30f6405d144d 2011-12-06 04:16:10.507 [INFO] - REPL: Pinging NIC eth5 2011-12-06 04:16:11.022 [INFO] - REPL: NIC monitor Socket[addr=/10.120.180.64,port=49876,localport=49875] on eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]] 2011-12-06 04:16:11.022 [INFO] - REPL: Building replication channel 2011-12-06 04:16:11.272 [INFO] - REPL: Initial transaction count and last sent incremental update id for 30f6405d144d: 1817, e7442dae-201d-11e1-b815-8fcb4d21bc4b 2011-12-06 04:16:12.223 [INFO] - REPL: Final JGroups protocol stack: 2011-12-06 04:16:12.270 [FINE] - ClassConfigurator: Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs 2011-12-06 04:16:12.348 [INFO] - JChannel: JGroups version: 2.12.2.Final 2011-12-06 04:16:12.473 [FINE] - GMS: changed role to org.jgroups.protocols.pbcast.ClientGmsImpl 2011-12-06 04:16:12.598 [FINE] - FRAG2: received CONFIG event: {bind_addr=/10.120.180.64} 2011-12-06 04:16:13.924 [FINE] - FRAG2: received CONFIG event: {flush_supported=true} 2011-12-06 04:16:13.939 [FINE] - UDP: creating sockets 2011-12-06 04:16:13.939 [FINE] - UDP: sockets will use interface 10.120.180.64 2011-12-06 04:16:13.939 [FINE] - UDP: socket information: , mcast_addr=228.8.8.8:45588, bind_addr=/10.120.180.64, ttl=10 sock: bound to 10.120.180.64:7800, receive buffer size=20000000, send buffer size=640000 mcast_sock: bound to 0.0.0.0:45588, send buffer size=640000, receive buffer size=25000000 2011-12-06 04:16:13.955 [FINE] - REPL: Block received 2011-12-06 04:16:13.955 [FINE] - UDP: created unicast receiver thread 2011-12-06 04:16:13.970 [FINE] - UDP: created multicast receiver thread 2011-12-06 04:16:15.000 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|5], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:16:15.000 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:16:15.000 [FINE] - GMS: sending handleJoin(C-23595) to A-20274 2011-12-06 04:16:20.023 [WARNING] - GMS: join(C-23595) sent to A-20274 timed out (after 5000 ms), retrying 2011-12-06 04:16:20.023 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|5], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:16:20.023 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:16:20.023 [FINE] - GMS: sending handleJoin(C-23595) to A-20274 2011-12-06 04:16:25.031 [WARNING] - GMS: join(C-23595) sent to A-20274 timed out (after 5000 ms), retrying 2011-12-06 04:16:25.031 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|5], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:16:25.031 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:16:25.031 [FINE] - GMS: sending handleJoin(C-23595) to A-20274 2011-12-06 04:16:30.039 [WARNING] - GMS: join(C-23595) sent to A-20274 timed out (after 5000 ms), retrying ... Repeats forever until application killing! ... --- Application Restart! --- 2011-12-06 04:25:03.968 [FINE] - REPL: Replication service activated 2011-12-06 04:25:04.015 [INFO] - REPL: Bind interface: eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]], Replica Id: 30f6405d144d 2011-12-06 04:25:04.031 [INFO] - REPL: Pinging NIC eth5 2011-12-06 04:25:04.577 [INFO] - REPL: NIC monitor Socket[addr=/10.120.180.64,port=49950,localport=49949] on eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]] 2011-12-06 04:25:04.577 [INFO] - REPL: Building replication channel 2011-12-06 04:25:04.826 [INFO] - REPL: Initial transaction count and last sent incremental update id for 30f6405d144d: 1817, e7442dae-201d-11e1-b815-8fcb4d21bc4b 2011-12-06 04:25:05.762 [INFO] - REPL: Final JGroups protocol stack: 2011-12-06 04:25:05.825 [FINE] - ClassConfigurator: Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs 2011-12-06 04:25:05.903 [INFO] - JChannel: JGroups version: 2.12.2.Final 2011-12-06 04:25:05.981 [FINE] - GMS: changed role to org.jgroups.protocols.pbcast.ClientGmsImpl 2011-12-06 04:25:06.074 [FINE] - FRAG2: received CONFIG event: {bind_addr=/10.120.180.64} 2011-12-06 04:25:06.339 [FINE] - FRAG2: received CONFIG event: {flush_supported=true} 2011-12-06 04:25:06.339 [FINE] - UDP: creating sockets 2011-12-06 04:25:06.339 [FINE] - UDP: sockets will use interface 10.120.180.64 2011-12-06 04:25:06.355 [FINE] - UDP: socket information: , mcast_addr=228.8.8.8:45588, bind_addr=/10.120.180.64, ttl=10 sock: bound to 10.120.180.64:7800, receive buffer size=20000000, send buffer size=640000 mcast_sock: bound to 0.0.0.0:45588, send buffer size=640000, receive buffer size=25000000 2011-12-06 04:25:06.355 [FINE] - REPL: Block received 2011-12-06 04:25:06.355 [FINE] - UDP: created unicast receiver thread 2011-12-06 04:25:06.371 [FINE] - UDP: created multicast receiver thread 2011-12-06 04:25:06.402 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|5], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:25:06.402 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:25:06.402 [FINE] - GMS: sending handleJoin(C-53802) to A-20274 2011-12-06 04:25:11.846 [WARNING] - GMS: join(C-53802) sent to A-20274 timed out (after 5000 ms), retrying 2011-12-06 04:25:11.846 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|5], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:25:11.846 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:25:11.846 [FINE] - GMS: sending handleJoin(C-53802) to A-20274 2011-12-06 04:25:16.854 [WARNING] - GMS: join(C-53802) sent to A-20274 timed out (after 5000 ms), retrying 2011-12-06 04:25:16.854 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|5], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:25:16.854 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:25:16.854 [FINE] - GMS: sending handleJoin(C-53802) to A-20274 2011-12-06 04:25:21.862 [WARNING] - GMS: join(C-53802) sent to A-20274 timed out (after 5000 ms), retrying ... Repeats forever until application killing! ... --- Application Restart! --- 2011-12-06 04:35:26.209 [FINE] - REPL: Replication service activated 2011-12-06 04:35:26.256 [INFO] - REPL: Bind interface: eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]], Replica Id: 04fbe06f8b6a 2011-12-06 04:35:26.272 [INFO] - REPL: Pinging NIC eth5 2011-12-06 04:35:26.802 [INFO] - REPL: NIC monitor Socket[addr=/10.120.180.64,port=49997,localport=49996] on eth5[/10.120.180.64/24 [/10.120.180.255], /10.120.180.164/32 [/255.255.255.255]] 2011-12-06 04:35:26.802 [INFO] - REPL: Building replication channel 2011-12-06 04:35:26.958 [INFO] - REPL: Initial transaction count and last sent incremental update id for 04fbe06f8b6a: 0, null 2011-12-06 04:35:27.847 [INFO] - REPL: Final JGroups protocol stack: 2011-12-06 04:35:27.894 [FINE] - ClassConfigurator: Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs 2011-12-06 04:35:27.972 [INFO] - JChannel: JGroups version: 2.12.2.Final 2011-12-06 04:35:28.081 [FINE] - GMS: changed role to org.jgroups.protocols.pbcast.ClientGmsImpl 2011-12-06 04:35:28.206 [FINE] - FRAG2: received CONFIG event: {bind_addr=/10.120.180.64} 2011-12-06 04:35:28.565 [FINE] - FRAG2: received CONFIG event: {flush_supported=true} 2011-12-06 04:35:28.565 [FINE] - UDP: creating sockets 2011-12-06 04:35:28.565 [FINE] - UDP: sockets will use interface 10.120.180.64 2011-12-06 04:35:28.986 [FINE] - UDP: socket information: , mcast_addr=228.8.8.8:45588, bind_addr=/10.120.180.64, ttl=10 sock: bound to 10.120.180.64:7800, receive buffer size=20000000, send buffer size=640000 mcast_sock: bound to 0.0.0.0:45588, send buffer size=640000, receive buffer size=25000000 2011-12-06 04:35:29.002 [FINE] - REPL: Block received 2011-12-06 04:35:29.002 [FINE] - UDP: created unicast receiver thread 2011-12-06 04:35:29.002 [FINE] - UDP: created multicast receiver thread 2011-12-06 04:35:29.033 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|67], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:35:29.033 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:35:29.033 [FINE] - GMS: sending handleJoin(C-18621(04fbe06f8b6a)) to A-20274 2011-12-06 04:35:34.041 [WARNING] - GMS: join(C-18621(04fbe06f8b6a)) sent to A-20274 timed out (after 5000 ms), retrying 2011-12-06 04:35:34.056 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|67], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:35:34.056 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:35:34.056 [FINE] - GMS: sending handleJoin(C-18621(04fbe06f8b6a)) to A-20274 2011-12-06 04:35:39.064 [WARNING] - GMS: join(C-18621(04fbe06f8b6a)) sent to A-20274 timed out (after 5000 ms), retrying 2011-12-06 04:35:39.064 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|67], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800] 2011-12-06 04:35:39.064 [FINE] - GMS: election results: {A-20274=1} 2011-12-06 04:35:39.064 [FINE] - GMS: sending handleJoin(C-18621(04fbe06f8b6a)) to A-20274 2011-12-06 04:35:44.072 [WARNING] - GMS: join(C-18621(04fbe06f8b6a)) sent to A-20274 timed out (after 5000 ms), retrying ... Repeats forever until application killing! ...