2011-12-05 04:35:10.319 [FINE] - REPL: Replication service activated
2011-12-05 04:35:10.345 [INFO] - REPL: Bind interface: eth4[/10.120.120.64/24 [/10.120.120.255], /10.120.120.164/32 [/255.255.255.255]], Replica Id: c9c069c9b73b
2011-12-05 04:35:10.360 [INFO] - REPL: Pinging NIC eth4
2011-12-05 04:35:10.958 [INFO] - REPL: NIC monitor Socket[addr=/10.120.120.64,port=53625,localport=53623] on eth4[/10.120.120.64/24 [/10.120.120.255], /10.120.120.164/32 [/255.255.255.255]]
2011-12-05 04:35:10.958 [INFO] - REPL: Building replication channel
2011-12-05 04:35:12.373 [INFO] - REPL: Final JGroups protocol stack: 
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="urn:org:jgroups">
  <UDP bind_addr="10.120.120.64" bind_interface="eth4" bind_port="7800" diagnostics_addr="224.0.75.75" discard_incompatible_packets="true" enable_bundling="true" enable_diagnostics="true" ip_ttl="10" loopback="true" max_bundle_size="64K" max_bundle_timeout="30" mcast_group_addr="228.8.8.8" mcast_port="45588" mcast_recv_buf_size="25M" mcast_send_buf_size="640K" oob_thread_pool.enabled="true" oob_thread_pool.keep_alive_time="5000" oob_thread_pool.max_threads="8" oob_thread_pool.min_threads="1" oob_thread_pool.queue_enabled="false" oob_thread_pool.queue_max_size="100" oob_thread_pool.rejection_policy="Run" singleton_name="UDP" thread_naming_pattern="pl" thread_pool.enabled="true" thread_pool.keep_alive_time="5000" thread_pool.max_threads="8" thread_pool.min_threads="2" thread_pool.queue_enabled="false" thread_pool.queue_max_size="100" thread_pool.rejection_policy="Run" tos="8" ucast_recv_buf_size="20M" ucast_send_buf_size="640K"/>
  <PING num_initial_members="3" timeout="2000"/>
  <MERGE2 max_interval="30000" min_interval="10000"/>
  <FD_SOCK bind_addr="10.120.120.64" bind_interface="eth4"/>
  <FD_ALL/>
  <VERIFY_SUSPECT bind_addr="10.120.120.64" bind_interface="eth4" timeout="1500"/>
  <pbcast.NAKACK discard_delivered_msgs="false" exponential_backoff="150" gc_lag="0" retransmit_timeout="300,600,1200" use_mcast_xmit="true" use_stats_for_retransmission="false"/>
  <UNICAST timeout="300,600,1200"/>
  <pbcast.STABLE desired_avg_gossip="50000" max_bytes="4M" stability_delay="1000"/>
  <pbcast.GMS join_timeout="5000" print_local_addr="true" view_bundling="true"/>
  <UFC max_credits="2M" min_threshold="0.4"/>
  <MFC max_credits="2M" min_threshold="0.4"/>
  <FRAG2 frag_size="60K"/>
  <pbcast.STREAMING_STATE_TRANSFER bind_addr="10.120.120.64" bind_interface="eth4" bind_port="7810" socket_buffer_size="16384" use_default_transport="false"/>
  <pbcast.FLUSH timeout="120000"/>
</config>
2011-12-05 04:35:12.441 [FINE] - ClassConfigurator: Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs
2011-12-05 04:35:12.582 [INFO] - JChannel: JGroups version: 2.12.2.Final
2011-12-05 04:35:13.112 [FINE] - GMS: changed role to org.jgroups.protocols.pbcast.ClientGmsImpl
2011-12-05 04:35:13.190 [INFO] - REPL: Initial transaction count and last sent incremental update id for c9c069c9b73b: 3525, e85a395a-1f55-11e1-bdab-a6edb2b268f1
2011-12-05 04:35:13.206 [FINE] - FRAG2: received CONFIG event: {bind_addr=/10.120.120.64}
2011-12-05 04:35:15.109 [FINE] - FRAG2: received CONFIG event: {flush_supported=true}
2011-12-05 04:35:15.109 [FINE] - UDP: creating sockets
2011-12-05 04:35:15.109 [FINE] - UDP: sockets will use interface 10.120.120.64
2011-12-05 04:35:15.124 [FINE] - UDP: socket information:
, mcast_addr=228.8.8.8:45588, bind_addr=/10.120.120.64, ttl=10
sock: bound to 10.120.120.64:7800, receive buffer size=20000000, send buffer size=640000
mcast_sock: bound to 0.0.0.0:45588, send buffer size=640000, receive buffer size=25000000
2011-12-05 04:35:15.140 [FINE] - REPL: Block received
2011-12-05 04:35:15.140 [FINE] - UDP: created unicast receiver thread 
2011-12-05 04:35:15.140 [FINE] - UDP: created multicast receiver thread 
2011-12-05 04:35:16.170 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|0], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800]
2011-12-05 04:35:16.170 [FINE] - GMS: election results: {A-20274=1}
2011-12-05 04:35:16.170 [FINE] - GMS: sending handleJoin(B-36404) to A-20274
2011-12-05 04:35:16.248 [FINE] - NAKACK: 
[setDigest()]
existing digest:  []
new digest:       B-36404: [0 : 0], A-20274: [13 : 18 (18)]
resulting digest: B-36404: [0 : 0 (0)], A-20274: [13 : 18 (18)]
2011-12-05 04:35:16.248 [FINE] - GMS: [B-36404]: JoinRsp=[A-20274|1] [A-20274, B-36404] [size=2]


2011-12-05 04:35:16.263 [FINE] - GMS: new_view=[A-20274|1] [A-20274, B-36404]
2011-12-05 04:35:16.263 [FINE] - GMS: B-36404: view is [A-20274|1] [A-20274, B-36404]
2011-12-05 04:35:16.263 [FINE] - FD_SOCK: VIEW_CHANGE received: [A-20274, B-36404]
2011-12-05 04:35:16.263 [FINE] - STABLE: [ergonomics] setting max_bytes to 8MB (2 members)
2011-12-05 04:35:16.263 [FINE] - FD_SOCK: ping_dest is A-20274, pingable_mbrs=[A-20274, B-36404]
2011-12-05 04:35:16.263 [FINE] - REPL: Accepted view: [A-20274|1] [A-20274, B-36404]
2011-12-05 04:35:16.263 [INFO] - REPL: Member joined: A-20274
2011-12-05 04:35:16.263 [INFO] - REPL: A-20274[UNSYNCED]: setting state to IN_PROGRESS
2011-12-05 04:35:16.263 [FINE] - REPL: Session snapshot: [A-20274[IN_PROGRESS]]
2011-12-05 04:35:16.263 [FINE] - FLUSH: B-36404: installing view [A-20274|1] [A-20274, B-36404]
2011-12-05 04:35:16.263 [FINE] - GMS: B-36404: 
2011-12-05 04:35:16.263 [FINE] - STREAMING_STATE_TRANSFER: GET_STATE: asking A-20274 for state, passing down a SUSPEND_STABLE event, timeout=0
2011-12-05 04:35:16.263 [FINE] - STABLE: suspending message garbage collection
2011-12-05 04:35:16.263 [FINE] - STABLE: resume task started, max_suspend_time=200000
2011-12-05 04:35:16.263 [FINE] - STREAMING_STATE_TRANSFER: Connecting to state provider /10.120.220.64:7810, original buffer size was 8192 and was reset to 16384
2011-12-05 04:35:16.279 [FINE] - STREAMING_STATE_TRANSFER: Connected to state provider, my end of the socket is /10.120.120.64:53647 passing inputstream up...
2011-12-05 04:35:21.442 [INFO] - REPL: A-20274[IN_PROGRESS]: setting state to SYNCED
2011-12-05 04:35:21.442 [FINE] - REPL: Session snapshot: [A-20274[SYNCED]]
2011-12-05 04:35:21.442 [INFO] - REPL: SLAVE: Successfully processed BATCH synchronization(s) in 4 seconds
2011-12-05 04:35:21.442 [FINE] - STREAMING_STATE_TRANSFER: State reader is closing the socket 
2011-12-05 04:35:21.442 [FINE] - STREAMING_STATE_TRANSFER: STATE_TRANSFER_INPUTSTREAM_CLOSED received
2011-12-05 04:35:21.442 [FINE] - FLUSH: B-36404: received RESUME, sending STOP_FLUSH to all
2011-12-05 04:35:21.442 [FINE] - STABLE: resuming message garbage collection
2011-12-05 04:35:21.442 [FINE] - FLUSH: B-36404: received STOP_FLUSH, unblocking FLUSH.down() and sending UNBLOCK up
2011-12-05 04:35:21.442 [FINE] - REPL: Unblock received
2011-12-05 04:35:21.442 [INFO] - REPL: Monitoring Socket[addr=/10.120.120.64,port=53625,localport=53623] for connection reset
2011-12-05 04:38:14.992 [FINE] - REPL: Block received
2011-12-05 04:38:15.008 [FINE] - FLUSH: B-36404: received START_FLUSH, responded with FLUSH_COMPLETED to A-20274
2011-12-05 04:38:15.024 [FINE] - NAKACK: 
[setDigest()]
existing digest:  B-36404: [4 : 5 (5)], A-20274: [19 : 24 (24)]
new digest:       B-36404: [4 : 5 (5)], A-20274: [19 : 23 (23)], C-27343: [0 : 0]
resulting digest: B-36404: [4 : 5 (5)], A-20274: [19 : 24 (24)], C-27343: [0 : 0 (0)]
2011-12-05 04:38:15.024 [FINE] - GMS: B-36404: view is [A-20274|2] [A-20274, B-36404, C-27343]
2011-12-05 04:38:15.024 [FINE] - FD_SOCK: VIEW_CHANGE received: [A-20274, B-36404, C-27343]
2011-12-05 04:38:15.039 [FINE] - FD_SOCK: socket to A-20274 was closed gracefully
2011-12-05 04:38:15.039 [FINE] - FD_SOCK: ping_dest is C-27343, pingable_mbrs=[A-20274, B-36404, C-27343]
2011-12-05 04:38:15.039 [FINE] - STABLE: [ergonomics] setting max_bytes to 12MB (3 members)
2011-12-05 04:38:15.039 [FINE] - REPL: Accepted view: [A-20274|2] [A-20274, B-36404, C-27343]
2011-12-05 04:38:15.039 [INFO] - REPL: Member joined: C-27343
2011-12-05 04:38:15.039 [INFO] - REPL: C-27343[UNSYNCED]: setting state to IN_PROGRESS
2011-12-05 04:38:15.039 [FINE] - REPL: Session snapshot: [A-20274[SYNCED], C-27343[IN_PROGRESS]]
2011-12-05 04:38:15.039 [FINE] - FLUSH: B-36404: installing view [A-20274|2] [A-20274, B-36404, C-27343]
2011-12-05 04:38:19.204 [FINE] - FLUSH: B-36404: received STOP_FLUSH, unblocking FLUSH.down() and sending UNBLOCK up
2011-12-05 04:38:19.204 [FINE] - REPL: Unblock received
2011-12-05 04:38:19.360 [FINE] - REPL: Incoming message: src=C-27343, dest=ALL, size=5
2011-12-05 04:38:19.360 [INFO] - REPL: Received BatchSynchronization[numEnts=0] from MASTER@C-27343
2011-12-05 04:38:19.360 [INFO] - REPL: C-27343[IN_PROGRESS]: setting state to SYNCED
2011-12-05 04:38:19.360 [FINE] - REPL: Session snapshot: [A-20274[SYNCED], C-27343[SYNCED]]


... Normal operations (nothing to report) ...


2011-12-06 03:59:47.261 [INFO] - REPL: SLAVE: Successfully processed INCREMENTAL synchronization in 43 milliseconds
2011-12-06 04:02:47.192 [FINE] - REPL: Incoming message: src=A-20274, dest=ALL, size=514
2011-12-06 04:02:47.223 [INFO] - REPL: Received Synchronization@1296[numEnts=33] from MASTER@A-20274
2011-12-06 04:02:47.239 [INFO] - REPL: SLAVE: Incoming synchronization
  Processing transaction 86fde84b-201d-11e1-b090-71caa3cf2752 containing 25 entities

2011-12-06 04:02:47.270 [INFO] - REPL: SLAVE: Successfully processed INCREMENTAL synchronization in 43 milliseconds
2011-12-06 04:08:46.991 [FINE] - REPL: Incoming message: src=A-20274, dest=ALL, size=516
2011-12-06 04:08:47.038 [INFO] - REPL: Received Synchronization@1297[numEnts=33] from MASTER@A-20274
2011-12-06 04:08:47.038 [INFO] - REPL: SLAVE: Incoming synchronization
  Processing transaction ab5719ed-201d-11e1-b090-71caa3cf2752 containing 25 entities

2011-12-06 04:08:47.662 [INFO] - REPL: SLAVE: Successfully processed INCREMENTAL synchronization in 637 milliseconds
2011-12-06 04:10:14.476 [FINE] - FD_SOCK: peer C-27343 closed socket (java.net.SocketException)
2011-12-06 04:10:14.476 [FINE] - FD_SOCK: suspecting C-27343 (own address is B-36404)
2011-12-06 04:10:14.476 [FINE] - FD_SOCK: ping_dest is A-20274, pingable_mbrs=[A-20274, B-36404]
2011-12-06 04:10:18.033 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:10:22.666 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:10:24.413 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 12682 ms, adding it to suspect list
2011-12-06 04:10:27.206 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:10:27.424 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 15693 ms, adding it to suspect list
2011-12-06 04:10:30.435 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 18704 ms, adding it to suspect list
2011-12-06 04:10:32.416 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:10:33.446 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 21715 ms, adding it to suspect list
2011-12-06 04:10:36.457 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 24726 ms, adding it to suspect list
2011-12-06 04:10:39.467 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 27736 ms, adding it to suspect list
2011-12-06 04:10:42.478 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 30747 ms, adding it to suspect list
2011-12-06 04:10:45.489 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 33758 ms, adding it to suspect list
2011-12-06 04:10:48.500 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 36769 ms, adding it to suspect list
2011-12-06 04:10:51.511 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 39780 ms, adding it to suspect list
2011-12-06 04:10:51.604 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:10:54.521 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 42790 ms, adding it to suspect list
2011-12-06 04:10:54.646 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:10:57.532 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 45801 ms, adding it to suspect list
2011-12-06 04:11:00.543 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 48812 ms, adding it to suspect list
2011-12-06 04:11:01.557 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:11:03.554 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 51823 ms, adding it to suspect list
2011-12-06 04:11:05.426 [FINE] - FLUSH: B-36404: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:11:06.565 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 54834 ms, adding it to suspect list
2011-12-06 04:11:09.575 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 57844 ms, adding it to suspect list
2011-12-06 04:11:12.586 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 60855 ms, adding it to suspect list
2011-12-06 04:11:15.597 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 63866 ms, adding it to suspect list
2011-12-06 04:11:18.608 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 66877 ms, adding it to suspect list
2011-12-06 04:11:21.619 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 69888 ms, adding it to suspect list
2011-12-06 04:11:24.629 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 72898 ms, adding it to suspect list
2011-12-06 04:11:27.640 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 75909 ms, adding it to suspect list
2011-12-06 04:11:30.651 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 78920 ms, adding it to suspect list
2011-12-06 04:11:33.662 [FINE] - FD_ALL: haven't received a heartbeat from C-27343 for 81931 ms, adding it to suspect list


--- Application Restart! ---


2011-12-06 04:14:30.090 [FINE] - REPL: Replication service activated
2011-12-06 04:14:30.105 [INFO] - REPL: Bind interface: eth4[/10.120.120.64/24 [/10.120.120.255], /10.120.120.164/32 [/255.255.255.255]], Replica Id: c9c069c9b73b
2011-12-06 04:14:30.121 [INFO] - REPL: Pinging NIC eth4
2011-12-06 04:14:30.729 [INFO] - REPL: NIC monitor Socket[addr=/10.120.120.64,port=56616,localport=56610] on eth4[/10.120.120.64/24 [/10.120.120.255], /10.120.120.164/32 [/255.255.255.255]]
2011-12-06 04:14:30.729 [INFO] - REPL: Building replication channel
2011-12-06 04:14:31.478 [INFO] - REPL: Initial transaction count and last sent incremental update id for c9c069c9b73b: 3715, f5604ddc-2013-11e1-a71f-5b28b8258e58
2011-12-06 04:14:32.320 [INFO] - REPL: Final JGroups protocol stack: 
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="urn:org:jgroups">
  <UDP bind_addr="10.120.120.64" bind_interface="eth4" bind_port="7800" diagnostics_addr="224.0.75.75" discard_incompatible_packets="true" enable_bundling="true" enable_diagnostics="true" ip_ttl="10" loopback="true" max_bundle_size="64K" max_bundle_timeout="30" mcast_group_addr="228.8.8.8" mcast_port="45588" mcast_recv_buf_size="25M" mcast_send_buf_size="640K" oob_thread_pool.enabled="true" oob_thread_pool.keep_alive_time="5000" oob_thread_pool.max_threads="8" oob_thread_pool.min_threads="1" oob_thread_pool.queue_enabled="false" oob_thread_pool.queue_max_size="100" oob_thread_pool.rejection_policy="Run" singleton_name="UDP" thread_naming_pattern="pl" thread_pool.enabled="true" thread_pool.keep_alive_time="5000" thread_pool.max_threads="8" thread_pool.min_threads="2" thread_pool.queue_enabled="false" thread_pool.queue_max_size="100" thread_pool.rejection_policy="Run" tos="8" ucast_recv_buf_size="20M" ucast_send_buf_size="640K"/>
  <PING num_initial_members="3" timeout="2000"/>
  <MERGE2 max_interval="30000" min_interval="10000"/>
  <FD_SOCK bind_addr="10.120.120.64" bind_interface="eth4"/>
  <FD_ALL/>
  <VERIFY_SUSPECT bind_addr="10.120.120.64" bind_interface="eth4" timeout="1500"/>
  <pbcast.NAKACK discard_delivered_msgs="false" exponential_backoff="150" gc_lag="0" retransmit_timeout="300,600,1200" use_mcast_xmit="true" use_stats_for_retransmission="false"/>
  <UNICAST timeout="300,600,1200"/>
  <pbcast.STABLE desired_avg_gossip="50000" max_bytes="4M" stability_delay="1000"/>
  <pbcast.GMS join_timeout="5000" print_local_addr="true" view_bundling="true"/>
  <UFC max_credits="2M" min_threshold="0.4"/>
  <MFC max_credits="2M" min_threshold="0.4"/>
  <FRAG2 frag_size="60K"/>
  <pbcast.STREAMING_STATE_TRANSFER bind_addr="10.120.120.64" bind_interface="eth4" bind_port="7810" socket_buffer_size="16384" use_default_transport="false"/>
  <pbcast.FLUSH timeout="120000"/>
</config>
2011-12-06 04:14:32.367 [FINE] - ClassConfigurator: Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs
2011-12-06 04:14:32.476 [INFO] - JChannel: JGroups version: 2.12.2.Final
2011-12-06 04:14:32.586 [FINE] - GMS: changed role to org.jgroups.protocols.pbcast.ClientGmsImpl
2011-12-06 04:14:33.147 [FINE] - FRAG2: received CONFIG event: {bind_addr=/10.120.120.64}
2011-12-06 04:14:33.834 [FINE] - FRAG2: received CONFIG event: {flush_supported=true}
2011-12-06 04:14:33.834 [FINE] - UDP: creating sockets
2011-12-06 04:14:33.834 [FINE] - UDP: sockets will use interface 10.120.120.64
2011-12-06 04:14:33.834 [FINE] - UDP: socket information:
, mcast_addr=228.8.8.8:45588, bind_addr=/10.120.120.64, ttl=10
sock: bound to 10.120.120.64:7800, receive buffer size=20000000, send buffer size=640000
mcast_sock: bound to 0.0.0.0:45588, send buffer size=640000, receive buffer size=25000000
2011-12-06 04:14:33.896 [FINE] - REPL: Block received
2011-12-06 04:14:33.912 [FINE] - UDP: created unicast receiver thread 
2011-12-06 04:14:33.912 [FINE] - UDP: created multicast receiver thread 
2011-12-06 04:14:33.927 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|4], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800]
2011-12-06 04:14:33.927 [FINE] - GMS: election results: {A-20274=1}
2011-12-06 04:14:33.927 [FINE] - GMS: sending handleJoin(B-35601) to A-20274
2011-12-06 04:14:34.005 [FINE] - NAKACK: 
[setDigest()]
existing digest:  []
new digest:       B-35601: [0 : 0], A-20274: [2090 : 2095 (2095)]
resulting digest: B-35601: [0 : 0 (0)], A-20274: [2090 : 2095 (2095)]
2011-12-06 04:14:34.005 [FINE] - GMS: [B-35601]: JoinRsp=[A-20274|5] [A-20274, B-35601] [size=2]


2011-12-06 04:14:34.005 [FINE] - GMS: new_view=[A-20274|5] [A-20274, B-35601]
2011-12-06 04:14:34.005 [FINE] - GMS: B-35601: view is [A-20274|5] [A-20274, B-35601]
2011-12-06 04:14:34.005 [FINE] - FD_SOCK: VIEW_CHANGE received: [A-20274, B-35601]
2011-12-06 04:14:34.005 [FINE] - STABLE: [ergonomics] setting max_bytes to 8MB (2 members)
2011-12-06 04:14:34.005 [FINE] - FD_SOCK: ping_dest is A-20274, pingable_mbrs=[A-20274, B-35601]
2011-12-06 04:14:34.005 [FINE] - REPL: Accepted view: [A-20274|5] [A-20274, B-35601]
2011-12-06 04:14:34.005 [INFO] - REPL: Member joined: A-20274
2011-12-06 04:14:34.005 [INFO] - REPL: A-20274[UNSYNCED]: setting state to IN_PROGRESS
2011-12-06 04:14:34.005 [FINE] - REPL: Session snapshot: [A-20274[IN_PROGRESS]]
2011-12-06 04:14:34.005 [FINE] - FLUSH: B-35601: installing view [A-20274|5] [A-20274, B-35601]
2011-12-06 04:14:34.021 [FINE] - GMS: B-35601: 
2011-12-06 04:14:34.021 [FINE] - STREAMING_STATE_TRANSFER: GET_STATE: asking A-20274 for state, passing down a SUSPEND_STABLE event, timeout=0
2011-12-06 04:14:34.021 [FINE] - STABLE: suspending message garbage collection
2011-12-06 04:14:34.021 [FINE] - STABLE: resume task started, max_suspend_time=200000
2011-12-06 04:14:34.021 [FINE] - STREAMING_STATE_TRANSFER: Connecting to state provider /10.120.220.64:7810, original buffer size was 8192 and was reset to 16384
2011-12-06 04:14:34.021 [FINE] - STREAMING_STATE_TRANSFER: Connected to state provider, my end of the socket is /10.120.120.64:56633 passing inputstream up...
2011-12-06 04:14:42.960 [INFO] - REPL: A-20274[IN_PROGRESS]: setting state to SYNCED
2011-12-06 04:14:42.960 [FINE] - REPL: Session snapshot: [A-20274[SYNCED]]
2011-12-06 04:14:42.960 [INFO] - REPL: SLAVE: Successfully processed BATCH synchronization(s) in 8 seconds
2011-12-06 04:14:42.960 [FINE] - STREAMING_STATE_TRANSFER: State reader is closing the socket 
2011-12-06 04:14:42.960 [FINE] - STREAMING_STATE_TRANSFER: STATE_TRANSFER_INPUTSTREAM_CLOSED received
2011-12-06 04:14:42.960 [FINE] - FLUSH: B-35601: received RESUME, sending STOP_FLUSH to all
2011-12-06 04:14:42.960 [FINE] - STABLE: resuming message garbage collection
2011-12-06 04:14:42.960 [FINE] - FLUSH: B-35601: received STOP_FLUSH, unblocking FLUSH.down() and sending UNBLOCK up
2011-12-06 04:14:42.960 [INFO] - REPL: Monitoring Socket[addr=/10.120.120.64,port=56616,localport=56610] for connection reset
2011-12-06 04:14:42.960 [FINE] - REPL: Unblock received
2011-12-06 04:16:17.074 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:21.177 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:27.729 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:33.829 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:39.523 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:43.860 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:47.229 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:50.505 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:16:56.059 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true


... Repeats forever until application killing! ...


2011-12-06 04:27:47.655 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:27:51.649 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:27:54.847 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:27:59.262 [FINE] - FLUSH: B-35601: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true


--- Application Restart! ---


2011-12-06 04:34:11.274 [FINE] - REPL: Replication service activated
2011-12-06 04:34:11.297 [INFO] - REPL: Bind interface: eth4[/10.120.120.64/24 [/10.120.120.255], /10.120.120.164/32 [/255.255.255.255]], Replica Id: c9c069c9b73b
2011-12-06 04:34:11.305 [INFO] - REPL: Pinging NIC eth4
2011-12-06 04:34:11.848 [INFO] - REPL: NIC monitor Socket[addr=/10.120.120.64,port=57394,localport=57392] on eth4[/10.120.120.64/24 [/10.120.120.255], /10.120.120.164/32 [/255.255.255.255]]
2011-12-06 04:34:11.848 [INFO] - REPL: Building replication channel
2011-12-06 04:34:11.907 [INFO] - REPL: Initial transaction count and last sent incremental update id for c9c069c9b73b: 3715, f5604ddc-2013-11e1-a71f-5b28b8258e58
2011-12-06 04:34:12.909 [INFO] - REPL: Final JGroups protocol stack: 
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="urn:org:jgroups">
  <UDP bind_addr="10.120.120.64" bind_interface="eth4" bind_port="7800" diagnostics_addr="224.0.75.75" discard_incompatible_packets="true" enable_bundling="true" enable_diagnostics="true" ip_ttl="10" loopback="true" max_bundle_size="64K" max_bundle_timeout="30" mcast_group_addr="228.8.8.8" mcast_port="45588" mcast_recv_buf_size="25M" mcast_send_buf_size="640K" oob_thread_pool.enabled="true" oob_thread_pool.keep_alive_time="5000" oob_thread_pool.max_threads="8" oob_thread_pool.min_threads="1" oob_thread_pool.queue_enabled="false" oob_thread_pool.queue_max_size="100" oob_thread_pool.rejection_policy="Run" singleton_name="UDP" thread_naming_pattern="pl" thread_pool.enabled="true" thread_pool.keep_alive_time="5000" thread_pool.max_threads="8" thread_pool.min_threads="2" thread_pool.queue_enabled="false" thread_pool.queue_max_size="100" thread_pool.rejection_policy="Run" tos="8" ucast_recv_buf_size="20M" ucast_send_buf_size="640K"/>
  <PING num_initial_members="3" timeout="2000"/>
  <MERGE2 max_interval="30000" min_interval="10000"/>
  <FD_SOCK bind_addr="10.120.120.64" bind_interface="eth4"/>
  <FD_ALL/>
  <VERIFY_SUSPECT bind_addr="10.120.120.64" bind_interface="eth4" timeout="1500"/>
  <pbcast.NAKACK discard_delivered_msgs="false" exponential_backoff="150" gc_lag="0" retransmit_timeout="300,600,1200" use_mcast_xmit="true" use_stats_for_retransmission="false"/>
  <UNICAST timeout="300,600,1200"/>
  <pbcast.STABLE desired_avg_gossip="50000" max_bytes="4M" stability_delay="1000"/>
  <pbcast.GMS join_timeout="5000" print_local_addr="true" view_bundling="true"/>
  <UFC max_credits="2M" min_threshold="0.4"/>
  <MFC max_credits="2M" min_threshold="0.4"/>
  <FRAG2 frag_size="60K"/>
  <pbcast.STREAMING_STATE_TRANSFER bind_addr="10.120.120.64" bind_interface="eth4" bind_port="7810" socket_buffer_size="16384" use_default_transport="false"/>
  <pbcast.FLUSH timeout="120000"/>
</config>
2011-12-06 04:34:12.970 [FINE] - ClassConfigurator: Using jg-magic-map.xml as magic number file and jg-protocol-ids.xml for protocol IDs
2011-12-06 04:34:13.068 [INFO] - JChannel: JGroups version: 2.12.2.Final
2011-12-06 04:34:13.165 [FINE] - GMS: changed role to org.jgroups.protocols.pbcast.ClientGmsImpl
2011-12-06 04:34:13.320 [FINE] - FRAG2: received CONFIG event: {bind_addr=/10.120.120.64}
2011-12-06 04:34:14.211 [FINE] - FRAG2: received CONFIG event: {flush_supported=true}
2011-12-06 04:34:14.211 [FINE] - UDP: creating sockets
2011-12-06 04:34:14.211 [FINE] - UDP: sockets will use interface 10.120.120.64
2011-12-06 04:34:14.227 [FINE] - UDP: socket information:
, mcast_addr=228.8.8.8:45588, bind_addr=/10.120.120.64, ttl=10
sock: bound to 10.120.120.64:7800, receive buffer size=20000000, send buffer size=640000
mcast_sock: bound to 0.0.0.0:45588, send buffer size=640000, receive buffer size=25000000
2011-12-06 04:34:14.227 [FINE] - REPL: Block received
2011-12-06 04:34:14.227 [FINE] - UDP: created unicast receiver thread 
2011-12-06 04:34:14.242 [FINE] - UDP: created multicast receiver thread 
2011-12-06 04:34:14.274 [FINE] - GMS: initial_mbrs are [own_addr=A-20274, view_id=[A-20274|66], is_server=true, is_coord=true, logical_name=A-20274, physical_addrs=10.120.220.64:7800]
2011-12-06 04:34:14.274 [FINE] - GMS: election results: {A-20274=1}
2011-12-06 04:34:14.274 [FINE] - GMS: sending handleJoin(B-13600) to A-20274
2011-12-06 04:34:14.336 [FINE] - NAKACK: 
[setDigest()]
existing digest:  []
new digest:       B-13600: [0 : 0], A-20274: [2097 : 2258 (2258)]
resulting digest: B-13600: [0 : 0 (0)], A-20274: [2097 : 2258 (2258)]
2011-12-06 04:34:14.336 [FINE] - GMS: [B-13600]: JoinRsp=[A-20274|67] [A-20274, B-13600] [size=2]


2011-12-06 04:34:14.352 [FINE] - GMS: new_view=[A-20274|67] [A-20274, B-13600]
2011-12-06 04:34:14.352 [FINE] - GMS: B-13600: view is [A-20274|67] [A-20274, B-13600]
2011-12-06 04:34:14.352 [FINE] - FD_SOCK: VIEW_CHANGE received: [A-20274, B-13600]
2011-12-06 04:34:14.352 [FINE] - STABLE: [ergonomics] setting max_bytes to 8MB (2 members)
2011-12-06 04:34:14.352 [FINE] - FD_SOCK: ping_dest is A-20274, pingable_mbrs=[A-20274, B-13600]
2011-12-06 04:34:14.352 [FINE] - REPL: Accepted view: [A-20274|67] [A-20274, B-13600]
2011-12-06 04:34:14.352 [INFO] - REPL: Member joined: A-20274
2011-12-06 04:34:14.352 [INFO] - REPL: A-20274[UNSYNCED]: setting state to IN_PROGRESS
2011-12-06 04:34:14.352 [FINE] - REPL: Session snapshot: [A-20274[IN_PROGRESS]]
2011-12-06 04:34:14.352 [FINE] - FLUSH: B-13600: installing view [A-20274|67] [A-20274, B-13600]
2011-12-06 04:34:14.352 [FINE] - GMS: B-13600: 
2011-12-06 04:34:14.352 [FINE] - STREAMING_STATE_TRANSFER: GET_STATE: asking A-20274 for state, passing down a SUSPEND_STABLE event, timeout=0
2011-12-06 04:34:14.352 [FINE] - STABLE: suspending message garbage collection
2011-12-06 04:34:14.352 [FINE] - STABLE: resume task started, max_suspend_time=200000
2011-12-06 04:34:14.367 [FINE] - STREAMING_STATE_TRANSFER: Connecting to state provider /10.120.220.64:7810, original buffer size was 8192 and was reset to 16384
2011-12-06 04:34:14.367 [FINE] - STREAMING_STATE_TRANSFER: Connected to state provider, my end of the socket is /10.120.120.64:57403 passing inputstream up...
2011-12-06 04:34:15.849 [INFO] - REPL: A-20274[IN_PROGRESS]: setting state to SYNCED
2011-12-06 04:34:15.849 [FINE] - REPL: Session snapshot: [A-20274[SYNCED]]
2011-12-06 04:34:15.849 [INFO] - REPL: SLAVE: Successfully processed BATCH synchronization(s) in 1 seconds
2011-12-06 04:34:15.849 [FINE] - STREAMING_STATE_TRANSFER: State reader is closing the socket 
2011-12-06 04:34:15.849 [FINE] - STREAMING_STATE_TRANSFER: STATE_TRANSFER_INPUTSTREAM_CLOSED received
2011-12-06 04:34:15.849 [FINE] - FLUSH: B-13600: received RESUME, sending STOP_FLUSH to all
2011-12-06 04:34:15.849 [FINE] - STABLE: resuming message garbage collection
2011-12-06 04:34:15.849 [FINE] - FLUSH: B-13600: received STOP_FLUSH, unblocking FLUSH.down() and sending UNBLOCK up
2011-12-06 04:34:15.849 [FINE] - REPL: Unblock received
2011-12-06 04:34:15.849 [INFO] - REPL: Monitoring Socket[addr=/10.120.120.64,port=57394,localport=57392] for connection reset
2011-12-06 04:35:31.104 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:35:37.468 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:35:43.849 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:35:48.732 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:35:52.413 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:35:56.953 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:36:02.272 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:36:08.310 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:36:13.473 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true


... Repeats forever until application killing! ...


2011-12-06 04:42:58.090 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:43:02.630 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:43:06.124 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:43:10.633 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true
2011-12-06 04:43:17.512 [FINE] - FLUSH: B-13600: received ABORT_FLUSH from flush coordinator A-20274,  am I flush participant=true