On Collector box

- this calls getMembers on the RouterStub, which times out and calls connectionStateChanged(Disconnected) and then throw exception
- connectionStatusChange(..) calls stub.destroy, which sends over the "close" message (which takes time to reach Gossip Router) in meanwhile new connection is opened.
-------------------
2010-03-11 19:13:38,257 TRACE [Timer-2,vivek_cluster,collector_10.0.2.72:4576] TCPGOSSIP - fetching members from GossipRouter(s)

2010-03-11 19:13:41,817 DEBUG [Timer-2,vivek_cluster,collector_10.0.2.72:4576] TCPGOSSIP - connection changed to DISCONNECTED

2010-03-11 19:13:43,817 DEBUG [Timer-2,vivek_cluster,collector_10.0.2.72:4576] TCPGOSSIP - starting reconnector
2010-03-11 19:13:43,817 ERROR [Timer-2,vivek_cluster,collector_10.0.2.72:4576] TCPGOSSIP - failed sending discovery request
java.lang.Exception: Connection to mgr-2-71/10.0.2.71:4575 broken. Could not send GOSSIP_GET request
        at org.jgroups.stack.RouterStub.getMembers(RouterStub.java:224)
        at org.jgroups.protocols.TCPGOSSIP.sendGetMembersRequest(TCPGOSSIP.java:168)
        at org.jgroups.protocols.Discovery$PingSenderTask$1.run(Discovery.java:487)
        at org.jgroups.util.TimeScheduler$RobustRunnable.run(TimeScheduler.java:194)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:129)
        at java.net.SocketInputStream.read(SocketInputStream.java:182)
        at java.io.DataInputStream.readShort(DataInputStream.java:296)
        at org.jgroups.stack.RouterStub.getMembers(RouterStub.java:215)
        ... 12 more
2010-03-11 19:13:43,817 TRACE [Timer-2,vivek_cluster,collector_10.0.2.72:4576] TCPGOSSIP - trying to connect to mgr-2-71/10.0.2.71:4575
2010-03-11 19:13:45,037 DEBUG [Timer-2,vivek_cluster,collector_10.0.2.72:4576] TCPGOSSIP - connection changed to CONNECTED
2010-03-11 19:13:45,037 DEBUG [Timer-2,vivek_cluster,collector_10.0.2.72:4576] TCPGOSSIP - stopping reconnector