05:06:51,413 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-6-thread-1) ISPN000094: Received new cluster view: [node01/default(s1)|0] [node01/default(s1)]

05:09:08,422 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (undefined) ISPN000094: Received new cluster view: [node01/default(s1)|1] [node01/default(s1), node02/default(s1)]
05:09:10,042 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-6-thread-1) ISPN000094: Received new cluster view: [node01/default(s1)|1] [node01/default(s1), node02/default(s1)]

05:09:51,953 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (undefined) ISPN000094: Received new cluster view: [node01/default(s1)|2] [node01/default(s1), node02/default(s1), node03/default(s1)]
05:09:51,969 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (undefined) ISPN000094: Received new cluster view: [node01/default(s1)|2] [node01/default(s1), node02/default(s1), node03/default(s1)]
05:09:53,419 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (pool-6-thread-1) ISPN000094: Received new cluster view: [node01/default(s1)|2] [node01/default(s1), node02/default(s1), node03/default(s1)]

*** node03 removes node01 and node02 from its view, but the others keep seeing node03 as part of their view ***
05:10:04,538 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (undefined) ISPN000094: Received new cluster view: [node03/default(s1)|3] [node03/default(s1)]
05:10:04,218 WARNING [org.jgroups.protocols.pbcast.GMS] (undefined) node01/default(s1): not member of view [node03/defau
lt(s1)|3]; discarding it
05:10:04,219 WARNING [org.jgroups.protocols.pbcast.GMS] (undefined) node02/default(s1): not member of view [node03/default(s1)|3]; discarding it

*** node03 keeps rejecting messages from the other members; however, it must be still sending heartbeats out to everyone, because they're not suspecting it ***
05:10:09,066 WARNING [org.jgroups.protocols.pbcast.NAKACK] (undefined) node03/default(s1): dropped message 1528 from node01/default(s1) (sender not in table [node03/default(s1)]), view=[node03/default(s1)|3] [node03/default(s1)]
05:10:09,066 WARNING [org.jgroups.protocols.pbcast.NAKACK] (undefined) node03/default(s1): dropped message 1559 from node01/default(s1) (sender not in table [node03/default(s1)]), view=[node03/default(s1)|3] [node03/default(s1)]

*** the join command fails on node03 with a SuspectedException ***
05:10:04,091 ERROR [org.jboss.msc.service.fail] (pool-7-thread-1) MSC000001: Failed to start service jboss.infinispan.default.memcachedCache: org.jboss.msc.service.StartException in service jboss.infinispan.default.memcachedCache: org.infinispan.CacheException: Unable to invoke method private void org.infinispan.statetransfer.BaseStateTransferManagerImpl.start() throws java.lang.Exception on object 
Caused by: org.infinispan.CacheException: SuspectedException
        at org.infinispan.util.Util.rewrapAsCacheException(Util.java:524) [infinispan-core-5.1.3.ER4-redhat-1.jar:5.1.3.ER4-redhat-1]
        at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommand(CommandAwareRpcDispatcher.java:168) [infinispan-core-5.1.3.ER4-redhat-1.jar:5.1.3.ER4-redhat-1]
        at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:478) [infinispan-core-5.1.3.ER4-redhat-1.jar:5.1.3.ER4-redhat-1]
        at org.infinispan.cacheviews.CacheViewsManagerImpl.join(CacheViewsManagerImpl.java:214) [infinispan-core-5.1.3.ER4-redhat-1.jar:5.1.3.ER4-redhat-1]
Caused by: SuspectedException
        at org.jgroups.blocks.MessageDispatcher.sendMessage(MessageDispatcher.java:349) [jgroups-3.0.7.Final-redhat-1.jar:3.0.7.Final-redhat-1]
        at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.processSingleCall(CommandAwareRpcDispatcher.java:263) [infinispan-core-5.1.3.ER4-redhat-1.jar:5.1.3.ER4-redhat-1]
        at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommand(CommandAwareRpcDispatcher.java:163) [infinispan-core-5.1.3.ER4-redhat-1.jar:5.1.3.ER4-redhat-1]

*** why would node01 collect ACKs for a view that contains only node03? ***
05:10:17,087 WARNING [org.jgroups.protocols.pbcast.GMS] (undefined) node01/default(s1): failed to collect all ACKs (expected=3) for view [node03/default(s1)|4] after 5000ms, missing ACKs from [node03/default(s1)]

*** after 10 minutes, the prepare view command times out on node01; still no new view on either node01 or node02 ***
05:19:54,061 ERROR [org.infinispan.cacheviews.CacheViewsManagerImpl] (CacheViewInstaller-4,node01/default(s1)) ISPN000172: Failed to prepare view CacheView{viewId=3, members=[node01/default(s1), node02/default(s1), node03/default(s1)]} for cache  memcachedCache, rolling back to view CacheView{viewId=2, members=[node01/default(s1), node02/default(s1)]}: java.util.concurrent.TimeoutException