Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-661

Make the timeout values for statetransfer flush configurable

    XMLWordPrintable

Details

    Description

      it seems I'm in need to configure the flush timeout defined in org.infinispan.statetransfer.StateTransferManagerImpl.generateTransactionLog(ObjectOutput)
      this is currently hardcoded to 60 seconds.
      This might actually cover another problem, but these are the stacktraces:

      Node1:

      2010-09-21 17:09:24,329 STREAMING_STATE_TRANSFER-sender-5,scarlet-cluster,ip-10-196-114-15-45100 ERROR [remoting.transport.jgroups.JGroupsTransport] Caught while responding to state transfer request
      org.infinispan.statetransfer.StateTransferException: java.util.concurrent.TimeoutException: Timed out waiting for a cluster-wide sync to be acquired. (timeout = 60 seconds)
      at org.infinispan.statetransfer.StateTransferManagerImpl.generateState(StateTransferManagerImpl.java:171)
      at org.infinispan.remoting.InboundInvocationHandlerImpl.generateState(InboundInvocationHandlerImpl.java:118)
      at org.infinispan.remoting.transport.jgroups.JGroupsTransport.getState(JGroupsTransport.java:569)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.handleUpEvent(MessageDispatcher.java:691)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:772)
      at org.jgroups.JChannel.up(JChannel.java:1453)
      at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:887)
      at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:483)
      at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER$StateProviderHandler.process(STREAMING_STATE_TRANSFER.java:653)
      at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER$StateProviderThreadSpawner$1.run(STREAMING_STATE_TRANSFER.java:582)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:619)
      Caused by: java.util.concurrent.TimeoutException: Timed out waiting for a cluster-wide sync to be acquired. (timeout = 60 seconds)
      at org.infinispan.remoting.transport.jgroups.JGroupsDistSync.blockUntilAcquired(JGroupsDistSync.java:42)
      at org.infinispan.statetransfer.StateTransferManagerImpl.generateTransactionLog(StateTransferManagerImpl.java:209)
      at org.infinispan.statetransfer.StateTransferManagerImpl.generateState(StateTransferManagerImpl.java:161)
      ... 12 more

      Node2:

      org.infinispan.statetransfer.StateTransferException: java.io.EOFException: Read past end of file
      at org.infinispan.statetransfer.StateTransferManagerImpl.applyState(StateTransferManagerImpl.java:331)
      at org.infinispan.remoting.InboundInvocationHandlerImpl.applyState(InboundInvocationHandlerImpl.java:101)
      at org.infinispan.remoting.transport.jgroups.JGroupsTransport.setState(JGroupsTransport.java:586)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.handleUpEvent(MessageDispatcher.java:712)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:772)
      at org.jgroups.JChannel.up(JChannel.java:1410)
      at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:887)
      at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:483)
      at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.connectToStateProvider(STREAMING_STATE_TRANSFER.java:525)
      at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.handleStateRsp(STREAMING_STATE_TRANSFER.java:464)
      at org.jgroups.protocols.pbcast.STREAMING_STATE_TRANSFER.up(STREAMING_STATE_TRANSFER.java:225)
      at org.jgroups.protocols.FRAG2.up(FRAG2.java:188)
      at org.jgroups.protocols.FC.up(FC.java:474)
      at org.jgroups.protocols.pbcast.GMS.up(GMS.java:888)
      at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234)
      at org.jgroups.protocols.UNICAST2.handleDataReceived(UNICAST2.java:637)
      at org.jgroups.protocols.UNICAST2.up(UNICAST2.java:262)
      at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:707)
      at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132)
      at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:270)
      at org.jgroups.protocols.MERGE2.up(MERGE2.java:210)
      at org.jgroups.protocols.Discovery.up(Discovery.java:281)
      at org.jgroups.protocols.TP.passMessageUp(TP.java:1009)
      at org.jgroups.protocols.TP.access$100(TP.java:56)
      at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1549)
      at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1526)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:619)
      Caused by: java.io.EOFException: Read past end of file
      at org.jboss.marshalling.AbstractUnmarshaller.eofOnRead(AbstractUnmarshaller.java:184)
      at org.jboss.marshalling.AbstractUnmarshaller.readUnsignedByteDirect(AbstractUnmarshaller.java:319)
      at org.jboss.marshalling.AbstractUnmarshaller.readUnsignedByte(AbstractUnmarshaller.java:280)
      at org.jboss.marshalling.river.RiverUnmarshaller.doReadObject(RiverUnmarshaller.java:207)
      at org.jboss.marshalling.AbstractUnmarshaller.readObject(AbstractUnmarshaller.java:85)
      at org.infinispan.marshall.jboss.GenericJBossMarshaller.objectFromObjectStream(GenericJBossMarshaller.java:162)
      at org.infinispan.marshall.VersionAwareMarshaller.objectFromObjectStream(VersionAwareMarshaller.java:180)
      at org.infinispan.statetransfer.StateTransferManagerImpl.processCommitLog(StateTransferManagerImpl.java:228)
      at org.infinispan.statetransfer.StateTransferManagerImpl.applyTransactionLog(StateTransferManagerImpl.java:258)
      at org.infinispan.statetransfer.StateTransferManagerImpl.applyState(StateTransferManagerImpl.java:320)
      ... 28 more

      Attachments

        Activity

          People

            manik_jira Manik Surtani (Inactive)
            sgrinove Sanne Grinovero
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: