Uploaded image for project: 'JBoss Enterprise Application Platform 4 and 5'
  1. JBoss Enterprise Application Platform 4 and 5
  2. JBPAPP-9846

IllegalStateException after node failover

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Critical
    • EAP_EWP 5.2.0 ER4
    • EAP_EWP 5.2.0 ER2
    • Messaging
    • None
    • RHEL6 x86_64, Oracle JDK6

    • Not Required
    • NEW

    Description

      During failover test, node was killed (its jvm was killed), other cluster members were notified of this event, but we see IllegalStateException from the messaging code:

      [JBoss] 05:51:38,750 ERROR [org.jgroups.blocks.ConnectionTable] (OOB-3,10.16.88.181:7900) failed sending data to 10.16.88.182:7900: java.net.SocketException: Socket closed
      [JBoss] 05:51:40,250 INFO  [org.jboss.ha.framework.interfaces.HAPartition.EJB3ReplTestPartition] (VERIFY_SUSPECT.TimerThread,EJB3ReplTestPartition,10.16.88.181:55200) Suspected member: 10.16.88.182:55200
      [JBoss] 05:51:40,307 INFO  [org.jboss.messaging.core.impl.postoffice.GroupMember] (Incoming-4,10.16.88.181:55200) org.jboss.messaging.core.impl.postoffice.GroupMember$ControlMembershipListener@5b266925 got new view [10.16.88.179:55200|12] [10.16.88.179:55200, 10.16.88.180:55200, 10.16.88.181:55200], old view is [10.16.88.179:55200|11] [10.16.88.179:55200, 10.16.88.180:55200, 10.16.88.181:55200, 10.16.88.182:55200]
      [JBoss] 05:51:40,307 INFO  [org.jboss.messaging.core.impl.postoffice.GroupMember] (Incoming-4,10.16.88.181:55200) I am (10.16.88.181:55200)
      [JBoss] 05:51:40,308 ERROR [org.jboss.messaging.core.impl.postoffice.GroupMember] (Incoming-4,10.16.88.181:55200) Caught Exception in MembershipListener
      [JBoss] java.lang.IllegalStateException: org.jboss.messaging.core.impl.postoffice.MessagingPostOffice@15d03fe9 cannot find node ID for address 10.16.88.182:55200
      [JBoss] 	at org.jboss.messaging.core.impl.postoffice.MessagingPostOffice.nodesLeft(MessagingPostOffice.java:1619)
      [JBoss] 	at org.jboss.messaging.core.impl.postoffice.GroupMember$ControlMembershipListener.viewAccepted(GroupMember.java:609)
      [JBoss] 	at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.handleUpEvent(MessageDispatcher.java:733)
      [JBoss] 	at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:776)
      [JBoss] 	at org.jgroups.JChannel.up(JChannel.java:1336)
      [JBoss] 	at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:454)
      [JBoss] 	at org.jgroups.protocols.pbcast.FLUSH.up(FLUSH.java:443)
      [JBoss] 	at org.jgroups.protocols.pbcast.STATE_TRANSFER.up(STATE_TRANSFER.java:153)
      [JBoss] 	at org.jgroups.protocols.FRAG2.up(FRAG2.java:188)
      [JBoss] 	at org.jgroups.protocols.FC.up(FC.java:493)
      [JBoss] 	at org.jgroups.protocols.pbcast.GMS.installView(GMS.java:543)
      [JBoss] 	at org.jgroups.protocols.pbcast.ParticipantGmsImpl.handleViewChange(ParticipantGmsImpl.java:153)
      [JBoss] 	at org.jgroups.protocols.pbcast.GMS.up(GMS.java:749)
      [JBoss] 	at org.jgroups.protocols.VIEW_SYNC.up(VIEW_SYNC.java:192)
      [JBoss] 	at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:233)
      [JBoss] 	at org.jgroups.protocols.UNICAST.up(UNICAST.java:328)
      [JBoss] 	at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:895)
      [JBoss] 	at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:708)
      [JBoss] 	at org.jgroups.protocols.BARRIER.up(BARRIER.java:136)
      [JBoss] 	at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:174)
      [JBoss] 	at org.jgroups.protocols.FD.up(FD.java:284)
      [JBoss] 	at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:328)
      [JBoss] 	at org.jgroups.protocols.MERGE2.up(MERGE2.java:144)
      [JBoss] 	at org.jgroups.protocols.Discovery.up(Discovery.java:264)
      [JBoss] 	at org.jgroups.protocols.PING.up(PING.java:273)
      [JBoss] 	at org.jgroups.protocols.TP$ProtocolAdapter.up(TP.java:2319)
      [JBoss] 	at org.jgroups.protocols.TP.passMessageUp(TP.java:1253)
      [JBoss] 	at org.jgroups.protocols.TP.access$100(TP.java:50)
      [JBoss] 	at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1830)
      [JBoss] 	at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1809)
      [JBoss] 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      [JBoss] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      [JBoss] 	at java.lang.Thread.run(Thread.java:662)
      

      Attachments

        Activity

          People

            gaohoward Howard Gao
            jkudrnac@redhat.com Jitka Kozana
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: