-
Bug
-
Resolution: Done
-
Blocker
-
5.1.0.BETA3
-
Start JGroups-backed "distributed" cluster using attached cmd-line args
and XML config. Use basic HotRod test client (like attached ClientTest1.java) to reproduce error.
Java Hotrod client gets errors trying to talk to basic distributed server cluster. Same code works in 5.1.0.BETA2. All endpoints and clients on local machine (different ports). Cluster seems to form fine, just client gets errors. Detailed log output will be attached in comments.
Error is characterized by lots of client-side errors like the following:
605055 [Timer-0] ERROR org.infinispan.client.hotrod.impl.protocol.Codec10 - ISPN004004: Invalid message id. Expected 10 and received 0
- is related to
-
ISPN-1408 Reduce Hot Rod topology information memory consumption
-
- Closed
-
[ISPN-1506] HotRod server not populating host and port right in the topology cache
Galder Zamarreño
added a comment - Thanks very much Glen. It is indeed a bug as a result of some refactoring I did for ISPN-1408. Should be fixed shortly.
Galder Zamarreño
added a comment - Thanks very much Glen. It is indeed a bug as a result of some refactoring I did for ISPN-1408 . Should be fixed shortly. 
Glen Taylor (Inactive)
added a comment - Updated "steps-to-reproduce" to reference attachments. Glen Taylor (Inactive)
added a comment - Just realized that the ClientTest1 still unnecessarily extends AbstractClientTest, so I removed that to simplify. JIRA wouldn't allow me to delete the original attachment
Glen Taylor (Inactive)
added a comment - Just realized that the ClientTest1 still unnecessarily extends AbstractClientTest, so I removed that to simplify. JIRA wouldn't allow me to delete the original attachment Glen Taylor (Inactive)
added a comment - Attaching traces of successful execution of same scenario with BETA2 binary distro.
Glen Taylor (Inactive)
added a comment - Attaching traces of successful execution of same scenario with BETA2 binary distro. Glen Taylor (Inactive)
added a comment - Client and server-side traces (org.infinispan=TRACE) for failure scenario on 5.1.0.BETA3. Will post trace of successful call on BETA2 shortly.
Glen Taylor (Inactive)
added a comment - Client and server-side traces (org.infinispan=TRACE) for failure scenario on 5.1.0.BETA3. Will post trace of successful call on BETA2 shortly. Glen Taylor (Inactive)
added a comment - Attaching runtime scenario (server startup args, server XML configs, and client code).
Glen Taylor (Inactive)
added a comment - Attaching runtime scenario (server startup args, server XML configs, and client code). Glen Taylor (Inactive)
added a comment - I'll attach a runnable example with source and logs ASAP, probably later today.
Glen Taylor (Inactive)
added a comment - I'll attach a runnable example with source and logs ASAP, probably later today. Galder Zamarreño
added a comment - Glen, can you attach the client code being executed? And can you attach a full TRACE client and server log files with TRACE enabled on org.infinispan package?
Galder Zamarreño
added a comment - Glen, can you attach the client code being executed? And can you attach a full TRACE client and server log files with TRACE enabled on org.infinispan package? Glen Taylor (Inactive)
added a comment - Here's some output from one of the server nodes at the same time (TRACE on org.infinispan.server):
5435 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodDecoder - Decode using instance @4b7d03c5
5457 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.Decoder10$ - Operation code: 23 has been matched to PingRequest
5463 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodDecoder - Decoded header HotRodHeader{op=PingRequest, version=11, messageId=1, cacheName=, flag=NoFlag, clientIntelligence=3, topologyId=0}
5467 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodDecoder - Write response Response{version=11, messageId=1, operation=PingResponse, status=Success, cacheName=}
5468 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodEncoder - Encode msg Response{version=11, messageId=1, operation=PingResponse, status=Success, cacheName=}
5479 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.Encoder11$ - Write hash distribution change response header HashDistAware11Response(1,JavaConversions(null:0, null:0),2,2,2147483647,1)
5482 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodEncoder - Encode msg ErrorResponse{version=0, messageId=0, operation=ErrorResponse, status=ServerError, msg=java.lang.NullPointerException}
Glen Taylor (Inactive)
added a comment - Here's some output from one of the server nodes at the same time (TRACE on org.infinispan.server):
5435 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodDecoder - Decode using instance @4b7d03c5
5457 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.Decoder10$ - Operation code: 23 has been matched to PingRequest
5463 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodDecoder - Decoded header HotRodHeader{op=PingRequest, version=11, messageId=1, cacheName=, flag=NoFlag, clientIntelligence=3, topologyId=0}
5467 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodDecoder - Write response Response{version=11, messageId=1, operation=PingResponse, status=Success, cacheName=}
5468 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodEncoder - Encode msg Response{version=11, messageId=1, operation=PingResponse, status=Success, cacheName=}
5479 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.Encoder11$ - Write hash distribution change response header HashDistAware11Response(1,JavaConversions( null :0, null :0),2,2,2147483647,1)
5482 [HotRodServerWorker-1-1] TRACE org.infinispan.server.hotrod.HotRodEncoder - Encode msg ErrorResponse{version=0, messageId=0, operation=ErrorResponse, status=ServerError, msg=java.lang.NullPointerException}
And thanks for the issue title/desc clarification. I realize "broken" is painfully useless, but the release and component was about as detailed as I could get at the time.