Uploaded image for project: 'JBoss Enterprise Application Platform'
  1. JBoss Enterprise Application Platform
  2. JBEAP-21054

Clustering: java.lang.NullPointerException in JDG hotrod test

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 7.4.0.GA
    • 7.4.0.Beta
    • Clustering
    • None
    • False
    • False
    • Undefined

      The error is present in EAP Clustering tests where session data is offloaded to a remote JDG cluster using hotrod;

      The 2 EAP cluster nodes are configured as follows:

      embed-server --server-config=standalone-ha.xml
      /subsystem=jgroups/channel=ee:write-attribute(name=stack,value=tcp)
      /subsystem=transactions:write-attribute(name=node-identifier,value=wildfly1)
      /socket-binding-group=standard-sockets/remote-destination-outbound-socket-binding=remote-jdg-server1:add(host=10.0.145.153, port=11222)
      /socket-binding-group=standard-sockets/remote-destination-outbound-socket-binding=remote-jdg-server2:add(host=10.0.144.25, port=11222)
      batch
      /subsystem=infinispan/remote-cache-container=session_data_cc:add(default-remote-cluster=jdg-server-cluster, module=org.wildfly.clustering.web.hotrod, protocol-version=3.0, statistics-enabled=true, properties={infinispan.client.hotrod.auth_username=admin, infinispan.client.hotrod.auth_password=pass.1234})
      /subsystem=infinispan/remote-cache-container=session_data_cc/remote-cluster=jdg-server-cluster:add(socket-bindings=[remote-jdg-server1,remote-jdg-server2])
      run-batch
      /subsystem=distributable-web/hotrod-session-management=sm_offload:add(remote-cache-container=session_data_cc, granularity=ATTRIBUTE)
      /subsystem=distributable-web/hotrod-session-management=sm_offload/affinity=local:add()
      /subsystem=distributable-web/hotrod-session-management=sm_offload_granular:add(remote-cache-container=session_data_cc, granularity=ATTRIBUTE)
      /subsystem=distributable-web/hotrod-session-management=sm_offload_granular/affinity=local:add()
      /subsystem=infinispan/remote-cache-container=session_data_cc/near-cache=invalidation:add(max-entries=1000)
      /subsystem=distributable-web:write-attribute(name=default-session-management,value=sm_offload_granular)
      

      The error happens right after the 2nd node has been shut-down and restarted:

      2021-02-18 14:36:22,926 ERROR [org.jboss.msc.service.fail] (ServerService Thread Pool -- 81) MSC000001: Failed to start service jboss.clustering.web."clusterbench-ee8.ear.c.war".cache: org.jboss.msc.service.StartException in service jboss.clustering.web."clusterbench-ee8.ear.c.war".cache: org.infinispan.client.hotrod.exceptions.TransportException:: java.lang.NullPointerException
      	at org.wildfly.clustering.service@7.4.0.Beta-redhat-00001//org.wildfly.clustering.service.FunctionalService.start(FunctionalService.java:66)
      	at org.wildfly.clustering.service@7.4.0.Beta-redhat-00001//org.wildfly.clustering.service.AsyncServiceConfigurator$AsyncService.lambda$start$0(AsyncServiceConfigurator.java:117)
      	at org.jboss.threads@2.4.0.Final-redhat-00001//org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
      	at org.jboss.threads@2.4.0.Final-redhat-00001//org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1990)
      	at org.jboss.threads@2.4.0.Final-redhat-00001//org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486)
      	at org.jboss.threads@2.4.0.Final-redhat-00001//org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377)
      	at java.base/java.lang.Thread.run(Thread.java:834)
      	at org.jboss.threads@2.4.0.Final-redhat-00001//org.jboss.threads.JBossThread.run(JBossThread.java:513)
      Caused by: org.infinispan.client.hotrod.exceptions.TransportException:: java.lang.NullPointerException
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.Util.rewrap(Util.java:84)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.Util.await(Util.java:57)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.RemoteCacheImpl.addClientListener(RemoteCacheImpl.java:506)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.DelegatingRemoteCache.addClientListener(DelegatingRemoteCache.java:91)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.near.NearCacheService.start(NearCacheService.java:47)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.InvalidatedNearRemoteCache.start(InvalidatedNearRemoteCache.java:136)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.RemoteCacheManager.startRemoteCache(RemoteCacheManager.java:566)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.RemoteCacheManager.createRemoteCache(RemoteCacheManager.java:513)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.RemoteCacheManager.getCache(RemoteCacheManager.java:314)
      	at org.wildfly.clustering.infinispan.client@7.4.0.Beta-redhat-00001//org.wildfly.clustering.infinispan.client.manager.RemoteCacheManager.getCache(RemoteCacheManager.java:70)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.RemoteCacheManager.getCache(RemoteCacheManager.java:278)
      	at org.jboss.as.clustering.infinispan@7.4.0.Beta-redhat-00001//org.jboss.as.clustering.infinispan.subsystem.remote.ManagedRemoteCacheContainer.getCache(ManagedRemoteCacheContainer.java:74)
      	at org.wildfly.clustering.infinispan.client@7.4.0.Beta-redhat-00001//org.wildfly.clustering.infinispan.client.service.RemoteCacheServiceConfigurator.get(RemoteCacheServiceConfigurator.java:87)
      	at org.wildfly.clustering.infinispan.client@7.4.0.Beta-redhat-00001//org.wildfly.clustering.infinispan.client.service.RemoteCacheServiceConfigurator.get(RemoteCacheServiceConfigurator.java:57)
      	at org.wildfly.clustering.service@7.4.0.Beta-redhat-00001//org.wildfly.clustering.service.FunctionalService.start(FunctionalService.java:63)
      	... 7 more
      Caused by: java.lang.NullPointerException
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.event.impl.ClientListenerNotifier.startClientListener(ClientListenerNotifier.java:129)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.operations.AddClientListenerOperation.acceptResponse(AddClientListenerOperation.java:136)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.transport.netty.HeaderDecoder.decode(HeaderDecoder.java:147)
      	at org.infinispan.client.hotrod@11.0.8.Final-redhat-00001//org.infinispan.client.hotrod.impl.transport.netty.HintedReplayingDecoder.callDecode(HintedReplayingDecoder.java:94)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
      	at io.netty@4.1.51.Final-redhat-00001//io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at org.jboss.as.clustering.common@7.4.0.Beta-redhat-00001//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
      	at org.jboss.as.clustering.common@7.4.0.Beta-redhat-00001//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
      	at org.jboss.as.clustering.common@7.4.0.Beta-redhat-00001//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
      	at org.jboss.as.clustering.common@7.4.0.Beta-redhat-00001//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
      	at java.base/java.lang.Thread.run(Thread.java:834)
      

      The error doesn't affect the client significantly;

      Complete run here:

      Find attached the logs for the EAP and JDG nodes;

              Unassigned Unassigned
              tborgato@redhat.com Tommaso Borgato
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: