-
Bug
-
Resolution: Done
-
Major
-
13.0.6.Final
-
None
-
None
We started to experience ISPN029019 occasionally after upgrading from earlier Infinispan version to 13.0.6.Final.
We are not using replication or other fancy stuff, just a local mem + disk cache as you can see from the config.
Stacktrace:
play.api.UnexpectedException: Unexpected exception[CompletionException: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index.] at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:358) at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:264) at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:430) at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:422) at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:490) at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63) at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:94) at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100) Caused by: java.util.concurrent.CompletionException: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index. at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:346) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:632) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.invokeQueuedHandlers(QueueAsyncInvocationStage.java:114) at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.accept(QueueAsyncInvocationStage.java:87) at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.accept(QueueAsyncInvocationStage.java:33) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index. at org.infinispan.persistence.sifs.NonBlockingSoftIndexFileStore.lambda$load$17(NonBlockingSoftIndexFileStore.java:601) at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700) at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1982) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377) ... 1 common frames omitted Caused by: java.lang.IllegalStateException: Error reading header from 0:232462 | 0 at org.infinispan.persistence.sifs.IndexNode$LeafNode.getHeaderAndKey(IndexNode.java:1035) at org.infinispan.persistence.sifs.IndexNode$LeafNode.loadRecord(IndexNode.java:1063) at org.infinispan.persistence.sifs.IndexNode$ReadOperation$1.apply(IndexNode.java:224) at org.infinispan.persistence.sifs.IndexNode$ReadOperation$1.apply(IndexNode.java:221) at org.infinispan.persistence.sifs.IndexNode.applyOnLeaf(IndexNode.java:295) at org.infinispan.persistence.sifs.Index.getRecord(Index.java:120) at org.infinispan.persistence.sifs.Index.getRecord(Index.java:106) at org.infinispan.persistence.sifs.NonBlockingSoftIndexFileStore.lambda$load$17(NonBlockingSoftIndexFileStore.java:592) at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700) at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) 2022-03-09 13:30:30,769 [debug] g.ErrorHandler - Exception: java.util.concurrent.CompletionException: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index.'
Configuration for the cache (session-cache):
<infinispan> <cache-container name="some-cache-manager" statistics="true" default-cache="default-cache" shutdown-hook="DEFAULT"> <global-state> <persistent-location path="global/state" relative-to="cache.dir"/> </global-state> <serialization marshaller="org.infinispan.commons.marshall.JavaSerializationMarshaller"> <allow-list> --- removed -- </allow-list> </serialization> <local-cache name="default-cache"> <memory storage="OFF_HEAP" max-count="2000000" /> <persistence passivation="false"> <file-store path="cache/default" shared="false" purge="true"> </file-store> </persistence> </local-cache> <local-cache name="session-cache"> <memory storage="OFF_HEAP" max-count="2000000" /> <expiration interval="60000" lifespan="2592000000"/> <persistence passivation="false"> <file-store path="cache/session" shared="false" preload="true" fetch-state="true"> </file-store> </persistence> </local-cache> --- removed -- </cache-container> </infinispan>