Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-13751

ISPN029019 caught when fetching a key from cache

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • 14.0.0.Dev03, 13.0.11.Final
    • 13.0.6.Final
    • None
    • None

    Description

      We started to experience ISPN029019 occasionally after upgrading from earlier Infinispan version to 13.0.6.Final.

      We are not using replication or other fancy stuff, just a local mem + disk cache as you can see from the config.

      Stacktrace:

      play.api.UnexpectedException: Unexpected exception[CompletionException: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index.]
          at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:358)
          at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:264)
          at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:430)
          at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:422)
          at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:490)
          at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
          at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
          at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18)
          at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:94)
          at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
      Caused by: java.util.concurrent.CompletionException: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index.
          at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331)
          at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:346)
          at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:632)
          at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
          at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
          at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.invokeQueuedHandlers(QueueAsyncInvocationStage.java:114)
          at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.accept(QueueAsyncInvocationStage.java:87)
          at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.accept(QueueAsyncInvocationStage.java:33)
          at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
          at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
      Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index.
          at org.infinispan.persistence.sifs.NonBlockingSoftIndexFileStore.lambda$load$17(NonBlockingSoftIndexFileStore.java:601)
          at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
          at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
          at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1982)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486)
          at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377)
          ... 1 common frames omitted
      Caused by: java.lang.IllegalStateException: Error reading header from 0:232462 | 0
          at org.infinispan.persistence.sifs.IndexNode$LeafNode.getHeaderAndKey(IndexNode.java:1035)
          at org.infinispan.persistence.sifs.IndexNode$LeafNode.loadRecord(IndexNode.java:1063)
          at org.infinispan.persistence.sifs.IndexNode$ReadOperation$1.apply(IndexNode.java:224)
          at org.infinispan.persistence.sifs.IndexNode$ReadOperation$1.apply(IndexNode.java:221)
          at org.infinispan.persistence.sifs.IndexNode.applyOnLeaf(IndexNode.java:295)
          at org.infinispan.persistence.sifs.Index.getRecord(Index.java:120)
          at org.infinispan.persistence.sifs.Index.getRecord(Index.java:106)
          at org.infinispan.persistence.sifs.NonBlockingSoftIndexFileStore.lambda$load$17(NonBlockingSoftIndexFileStore.java:592)
          at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
          at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
      2022-03-09 13:30:30,769 [debug] g.ErrorHandler - Exception: java.util.concurrent.CompletionException: org.infinispan.persistence.spi.PersistenceException: ISPN029019: Cannot load key WrappedByteArray[ACED0005\t00\$\8\4\f\6\1\0\d\4\-\2\d\9\6\-\4\5\f\b\-\b\d\7\4\-\2\4\7\a\d\4\2\9\d\7\e\8 (43 bytes)] from index.' 

      Configuration for the cache (session-cache):

      <infinispan>
         <cache-container name="some-cache-manager" statistics="true"  default-cache="default-cache" shutdown-hook="DEFAULT">
             <global-state>
                 <persistent-location path="global/state" relative-to="cache.dir"/>
             </global-state>
             <serialization marshaller="org.infinispan.commons.marshall.JavaSerializationMarshaller">
                  <allow-list>
      --- removed -- 
                  </allow-list>
            </serialization>
      
            <local-cache name="default-cache">
               <memory storage="OFF_HEAP" max-count="2000000" />
               <persistence passivation="false">
                  <file-store path="cache/default" shared="false" purge="true">
                  </file-store>
               </persistence>
            </local-cache>
      
            <local-cache name="session-cache">
               <memory storage="OFF_HEAP" max-count="2000000" />
               <expiration interval="60000" lifespan="2592000000"/>
               <persistence passivation="false">
                  <file-store path="cache/session" shared="false" preload="true" fetch-state="true">
                  </file-store>
               </persistence>
            </local-cache>
      
            --- removed --
      
         </cache-container>
      </infinispan> 

      Attachments

        Activity

          People

            wburns@redhat.com Will Burns
            timopulkkinen Timo Pulkkinen (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: