Uploaded image for project: 'JBoss Enterprise Application Platform'
  1. JBoss Enterprise Application Platform
  2. JBEAP-21046

Clustering: errors in mysql database tests

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Blocker Blocker
    • None
    • 7.4.0.Beta
    • Clustering
    • None
    • False
    • False
    • Undefined

      The error is present in EAP Clustering tests where the replicated session data is stored in a remote mysql-8.0 relational database;

      The errors are observed after the first node of a 4 nodes cluster, is failed and then restarted;

      Here is a sequence of errors observed:

      2021-02-17 17:04:36,552 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (non-blocking-thread--p5-t1) ISPN000136: Error executing command GetKeyValueCommand on Cache 'cbnc.ear.a.war', writing keys []: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 15 seconds for key SessionCreationMetaDataKey(x2zJZ-VS4iaKYaz0zCbktW56KGs4KYN9Of4M9T-G) and requestor GlobalTransaction{id=5, addr=wildfly1, remote=false, xid=null, internalId=-1}. Lock is held by GlobalTransaction{id=565, addr=wildfly2, remote=true, xid=null, internalId=-1}
      ...
      2021-02-17 17:05:21,690 ERROR [io.undertow.servlet.request] (default task-2) UT015005: Error invoking method requestDestroyed on listener class com.sun.faces.config.ConfigureListener: java.lang.UnsupportedOperationException
      ...
      2021-02-17 17:06:31,374 ERROR [org.infinispan.CLUSTER] (thread-18,ejb,wildfly1) ISPN000475: Error processing response for request 125 from wildfly3: java.lang.ClassNotFoundException: javax.resource.ResourceException from [Module "org.infinispan" version 11.0.8.Final-redhat-00001 from local module loader @5f031ebd (finder: local module finder @4ee37ca3 (roots: /tmp/tests-clustering/jboss-eap-1/modules,/tmp/tests-clustering/jboss-eap-1/modules/system/layers/base))]
      

      The EAP nodes are configured as follows:

      embed-server --server-config=standalone-ha.xml
      /subsystem=jgroups/channel=ee:write-attribute(name=stack,value=tcp)
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload:add()
      /subsystem=infinispan/cache-container=web/invalidation-cache==offload/component=transaction:write-attribute(name=mode, value=BATCH)
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/component=locking:write-attribute(name=isolation, value=REPEATABLE_READ)
      data-source add --name=testDS --jndi-name=java:jboss/datasources/testDS --driver-name=mysql-connector.jar --connection-url=jdbc:mysql://mysql-80.hosts.mwqe.eng.bos.redhat.com:3306/dballo00 --enabled=true --jta=true --use-java-context=true --transaction-isolation=TRANSACTION_READ_COMMITTED --min-pool-size=1 --max-pool-size=5 --pool-prefill=true --user-name=dballo00 --password=dballo00 --prepared-statements-cache-size=32 --share-prepared-statements=true
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc:add(data-source=testDS,fetch-state=false,passivation=false,purge=false,shared=true,dialect=MYSQL){allow-resource-service-restart=true}
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=id-column.name,value=id)
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=data-column.name,value=datum)
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=timestamp-column.name,value=version)
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=id-column.type,value=VARCHAR(255))
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=timestamp-column.type,value=BIGINT)
      /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=data-column.type,value=VARBINARY(10000))
      /subsystem=infinispan/cache-container=web:write-attribute(name=default-cache, value=offload)
      /subsystem=transactions:write-attribute(name=node-identifier,value=wildfly1)
      

      This impacts on the client:

      • 15% of the HTTP requests receive an invalid serial (= replication isn't working properly)
      • 4% of the HTTP requests receive 503 response code

      Complete test runs here:

      Find attached the nodes log files;

              Unassigned Unassigned
              tborgato@redhat.com Tommaso Borgato
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: