Investigate CrashRecovery05_2_Test075 timeout failure

2022-06-10 16:50:24,983: Task [emptyObjectStore 517]: performing command: /usr/lib/jvm/java-11-openjdk/bin/java -classpath dist/narayana-full-5.12.7.Final-SNAPSHOT/etc/:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/ext/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/etc/:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/jcc.jar:dbdrivers/mysql-connector-java.jar:dbdrivers/ojdbc8.jar:dbdrivers/postgresql.jar:ext/log4j.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/emptyObjectStore-coverage.ec -DportOffsetId=0 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/emptyObjectStore -DRecoveryEnvironmentBean.recoveryListener=true org.jboss.jbossts.qa.Utils.EmptyObjectStore 
2022-06-10 16:50:24,983: Task [emptyObjectStore 517]: Insert into task reaper queue with timeout 480000 secs
2022-06-10 16:50:25,535: Task [emptyObjectStore 517]: Reached end of input passed=true failed=false
2022-06-10 16:50:25,536: Task [emptyObjectStore 517]:  perform removing task from reaper
2022-06-10 16:50:25,536: Task [server0 518]: starting command: /usr/lib/jvm/java-11-openjdk/bin/java -classpath dist/narayana-full-5.12.7.Final-SNAPSHOT/etc/:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/ext/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/etc/:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/jcc.jar:dbdrivers/mysql-connector-java.jar:dbdrivers/ojdbc8.jar:dbdrivers/postgresql.jar:ext/log4j.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server0-coverage.ec -DportOffsetId=1 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server0 -DRecoveryEnvironmentBean.recoveryListener=true com.arjuna.ats.arjuna.recovery.RecoveryManager -test 
2022-06-10 16:50:25,537: Task [server0 518]:  Task started, insert into task reaper queue with timeout 480000 secs
2022-06-10 16:50:26,205: Task [server0 518]:  TaskReader printedReady=true shutdown=true
2022-06-10 16:50:26,206: Task [server1 519]: starting command: /usr/lib/jvm/java-11-openjdk/bin/java -classpath dist/narayana-full-5.12.7.Final-SNAPSHOT/etc/:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/ext/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/etc/:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/jcc.jar:dbdrivers/mysql-connector-java.jar:dbdrivers/ojdbc8.jar:dbdrivers/postgresql.jar:ext/log4j.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server1-coverage.ec -DportOffsetId=2 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server -DRecoveryEnvironmentBean.recoveryListener=true org.jboss.jbossts.qa.CrashRecovery05Servers.Server07 value_5 value_1 value_2 
2022-06-10 16:50:26,207: Task [server1 519]:  Task started, insert into task reaper queue with timeout 480000 secs
2022-06-10 16:50:26,761: Task [server1 519]:  TaskReader printedReady=true shutdown=true
2022-06-10 16:50:26,762: Task [client0 520]: starting command: /usr/lib/jvm/java-11-openjdk/bin/java -classpath dist/narayana-full-5.12.7.Final-SNAPSHOT/etc/:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/ext/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/etc/:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/jcc.jar:dbdrivers/mysql-connector-java.jar:dbdrivers/ojdbc8.jar:dbdrivers/postgresql.jar:ext/log4j.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client0-coverage.ec -DportOffsetId=3 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client -DRecoveryEnvironmentBean.recoveryListener=true org.jboss.jbossts.qa.CrashRecovery05Clients2.Client25b value_1 value_2 
2022-06-10 16:50:26,763: Task [client0 520]:  Task started, insert into task reaper queue with timeout 480000 secs
2022-06-10 16:50:28,135: Task [client0 520]:  waitFor removing task from reaper
2022-06-10 16:50:28,137: Task [server2 521]: starting command: /usr/lib/jvm/java-11-openjdk/bin/java -classpath dist/narayana-full-5.12.7.Final-SNAPSHOT/etc/:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/ext/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/etc/:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/jcc.jar:dbdrivers/mysql-connector-java.jar:dbdrivers/ojdbc8.jar:dbdrivers/postgresql.jar:ext/log4j.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server2-coverage.ec -DportOffsetId=2 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server -DRecoveryEnvironmentBean.recoveryListener=true org.jboss.jbossts.qa.CrashRecovery05Servers.Server08 value_5 value_3 value_4 
2022-06-10 16:50:28,137: Task [server2 521]:  Task started, insert into task reaper queue with timeout 480000 secs
2022-06-10 16:50:28,713: Task [server2 521]:  TaskReader printedReady=true shutdown=true
2022-06-10 16:50:28,714: Task [client1 522]: starting command: /usr/lib/jvm/java-11-openjdk/bin/java -classpath dist/narayana-full-5.12.7.Final-SNAPSHOT/etc/:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/ext/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/etc/:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/jcc.jar:dbdrivers/mysql-connector-java.jar:dbdrivers/ojdbc8.jar:dbdrivers/postgresql.jar:ext/log4j.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client1-coverage.ec -DportOffsetId=3 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client -DRecoveryEnvironmentBean.recoveryListener=true org.jboss.jbossts.qa.CrashRecovery05Clients2.Client25a value_3 value_4 
2022-06-10 16:50:28,714: Task [client1 522]:  Task started, insert into task reaper queue with timeout 480000 secs
2022-06-10 16:59:06,235: Task [server0 518]:  TASK TIME OUT
2022-06-10 16:59:09,054: Task [server0 518]:  Creating stack dump for pid 20065 and cmd 20065 org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery05_2 skipNonTests=false filtertrace=true haltOnError=false haltOnFailure=false formatter=org.apache.tools.ant.taskdefs.optional.junit.SummaryJUnitResultFormatter showoutput=false outputtoformatters=true logfailedtests=true threadid=0 logtestlistenerevents=false formatter=org.apache.tools.ant.taskdefs.optional.junit.PlainJUnitResultFormatter,/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/TEST-org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery05_2.txt crashfile=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/junitvmwatcher1061963607648630291.properties propsfile=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/junit16453735941131377306.properties -Dnames=.* -Dadditional.elements= -Dtest.timeout=
2022-06-10 16:59:09,544: Task [server0 518]:  Creating stack dump for pid 6497 and cmd 6497 org.jboss.jbossts.qa.CrashRecovery05Servers.Server08 value_5 value_3 value_4 -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server2-coverage.ec -DportOffsetId=2 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server -DRecoveryEnvironmentBean.recoveryListener=true
2022-06-10 16:59:09,826: Task [server0 518]:  Creating stack dump for pid 7 and cmd 7 /home/jenkins/remoting-4.14.jar -noReconnect -noKeepAlive -agentLog /home/jenkins/agent.log
2022-06-10 16:59:10,104: Task [server0 518]:  Creating stack dump for pid 22858 and cmd 22858 org.apache.tools.ant.launch.Launcher -cp  -f run-tests.xml ci-jts-tests -Dcode.coverage=false -Dorbtype=orbtype -Xms1024m -Xmx1024m -Dant.home=/usr/share/ant -Dant.library.dir=/usr/share/ant/lib
2022-06-10 16:59:10,387: Task [server0 518]:  Creating stack dump for pid 6379 and cmd 6379 com.arjuna.ats.arjuna.recovery.RecoveryManager -test -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server0-coverage.ec -DportOffsetId=1 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server0 -DRecoveryEnvironmentBean.recoveryListener=true
2022-06-10 16:59:10,678: Task [server0 518]:  Creating stack dump for pid 6525 and cmd 6525 org.jboss.jbossts.qa.CrashRecovery05Clients2.Client25a value_3 value_4 -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client1-coverage.ec -DportOffsetId=3 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client -DRecoveryEnvironmentBean.recoveryListener=true
2022-06-10 16:59:10,954: Task [server0 518]:  Creating stack dump for pid 6605 and cmd 6605 jdk.jcmd/sun.tools.jps.Jps -mlv -Dapplication.home=/usr/lib/jvm/java-11-openjdk-11.0.14.0.9-2.el8_5.x86_64 -Xms8m -Djdk.module.main=jdk.jcmd
2022-06-10 16:59:11,118: Task [server2 521]:  TASK TIME OUT
2022-06-10 16:59:11,265: Task [server2 521]:  Creating stack dump for pid 20065 and cmd 20065 org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery05_2 skipNonTests=false filtertrace=true haltOnError=false haltOnFailure=false formatter=org.apache.tools.ant.taskdefs.optional.junit.SummaryJUnitResultFormatter showoutput=false outputtoformatters=true logfailedtests=true threadid=0 logtestlistenerevents=false formatter=org.apache.tools.ant.taskdefs.optional.junit.PlainJUnitResultFormatter,/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/TEST-org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery05_2.txt crashfile=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/junitvmwatcher1061963607648630291.properties propsfile=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/junit16453735941131377306.properties -Dnames=.* -Dadditional.elements= -Dtest.timeout=
2022-06-10 16:59:11,446: Task [server2 521]:  Creating stack dump for pid 6497 and cmd 6497 org.jboss.jbossts.qa.CrashRecovery05Servers.Server08 value_5 value_3 value_4 -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server2-coverage.ec -DportOffsetId=2 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server -DRecoveryEnvironmentBean.recoveryListener=true
2022-06-10 16:59:11,488: Task [client1 522]:  waitFor removing task from reaper
2022-06-10 16:59:11,620: Task [server2 521]:  Creating stack dump for pid 6786 and cmd 6786 jdk.jcmd/sun.tools.jps.Jps -mlv -Dapplication.home=/usr/lib/jvm/java-11-openjdk-11.0.14.0.9-2.el8_5.x86_64 -Xms8m -Djdk.module.main=jdk.jcmd
2022-06-10 16:59:11,780: Task [server2 521]:  Creating stack dump for pid 7 and cmd 7 /home/jenkins/remoting-4.14.jar -noReconnect -noKeepAlive -agentLog /home/jenkins/agent.log
2022-06-10 16:59:11,957: Task [server2 521]:  Creating stack dump for pid 22858 and cmd 22858 org.apache.tools.ant.launch.Launcher -cp  -f run-tests.xml ci-jts-tests -Dcode.coverage=false -Dorbtype=orbtype -Xms1024m -Xmx1024m -Dant.home=/usr/share/ant -Dant.library.dir=/usr/share/ant/lib
2022-06-10 16:59:12,123: Task [server2 521]:  Creating stack dump for pid 6379 and cmd 6379 com.arjuna.ats.arjuna.recovery.RecoveryManager -test -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server0-coverage.ec -DportOffsetId=1 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/server0 -DRecoveryEnvironmentBean.recoveryListener=true
2022-06-10 16:59:12,284: Task [server2 521]:  Creating stack dump for pid 6525 and cmd 6525 org.jboss.jbossts.qa.CrashRecovery05Clients2.Client25a value_3 value_4 -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client1-coverage.ec -DportOffsetId=3 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/client -DRecoveryEnvironmentBean.recoveryListener=true
2022-06-10 16:59:12,442: Task [emptyObjectStore 523]: performing command: /usr/lib/jvm/java-11-openjdk/bin/java -classpath dist/narayana-full-5.12.7.Final-SNAPSHOT/etc/:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/lib/ext/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/lib/*:dist/narayana-full-5.12.7.Final-SNAPSHOT/jacorb/etc/:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/jcc.jar:dbdrivers/mysql-connector-java.jar:dbdrivers/ojdbc8.jar:dbdrivers/postgresql.jar:ext/log4j.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -DCoordinatorEnvironmentBean.dynamic1PC=false -Dio.narayana.perf.failonregression=false -Xms1024m -Xmx1024m -XX:ParallelGCThreads=2 -Demma.coverage.out.file=./testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/emptyObjectStore-coverage.ec -DportOffsetId=6 -DObjectStoreBaseDir=/home/jenkins/workspace/btny-pulls-narayana/PROFILE/QA_JTS_JACORB/jdk/jdk11.latest/label/linux/qa/testoutput/crashrecovery05_2/CrashRecovery05_2_Test075/emptyObjectStore -DRecoveryEnvironmentBean.recoveryListener=true org.jboss.jbossts.qa.Utils.EmptyObjectStore 
2022-06-10 16:59:12,443: Task [emptyObjectStore 523]: Insert into task reaper queue with timeout 480000 secs
2022-06-10 16:59:12,962: Task [emptyObjectStore 523]: Reached end of input passed=true failed=false
2022-06-10 16:59:12,962: Task [emptyObjectStore 523]:  perform removing task from reaper

Testcase: CrashRecovery05_2_Test075 took 530.983 sec
	Caused an ERROR
2022-06-10 16:59:12,441: Task [server2 521]: terminate for timed out task
java.lang.RuntimeException: 2022-06-10 16:59:12,441: Task [server2 521]: terminate for timed out task
	at org.jboss.jbossts.qa.junit.TaskImpl.terminate(TaskImpl.java:490)
	at org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery05_2.CrashRecovery05_2_Test075(TestGroup_crashrecovery05_2.java:1478)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at org.jboss.jbossts.qa.junit.QATestNameRule$1.evaluate(QATestNameRule.java:89)

	Caused an ERROR
2022-06-10 16:59:12,441: Task [server0 518]: terminate for timed out task
java.lang.RuntimeException: 2022-06-10 16:59:12,441: Task [server0 518]: terminate for timed out task
	at org.jboss.jbossts.qa.junit.TaskImpl.terminate(TaskImpl.java:490)
	at org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery05_2.tearDown(TestGroup_crashrecovery05_2.java:46)
	at jdk.internal.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at org.jboss.jbossts.qa.junit.QATestNameRule$1.evaluate(QATestNameRule.java:89)