If HA local DB is not correctly started the HAConnectionFactoryUnitTestCase.testFailoverLocalMCF will hang in HAConnectionSessionBean.stopDb.
The issue occures when there is problem to start testHaLocalDB1 defined in testsuite/src/resources/jca/ha/test-ha-ds.xml deployed in org.jboss.test.jca.test.HAConnectionFactoryUnitTestCase
Server log:
2014-02-23 22:57:43,423 INFO [STDOUT] (HSQLDB Server @7b782609) [Server@7b782609]: Database [index=0, id=3, db=file:/mnt/hudson_workspace/workspace/eap-5.3.x-JDK6-RHEL6-matrix-CI/96366ac8/jboss-eap-5.3.x/build/output/jboss-5.3.0.Branch/server/all/data/hypersonic/testHaLocalDB1, alias=] opened sucessfully in 100 ms.
2014-02-23 22:57:43,423 ERROR [STDERR] (HSQLDB Server @d095833) Exception in thread "HSQLDB Server @d095833"
2014-02-23 22:57:43,423 INFO [STDOUT] (HSQLDB Server @7b782609) [Server@7b782609]: Startup sequence completed in 104 ms.
2014-02-23 22:57:43,423 ERROR [STDERR] (HSQLDB Server @d095833) java.lang.NullPointerException
2014-02-23 22:57:43,424 ERROR [STDERR] (HSQLDB Server @d095833) at org.hsqldb.DatabaseManager.registerServer(Unknown Source)
2014-02-23 22:57:43,424 ERROR [STDERR] (HSQLDB Server @d095833) at org.hsqldb.DatabaseManager.getDatabase(Unknown Source)
2014-02-23 22:57:43,424 INFO [STDOUT] (HSQLDB Server @7b782609) [Server@7b782609]: 2014-02-23 22:57:43.424 HSQLDB server 1.8.0 is online
2014-02-23 22:57:43,424 ERROR [STDERR] (HSQLDB Server @d095833) at org.hsqldb.Server.openDatabases(Unknown Source)
2014-02-23 22:57:43,424 ERROR [STDERR] (HSQLDB Server @d095833) at org.hsqldb.Server.run(Unknown Source)
2014-02-23 22:57:43,424 ERROR [STDERR] (HSQLDB Server @d095833) at org.hsqldb.Server.access$000(Unknown Source)
2014-02-23 22:57:43,424 INFO [STDOUT] (HSQLDB Server @7b782609) [Server@7b782609]: To close normally, connect and execute SHUTDOWN SQL
2014-02-23 22:57:43,424 ERROR [STDERR] (HSQLDB Server @d095833) at org.hsqldb.Server$ServerThread.run(Unknown Source)
2014-02-23 22:57:43,424 INFO [STDOUT] (HSQLDB Server @7b782609) [Server@7b782609]: From command line, use [Ctrl]+[C] to abort abruptly
In this case it's unable to stop the second database. Server log:
2014-02-23 22:57:53,791 DEBUG [org.jboss.system.ServiceController] (WorkerThread#1[10.16.92.123:45615]) stopping service: jboss:service=Hypersonic,database=haLocalDB2
2014-02-23 22:57:53,791 DEBUG [org.jboss.jdbc.HypersonicDatabase] (WorkerThread#1[10.16.92.123:45615]) Stopping jboss:service=Hypersonic,database=haLocalDB2
2014-02-23 22:58:38,781 DEBUG [com.arjuna.ats.arjuna.logging.arjLogger] (Thread-16) TransactionReaper::check ()
No log record that the database was stopped and no more log record about haLocalDB1 or haLocalDB2 at alll in this case.