A possible solution would be:

• jmx disabled by default (The TestCacheManagerFactory might do this)
• new TestCacheManagerFactory method would receive the jmx domain. It will keep track of all active domains and won't allow two CacheManagers with same domain name.