Running hotrod tests on OSX fails with malloc error

The module server/hotrod fails to compile with a very nasty JVM crash:

%mvn clean install -e
[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Infinispan Hot Rod Server 7.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] — maven-clean-plugin:2.5:clean (default-clean) @ infinispan-server-hotrod —
[INFO] Deleting /Users/veleno/workspace-git/infinispan/server/hotrod/target
[INFO]
[INFO] — maven-enforcer-plugin:1.0:enforce (enforce-java) @ infinispan-server-hotrod —
[INFO]
[INFO] — maven-remote-resources-plugin:1.1:process (attach-license) @ infinispan-server-hotrod —
[INFO] Setting property: classpath.resource.loader.class => 'org.codehaus.plexus.velocity.ContextClassLoaderResourceLoader'.
[INFO] Setting property: velocimacro.messages.on => 'false'.
[INFO] Setting property: resource.loader => 'classpath'.
[INFO] Setting property: resource.manager.logwhenfound => 'false'.
[WARNING] org.apache.velocity.runtime.exception.ReferenceException: reference : template = META-INF/DEPENDENCIES.txt.vm [line 20,column 14] : $license.name is not a valid reference.
[INFO]
[INFO] — maven-resources-plugin:2.6:resources (default-resources) @ infinispan-server-hotrod —
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 2 resources
[INFO]
[INFO] — maven-scala-plugin:2.15.2:compile (default) @ infinispan-server-hotrod —
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[INFO] /Users/veleno/workspace-git/infinispan/server/hotrod/src/main/scala:-1: info: compiling
[INFO] Compiling 23 source files to /Users/veleno/workspace-git/infinispan/server/hotrod/target/classes at 1389828713500
[INFO] compiler plugin: BasicArtifact(com.typesafe.genjavadoc,genjavadoc-plugin_2.10.2,0.5)
[WARNING] warning: there were 1 deprecation warning(s); re-run with -deprecation for details
[WARNING] one warning found
[INFO] prepare-compile in 0 s
[INFO] compile in 11 s
[INFO]
[INFO] — maven-compiler-plugin:3.0:compile (default-compile) @ infinispan-server-hotrod —
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /Users/veleno/workspace-git/infinispan/server/hotrod/target/classes
[WARNING] /Users/veleno/workspace-git/infinispan/server/hotrod/src/main/scala/org/infinispan/server/hotrod/logging/JavaLog.java: /Users/veleno/workspace-git/infinispan/server/hotrod/src/main/scala/org/infinispan/server/hotrod/logging/JavaLog.java uses or overrides a deprecated API.
[WARNING] /Users/veleno/workspace-git/infinispan/server/hotrod/src/main/scala/org/infinispan/server/hotrod/logging/JavaLog.java: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] — maven-scala-plugin:2.15.2:compile (compile) @ infinispan-server-hotrod —
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] — animal-sniffer-maven-plugin:1.9:check (default) @ infinispan-server-hotrod —
[INFO] Checking unresolved references to org.codehaus.mojo.signature:java16:1.0
[INFO]
[INFO] >>> exec-maven-plugin:1.2.1:java (serialize_component_metadata) @ infinispan-server-hotrod >>>
[INFO]
[INFO] — maven-enforcer-plugin:1.0:enforce (enforce-java) @ infinispan-server-hotrod —
[INFO]
[INFO] <<< exec-maven-plugin:1.2.1:java (serialize_component_metadata) @ infinispan-server-hotrod <<<
[INFO]
[INFO] — exec-maven-plugin:1.2.1:java (serialize_component_metadata) @ infinispan-server-hotrod —
[INFO] skipping execute as per configuraion
[INFO]
[INFO] — maven-resources-plugin:2.6:testResources (default-testResources) @ infinispan-server-hotrod —
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO] Copying 2 resources
[INFO]
[INFO] — maven-antrun-plugin:1.7:run (copy_serialized_metadata) @ infinispan-server-hotrod —
[INFO] Skipping Antrun execution
[INFO]
[INFO] — maven-compiler-plugin:3.0:testCompile (default-testCompile) @ infinispan-server-hotrod —
[INFO] Changes detected - recompiling the module!
[INFO]
[INFO] — maven-scala-plugin:2.15.2:testCompile (test-compile) @ infinispan-server-hotrod —
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[INFO] /Users/veleno/workspace-git/infinispan/server/hotrod/src/test/scala:-1: info: compiling
[INFO] Compiling 29 source files to /Users/veleno/workspace-git/infinispan/server/hotrod/target/test-classes at 1389828729403
[INFO] compiler plugin: BasicArtifact(com.typesafe.genjavadoc,genjavadoc-plugin_2.10.2,0.5)
[WARNING] warning: there were 4 deprecation warning(s); re-run with -deprecation for details
[WARNING] one warning found
[INFO] prepare-compile in 0 s
[INFO] compile in 16 s
[INFO]
[INFO] — maven-surefire-plugin:2.14.1:test (default-test) @ infinispan-server-hotrod —
[INFO] Surefire report directory: /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire-reports

-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running TestSuite
Configuring TestNG with: TestNG652Configurator
log4j:WARN No appenders could be found for logger (org.jboss.logging).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Transport protocol stack used = tcp
[testng-CrashedMemberDetectorTest] Test testDetectCrashedMembers(org.infinispan.server.hotrod.CrashedMemberDetectorTest) succeeded.
Test suite progress: tests succeeded: 1, failed: 0, skipped: 0.
[testng-HotRodMarshallingTest] Test testMarshallingBigByteArrayKey(org.infinispan.server.hotrod.HotRodMarshallingTest) succeeded.
Test suite progress: tests succeeded: 2, failed: 0, skipped: 0.
[testng-HotRodMarshallingTest] Test testMarshallingCommandWithBigByteArrayKey(org.infinispan.server.hotrod.HotRodMarshallingTest) succeeded.
Test suite progress: tests succeeded: 3, failed: 0, skipped: 0.
[testng-HotRodDefaultCacheTest] Test testPutOnDefaultCache(org.infinispan.server.hotrod.HotRodDefaultCacheTest) succeeded.
Test suite progress: tests succeeded: 4, failed: 0, skipped: 0.
[testng-HotRodServerTest] Test testValidateProtocolServerNullProperties(org.infinispan.server.hotrod.HotRodServerTest) succeeded.
Test suite progress: tests succeeded: 5, failed: 0, skipped: 0.
[testng-HotRodConfigurationTest] Test testLazyLoadTopology(org.infinispan.server.hotrod.HotRodConfigurationTest) succeeded.
Test suite progress: tests succeeded: 6, failed: 0, skipped: 0.
[testng-HotRodConfigurationTest] Test testRepeatableReadIsolationLevelValidation(org.infinispan.server.hotrod.HotRodConfigurationTest) succeeded.
Test suite progress: tests succeeded: 7, failed: 0, skipped: 0.
[testng-HotRodConfigurationTest] Test testSerializableIsolationLevelValidation(org.infinispan.server.hotrod.HotRodConfigurationTest) succeeded.
Test suite progress: tests succeeded: 8, failed: 0, skipped: 0.
[testng-HotRodSharedContainerTest] Test testSharedContainer(org.infinispan.server.hotrod.HotRodSharedContainerTest) succeeded.
Test suite progress: tests succeeded: 9, failed: 0, skipped: 0.
[testng-HotRod12ReplicationTest] Test testPingWithTopologyAwareClient(org.infinispan.server.hotrod.HotRod12ReplicationTest) succeeded.
Test suite progress: tests succeeded: 10, failed: 0, skipped: 0.
[testng-HotRodSharedContainerTest] Test testTopologyConflict(org.infinispan.server.hotrod.HotRodSharedContainerTest) succeeded.
Test suite progress: tests succeeded: 11, failed: 0, skipped: 0.
[testng-HotRodConfigurationTest] Test testUserDefinedTimeouts(org.infinispan.server.hotrod.HotRodConfigurationTest) succeeded.
Test suite progress: tests succeeded: 12, failed: 0, skipped: 0.
[testng-HotRod12ReplicationTest] Test testReplicatedPut(org.infinispan.server.hotrod.HotRod12ReplicationTest) succeeded.
Test suite progress: tests succeeded: 13, failed: 0, skipped: 0.
[testng-HotRodShutdownTest] Test testPutBasic(org.infinispan.server.hotrod.HotRodShutdownTest) succeeded.
Test suite progress: tests succeeded: 14, failed: 0, skipped: 0.
[testng-HotRodSingleClusteredTest] Test testPutGet(org.infinispan.server.hotrod.HotRodSingleClusteredTest) succeeded.
Test suite progress: tests succeeded: 15, failed: 0, skipped: 0.
java(4580,0x12f145000) malloc: *** error for object 0x12f134440: pointer being freed was not allocated

• • • set a breakpoint in malloc_error_break to debug
      /bin/sh: line 1: 4580 Abort trap: 6 /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home/jre/bin/java -Xmx1024m -XX:MaxPermSize=256m -Dsun.nio.ch.bugLevel -jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefirebooter6031708881646581287.jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire4130857253146854844tmp /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire_01759720057193009119tmp

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 41.325s
[INFO] Finished at: Wed Jan 15 23:32:31 WET 2014
[INFO] Final Memory: 63M/982M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test (default-test) on project infinispan-server-hotrod: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test failed: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd /Users/veleno/workspace-git/infinispan/server/hotrod && /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home/jre/bin/java -Xmx1024m -XX:MaxPermSize=256m -Dsun.nio.ch.bugLevel -jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefirebooter6031708881646581287.jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire4130857253146854844tmp /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire_01759720057193009119tmp
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test (default-test) on project infinispan-server-hotrod: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test failed: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
Command was/bin/sh -c cd /Users/veleno/workspace-git/infinispan/server/hotrod && /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home/jre/bin/java -Xmx1024m -XX:MaxPermSize=256m -Dsun.nio.ch.bugLevel -jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefirebooter6031708881646581287.jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire4130857253146854844tmp /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire_01759720057193009119tmp
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:317)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:152)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test failed: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
Command was/bin/sh -c cd /Users/veleno/workspace-git/infinispan/server/hotrod && /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home/jre/bin/java -Xmx1024m -XX:MaxPermSize=256m -Dsun.nio.ch.bugLevel -jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefirebooter6031708881646581287.jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire4130857253146854844tmp /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire_01759720057193009119tmp
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:115)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: java.lang.RuntimeException: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
Command was/bin/sh -c cd /Users/veleno/workspace-git/infinispan/server/hotrod && /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home/jre/bin/java -Xmx1024m -XX:MaxPermSize=256m -Dsun.nio.ch.bugLevel -jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefirebooter6031708881646581287.jar /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire4130857253146854844tmp /Users/veleno/workspace-git/infinispan/server/hotrod/target/surefire/surefire_01759720057193009119tmp
at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:485)
at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:350)
at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:156)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:809)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:703)
at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:631)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106)
... 20 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException