It would be useful to add some functionality similar to TestNG test method timeout [1], so that the test method is terminated once the timeout is exceeded. Performance extension [2] covers different use case - it only checks whether the test finished within the specified time.

[1] org.testng.annotations.Test.timeOut()
[2] org.jboss.arquillian.performance.annotation.Performance.time()