The Byteman Agent is installed in BeforeSuite, which means it will install the Agent in the Client/Container JVM weather the TestClass use Byteman or not. The Agent Installer should be changed to trigger on first use.