ConstantPermissionMapperTestCase (testsuite/integration/elytron) fails when some other test fails before:
After modifying SpengoMechTestCase to fail during ServerSetup (when I change path in cli.sendLine("/subsystem=elytron/kerberos-security-factory=... to filepath which does not exists), independent test ConstantPermissionMapperTestCase start to fail too because of DeploymentException.
Reason is, ServerSetup of ConstantPermissionMapperTestCase is not started, so Deployment fails.

Edit: the same occurs in opposite case - when ConstantPermissionMapperTestCase setup fails (for example when I change withRoleDecoder("groups-to-roles") to withRoleDecoder("groups-to-roles2")), SpengoMechTestCase's SetupTask will not run too, and tests fails on DeploymentException too (resource crated as part of setup task does not exists).

mvn clean test -Dtest=org.wildfly.test.integration.elytron.http.SpnegoMechTestCase,org.wildfly.test.integration.elytron.permissionmappers.ConstantPermissionMapperTestCase -Dsurefire.runOrder=alphabetical

As the problem is SetupTask is not started in consequences of different test SetupTask behavior (fail), this is probably wildfly-arquillian issue.