My work on WFLY-16620 is revealing that the Hibernate Search tests currently in testsuite/preview/basic fail when the SecurityManager is enabled. They have @BeforeClass methods that are meant to disable them in SM runs but that's not sufficient to prevent failures, as ARQ deploys deployments before executing @BeforeClass methods, and the deployments fail.

We haven't noticed this before because we haven't been running WildFly Preview tests with the SM enabled.