I have tried updating surefire version, declared in weld-parent project, and this causes some awkward testsuite behaviour on tests-arquillian.
We are now on 2.19.1 version which works fine, but anything newer doesn't.
To reproduce this, just update plugin and run mvn clean install on tests-arquillian (other tests such as TCK will likely be affected as well). Amongst test output, there are three weird things:
- Number of tests is about twice as big
- Ouput contains failures of tests that shouldn't have been executed in the first place (in-container tests with @Category that is excluded)
- Output contains re-run of tests which shouldn't happen with default setting and what's worse it re-runs tests that passed the first run (and they fail on second)
I wasn't yet able to nail this down. The suspects are either plugin setup (which I tried playing with but to no avail so far) and maybe some cooperation between Arquillian and surefire which is a black box to me yet.
Once resolved, we should update the plugin on both, 3.1 and master branches.