Current groovy scripts for preparing various server configuration for tests remove console handler and set logging only to file.
This might be convenient for passing testsuite and/or for local run. For CI job or for debugging purposes it is often useful to have whole output (server log and test log) in one place to have context. So making the removal optional seems better to me.