Ensure test runs can be repeated from an IDE

The test execution leaves file system in such state that repetitive test runs caused every but the first one to fail. Ensure that tests can be executed multiple times in a row.