That test used to verify the existence of the attachment part files in tmp dir. Those are created by JBossWS Native only. Btw, later the test has been partially commented out to deal with a Windows file handle issue, basically becoming a test for the existence of the tmp dir. When running against vanilla AS 5.x, that tmp is not created if the native stack is not installed. This revealed the issue.