Test Thread Leaks aren't clearing in time

The current master and existing PRs have a lot of tests that show as leaking. However they seem to be all waiting on state transfer to complete from stack traces I see. It appears that due to the thread context switching and how many concurrent operations we do there is a delay in their completions. However we should confirm this if so, otherwise it sounds like there is an issue with the threads completing.