[Umbrella Issue] Many tests use Thread.sleep instead of synchronization primitives #1223
Description
Many of our tests simply have a Thread.sleep(duration) when testing multi-threaded code. This is inherently flaky.
Instead we should use synchronization classes (generally Semaphore) to synchronized the tests which is both faster in the general case and not flaky in the extreme case.