[Main] launcher/allocator rewrite #611
Description
Context
Currently, the launcher/allocator is written in a way that's not very extensible and have many hard-coded constants not modifiable.
This has caused issues on clusters that are not configured the same way as our development cluster (see for example, #590 ). And also hinders our ability to support new hardware configurations internally.
A rewrite of the launcher/allocator is required for us to make the launcher more configurable both for external customers and internal usage.
To do
Please fill in details here @allenwang28