In addition to #32 and #33 we might want to support launching Docker containers for checker scripts. This would make testing and deployment of checker dependencies easier.
One container per service, team and tick is probably too expensive, but one per service and team (and checker instance) could work. However, we would need some (enhanced or new protocol) to communicate with the containers.