Dockerify Everything

[msmith-techempower]

Abstract

Move the suite away from the current methodology of using scripting files to handle dependencies, installation into the $IROOT directory for sandboxing, and instead use Docker CE.

Reasoning

1. Installing software to $IROOT is hard (much harder than apt-get) and prone to difficult-to-identify errors
2. Many dependencies use apt-get already for various reasons, and migrating away from globally installed software is hard (much harder than allowing apt-get)
3. Docker provides a much cleaner reusable sandbox environment that has been fire-tested much more-so than our in-house implementation
4. In testing, Docker does not appear to incur much (if any) performance penalty

Ongoing work is in this branch.

Action Items (in no particular order)

• Create base tfb dockerfile with as minimal software installed as possible
• Implement base dockerfile to have an entrypoint of TFBReapear so that everything is run through him
• Create POC using only gemini and the dockerfile(s) required to build and run in console mode
• Create POC suite implementation using the dockerfile(s) require to build and run gemini and perform a verification
• Implement stable mechanism for finding running docker containers and stopping them
• Implement stable mechanism for removing docker images for a specific test after the container is stopped (there is no reason to keep a gemini image after we have run the gemini test)
• Create docker folder hierarchy that would allow for similar grouping to our current dependency hierarchy (docker/languages, docker/frameworks, etc)
• Change benchmark_config.json to specify a dockerfile instead of a setup.sh
• Implement database mechanisms currently handled by fw_depends (which is being deprecated and removed with the docker work)
• Implement client mechanisms currently handled by fw_depends (installing wrk on the remote client, etc)
• Update vagrant install to call tfb --init --quiet to initialize the software on the database and client machine (localhost)
• Fix docker build process to split the output to the console as well as the log (see framework_test.py for an example of this; this is needed to see output in Travis-CI, for example)
• Implement error-handling for an unfound dependency (docker build... cannot find the file referenced in FROM something in a dockerfile)
• Implement error-handling for a docker build failing (docker build... fails for some reason)
• Implement error-handling for a test not starting properly (docker run... fails for some reason)
• Clean out prerequisites.sh since it will no longer require most of the packages listed (they will move to the various dockerfiles)
• Update prerequisites.sh to install Rust and build TFBReaper
• Update prerequisites.sh to install Docker CE
• ... Migrate all the shell scripts to dockerfiles
• Updated scaffolding to reflect the docker implementation (instructions, default files, etc)
• Update documentation to reflect all these changes
• Set ulimit on containers (see this)
• Update --clean-all implementation to delete all docker images