-
Notifications
You must be signed in to change notification settings - Fork 6
Terminology
elavoie edited this page Jan 29, 2016
·
6 revisions
| Terminology | Definition |
|---|---|
| artifact | Elementary component with a file representation and associated JSON meta-information |
| repository | Collection of artifacts on the file system |
| action | Operation that can be performed on artifact(s) |
| Artifacts | Definition |
|---|---|
| benchmark | Abstract algorithm that performs a useful numerical task |
| build | Runnable implementation that is ready to be executed on an environment and the configuration that was used to create it |
| compiler | Program that processes a benchmark implementation to produce a new implementation (in the same or a different language) |
| configuration | Combination of artifacts and their associated parameters necessary for performing an action |
| environment | Additional virtualization layer executing on top of a platform (or another environment) a benchmark might execute on |
| experiment | Combination of a configuration and experimental parameters that determine what, where, and how an implementation is to be executed |
| implementation | Realization of a benchmark in a specific language (ex: C, assembly) and packaged in a particular format (ex: text file, binary, webpage) which might be directly runnable or not |
| platform | Hardware and (native) OS combination for the machine to run benchmarks on |
| report | Collection of figure(s) and the configuration that was used to produce them |
| run | Execution report (ex: timing results, memory usage, etc.) and the experiment that produced it |
| Actions | Definition |
|---|---|
| building | Creation, from a configuration, of an implementation that is executable on an environment |
| installing | Retrieval, and initialization of an artifact in the repository |
| reporting | Aggregation of multiple compatible runs, selection of significant results, and production of human-readable figure(s) from those results |
| running | Execution of an implementation on a stack of environment(s), and production of a run from the monitoring of its execution |
- Introduction
- Terminology | [Conventions](Benchmark Organization Conventions)
- Installation
- [Configuration](Add local platform information)
- Contribution
- [Add a new benchmark](Adding a new benchmark and implementation to an existing suite)
- [Configure implementation.json](Adding multiple parameters in implementation.json)
- [Add a new compiler](Adding a new compiler) // To-do
- [Add a new implementation](Adding a new implementation) // To-do
- Development // To-do
- [Work with commands](Work with commands)
- [Customize jobs](Customize jobs)