Skip to content

README.md

Latest commit

 

History

History
29 lines (24 loc) · 2.66 KB

README.md

File metadata and controls

29 lines (24 loc) · 2.66 KB

Benchmarks

The following benchmark suites are included, some of which required modifications to work with WASM/WASI:

  • polybench: Polybench; 90 benchmarks (30 benchmarks x 3 sizes)
  • mibench: Mibench; 35 benchmarks (18 benchmarks having small and large sizes except one)
  • cortex: UCSD CortexSuite, excluding the San Diego Vision Benchmark suite; 24 benchmarks (8 benchmarks x 3 sizes)
  • vision: San Diego Vision Benchmark Suite; 27 benchmarks (9 benchmarks x 3 sizes)
  • libsodium: Libsodium Benchmarks, available pre-compiled here; 70 benchmarks (15 benchmark types, various configurations per type)
  • apps: benchmarks made from common real-world applications:
    • python: the CPython interpreter compiled to WASM running 12 python scripts taken from the Codon benchmark suite. Note that WASM/WASI-compiled python currently does not support pip-installed modules; complicated imports are also somewhat flaky.
    • ffmpeg: FFmpeg standalone executable compiled to WASM, supporting zlib and x264 with 6 different operations.
    • lua: Lua interpreter, running 5 different scripts; requires WALI instead of only WASI to run.
    • sqlite3: SQLite running 5 different queries; requires WALI.

Setup

  1. Install the WASI SDK:

    wget https://github.com/WebAssembly/wasi-sdk/releases/download/wasi-sdk-20/wasi-sdk-20.0-linux.tar.gz
tar xvf wasi-sdk-20.0-linux.tar.gz
sudo cp -r wasi-sdk-20.0 /opt/wasi-sdk

  2. Build benchmarks:

    • make: build all benchmarks; saved to ./wasm. Any necessary data files are saved to ./data. Since paths are hard-coded into benchmarks, benchmarks must be executed with ./benchmarks as a WASI pre-opened directory (or equivalently, wasm and data in WASI working directory).
    • MODE=native make: build all benchmarks natively using gcc for comparison; saved to ./native.
    • make {benchmark}: make benchmark suites individually.
    • make clean: remove ./wasm and ./data.