Skip to content

feat: benchmark low, mid and high spec devices via repo device matrix - #998

Open
kilianglas wants to merge 1 commit into
mainfrom
kilianglas/multi-device-bench
Open

feat: benchmark low, mid and high spec devices via repo device matrix#998
kilianglas wants to merge 1 commit into
mainfrom
kilianglas/multi-device-bench

Conversation

@kilianglas

Copy link
Copy Markdown
Contributor
  • Adds crates/zk-mobile-bench/device-matrix.yaml; device profiles now resolve as tags against it via --device-matrix, and the BrowserStack-inventory workarounds (dead Moto G9 Play, incompatible iPhone SE 2020) move from workflow shell / caller defaults into the matrix.
  • New device_profile=all runs the full tier spread — 3 Android + 2 iOS devices — in a single ci run per platform, so summaries and sina plots compare tiers side by side.
  • Resolve steps emit a device-spec list; bench steps pass repeated --devices args. Custom device overrides unchanged.
  • meta.json/LATEST.md record all devices of a snapshot run; docs now tell snapshot runs to use device_profile=all.
  • Verified against mobench v0.2.0 built from source: every profile (incl. all) resolves to the intended devices; all 26 workflow scripts pass bash -n. BrowserStack cost only grows when all is explicitly selected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant