Skip to content

[ci] Baseline benchmark: runs-on.com runners#18888

Closed
rustielin wants to merge 3 commits intomainfrom
rustielin/benchmark-runs-on-baseline
Closed

[ci] Baseline benchmark: runs-on.com runners#18888
rustielin wants to merge 3 commits intomainfrom
rustielin/benchmark-runs-on-baseline

Conversation

@rustielin
Copy link
Contributor

Summary

Test plan

🤖 Generated with Claude Code

rustielin and others added 3 commits February 27, 2026 13:41
…ners

Replace runs-on.com runner labels with GitHub-managed larger runners
using custom images (pre-installed Aptos build deps). The migration is
controlled by the USE_CUSTOM_APTOS_IMAGE_RUNNER repository variable:

- When 'true': uses *-aptos-image-ubuntu22-x64 runners (custom image)
- Otherwise: falls back to *-gh-ubuntu22-x64 runners (standard image)

Runner mapping:
- cpu=64 runs-on.com -> 64cpu-aptos-image-ubuntu22-x64
- cpu=16 runs-on.com -> 32cpu-aptos-image-ubuntu22-x64 (min custom size)
- cpu=4  runs-on.com -> 32cpu-aptos-image-ubuntu22-x64 (min custom size)
- c5ad.8xlarge runs-on.com -> 32cpu-aptos-image-ubuntu22-x64

Excludes workflow-run-docker-rust-build.yaml (uses runs-on/snapshot).
Removes buildtools/packer/ (moved to internal-ops).
Keeps .github/runs-on.yml for rollback capability.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
These system libraries are required by the hidapi and dw-sys crates.
They were previously provided by the runs-on.com custom image but are
missing from standard GitHub runner images.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…ison

Keep actionlint, rust-setup, and buildtools changes from the migration
PR, but revert workflow files to use original runs-on.com runners.
This creates an apples-to-apples comparison against the GH runner
migration PR by ensuring the same targeted tests run on both.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@rustielin
Copy link
Contributor Author

Benchmark complete. GH custom image runners are ~1.3 min faster than runs-on.com per job. Closing baseline comparison PR.

@rustielin rustielin closed this Feb 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant