Skip to content

feat(benches): add benchmarks for historic and latest events scanning #254

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
0xNeshi merged 41 commits into from
Jan 21, 2026
Merged

feat(benches): add benchmarks for historic and latest events scanning #254

Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
47fd087
feat(benches): add Criterion benchmarks for historic scanning mode
yug49 Dec 13, 2025
329e2a4
Add latest events scanning benchmark
yug49 Dec 13, 2025
988adea
Update Cargo.lock
yug49 Dec 13, 2025
8ff77f3
feat(benches): optimize benchmarks and simplify BenchConfig API
yug49 Dec 17, 2025
fa67e5b
chore: update Cargo.lock with latest dependency versions
yug49 Dec 17, 2025
7ec2a3d
Merge branch 'OpenZeppelin:main' into feat/benchmarks
yug49 Dec 21, 2025
28c052c
feat: add Bencher CI integration for performance tracking
yug49 Dec 21, 2025
f7a3d81
fix: remove invalid --noplot flag from benchmark command
yug49 Dec 21, 2025
70c6b17
perf: run benchmarks in parallel jobs to avoid disk space issues
yug49 Dec 21, 2025
b8146e8
fix: add disk cleanup step to free space before benchmarks
yug49 Dec 21, 2025
a53baef
perf: reduce latest events benchmark from 100K to 50K events
yug49 Dec 21, 2025
e541a36
fix: correct Bencher integration for baseline tracking
yug49 Dec 21, 2025
651bf30
fix: use dynamic branch name in Bencher upload
yug49 Dec 21, 2025
44e4ead
fix: remove --ci-only flag from PR tracking workflow
yug49 Dec 21, 2025
d5d7e9e
Update .github/workflows/benchmarks.yml
yug49 Dec 22, 2025
4825627
Update .github/workflows/benchmarks.yml
yug49 Dec 22, 2025
6a1e923
Update .github/workflows/benchmarks.yml
yug49 Dec 22, 2025
6f036a4
Merge branch 'OpenZeppelin:main' into feat/benchmarks
yug49 Dec 22, 2025
23c741c
refactor: update benchmark config and remove PR workflows
yug49 Dec 22, 2025
dc8f23d
Update .github/workflows/benchmarks.yml
yug49 Dec 25, 2025
798f9c5
Merge branch 'OpenZeppelin:main' into feat/benchmarks
yug49 Dec 25, 2025
ec4ed63
Remove log count tracking and assertion from historic scanning benchmark
yug49 Dec 25, 2025
78ed3bd
Rename BenchCounter to Counter
yug49 Dec 25, 2025
97cc1d9
bench: add 5s warm-up time to benchmark groups
yug49 Dec 25, 2025
4b71d12
feat: use singleton tokio runtime in benchmarks
yug49 Dec 25, 2025
ae58054
refactor(benches): replace panics with proper error handling
yug49 Dec 26, 2025
29acfb8
Update .github/workflows/benchmarks.yml
yug49 Dec 26, 2025
089d5af
fix: make benchmark jobs consistent with dependency versions
yug49 Dec 26, 2025
bb81e8d
feat: add benchmarking system using anvil dump files
yug49 Dec 29, 2025
c84172d
fix: increase benchmark measurement time to 200s
yug49 Dec 29, 2025
6b5141c
Update benches/benches/historic_scanning.rs
yug49 Dec 29, 2025
202ee64
fix: restore .clone() for provider in historic benchmark
yug49 Dec 29, 2025
6e74b55
Update .github/workflows/benchmarks.yml
yug49 Jan 20, 2026
8a2dc23
Update .github/workflows/benchmarks.yml
yug49 Jan 20, 2026
0dbf27f
Update benches/dumps/state_100000.metadata.json
yug49 Jan 20, 2026
16642f6
fix: apply --err flag only on manual workflow dispatch
yug49 Jan 20, 2026
3b34076
refactor: remove unnecessary sleep before Anvil shutdown
yug49 Jan 20, 2026
afd1c48
chore: resolve merge conflicts
yug49 Jan 20, 2026
dac85ae
Merge branch 'main' into feat/benchmarks
yug49 Jan 20, 2026
18cfe68
fix: update benchmarks to use robust-provider as direct dependency
yug49 Jan 20, 2026
1181f46
fix: remove --err flag from benchmark workflow
yug49 Jan 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
52 changes: 22 additions & 30 deletions .github/workflows/benchmarks.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,31 +42,27 @@ jobs:

steps:
- name: Harden the runner (Audit all outbound calls)
uses: step-security/harden-runner@0634a2670c59f64b4a01f0f96f84700a4088b9f0 # v2.12.0
uses: step-security/harden-runner@20cf305ff2072d973412fa9b1e3a4f227bda3c76 # v2.14.0
with:
egress-policy: audit

- name: Free up disk space
run: |
sudo rm -rf /usr/share/dotnet
sudo rm -rf /opt/ghc
sudo rm -rf "/usr/local/share/boost"
sudo rm -rf /usr/local/lib/android
df -h

- name: Checkout repository
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8

- name: Install Rust toolchain
uses: actions-rust-lang/setup-rust-toolchain@1780873c7b576612439a134613cc4cc74ce5538c # v1.15.2

- name: Install Foundry (Anvil)
uses: foundry-rs/foundry-toolchain@v1
with:
version: stable
uses: foundry-rs/foundry-toolchain@8b0419c685ef46cb79ec93fbdc131174afceb730 # v1.6.0

- name: Install Bencher CLI
uses: bencherdev/bencher@main
uses: bencherdev/bencher@2f1532643adc0e69e52acaec936d227ff14da24f # v0.5.9

- name: Decompress benchmark state dumps
run: |
echo "Decompressing Anvil state dumps..."
gunzip -k benches/dumps/*.json.gz
ls -lh benches/dumps/

- name: Run historic benchmarks and track with Bencher
env:
Expand All @@ -76,7 +72,7 @@ jobs:
bencher run \
--project "$BENCHER_PROJECT" \
--token "$BENCHER_API_TOKEN" \
--branch "${{ github.ref_name }}" \
--branch main \
--testbed ubuntu-latest \
--threshold-measure latency \
--threshold-test t_test \
Expand All @@ -97,31 +93,27 @@ jobs:

steps:
- name: Harden the runner (Audit all outbound calls)
uses: step-security/harden-runner@0634a2670c59f64b4a01f0f96f84700a4088b9f0 # v2.12.0
uses: step-security/harden-runner@20cf305ff2072d973412fa9b1e3a4f227bda3c76 # v2.14.0
with:
egress-policy: audit

- name: Free up disk space
run: |
sudo rm -rf /usr/share/dotnet
sudo rm -rf /opt/ghc
sudo rm -rf "/usr/local/share/boost"
sudo rm -rf /usr/local/lib/android
df -h

- name: Checkout repository
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8

- name: Install Rust toolchain
uses: actions-rust-lang/setup-rust-toolchain@1780873c7b576612439a134613cc4cc74ce5538c # v1.15.2

- name: Install Foundry (Anvil)
uses: foundry-rs/foundry-toolchain@v1
with:
version: stable
uses: foundry-rs/foundry-toolchain@8b0419c685ef46cb79ec93fbdc131174afceb730 # v1.6.0

- name: Install Bencher CLI
uses: bencherdev/bencher@main
uses: bencherdev/bencher@2f1532643adc0e69e52acaec936d227ff14da24f # v0.5.9

- name: Decompress benchmark state dumps
run: |
echo "Decompressing Anvil state dumps..."
gunzip -k benches/dumps/*.json.gz
ls -lh benches/dumps/

- name: Run latest events benchmarks and track with Bencher
env:
Expand All @@ -131,7 +123,7 @@ jobs:
bencher run \
--project "$BENCHER_PROJECT" \
--token "$BENCHER_API_TOKEN" \
--branch "${{ github.ref_name }}" \
--branch main \
--testbed ubuntu-latest \
--threshold-measure latency \
--threshold-test t_test \
Expand Down
142 changes: 0 additions & 142 deletions .github/workflows/pr_benchmarks_run.yml
View file
Open in desktop

This file was deleted.

79 changes: 0 additions & 79 deletions .github/workflows/pr_benchmarks_track.yml
View file
Open in desktop

This file was deleted.

4 changes: 4 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
/target
/examples/**/target
.DS_Store

# Benchmark dumps - only commit compressed files
benches/dumps/*.json
!benches/dumps/*.metadata.json
Loading