Skip to content

Set up benchmarks with AirspeedVelocity.jl#6

Merged
Krastanov merged 5 commits intomasterfrom
feature/benchmarks-airspeedvelocity
Jan 18, 2026
Merged

Set up benchmarks with AirspeedVelocity.jl#6
Krastanov merged 5 commits intomasterfrom
feature/benchmarks-airspeedvelocity

Conversation

@Krastanov
Copy link
Member

Summary

  • Remove broken BenchmarkCI workflows that weren't working
  • Add benchmark suite for traversal operations using BenchmarkTools.jl
  • Set up AirspeedVelocity.jl CI workflow to run benchmarks on PRs
  • Update CLAUDE.md with benchmark documentation and guidelines

Benchmark coverage

Current benchmarks cover the traversal function:

  • Swap traversal (different circuit sizes: 10, 100, 1000)
  • No-op traversal (visiting without changes)
  • Combine traversal (reducing circuit by merging operations)
  • Mixed circuits with different gate types
  • Direction comparison (left vs right traversal)

Test plan

  • Verified benchmarks run locally with julia -tauto --project=benchmark -e 'include("benchmark/benchmarks.jl"); run(SUITE)'
  • CI workflow will run on this PR to verify AirspeedVelocity setup

🤖 Generated with Claude Code

Krastanov and others added 4 commits January 18, 2026 12:58
These workflows use the outdated BenchmarkCI package which doesn't work
correctly. They will be replaced with AirspeedVelocity.jl benchmarks.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Adds benchmarks for:
- Swap traversal (moving operations around)
- No-op traversal (visiting without changes)
- Combine traversal (reducing circuit by merging)
- Mixed circuits with different gate types
- Direction comparison (left vs right traversal)

Uses BenchmarkTools.jl with evals=1 since traversal modifies
circuits in-place.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Runs benchmarks on PRs and posts results as PR comments.
Uses the MilesCranmer/AirspeedVelocity.jl action.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Add benchmark folder to project structure
- Add benchmarks section with local run instructions
- Document when to add benchmarks and file structure guidelines
- Add workflow step to remind about benchmarks for new functionality

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@codecov
Copy link

codecov bot commented Jan 18, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 78.60%. Comparing base (2fc7840) to head (e553bf9).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master       #6   +/-   ##
=======================================
  Coverage   78.60%   78.60%           
=======================================
  Files           4        4           
  Lines         187      187           
=======================================
  Hits          147      147           
  Misses         40       40           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Krastanov Krastanov closed this Jan 18, 2026
@Krastanov Krastanov reopened this Jan 18, 2026
@Krastanov Krastanov merged commit 7af6dd1 into master Jan 18, 2026
16 of 19 checks passed
@Krastanov Krastanov deleted the feature/benchmarks-airspeedvelocity branch January 18, 2026 18:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant