Skip to content

Conversation

@cometkim
Copy link
Owner

@cometkim cometkim commented Aug 5, 2025

@changeset-bot
Copy link

changeset-bot bot commented Aug 5, 2025

⚠️ No Changeset found

Latest commit: 9dc8e80

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@codspeed-hq
Copy link

codspeed-hq bot commented Aug 5, 2025

CodSpeed Performance Report

Merging #93 will improve performances by 28.55%

Comparing claude-4-opus (9dc8e80) with main (b351f2a)

Summary

⚡ 3 improvements
✅ 3 untouched benchmarks

Benchmarks breakdown

Benchmark BASE HEAD Change
grapheme - Code snippet (combined) 239 µs 210.1 µs +13.76%
grapheme - Hindi 86.8 µs 67.6 µs +28.55%
grapheme - Tweet text (combined) 120.4 µs 103.4 µs +16.48%

@codecov
Copy link

codecov bot commented Aug 5, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 100.00%. Comparing base (b351f2a) to head (9dc8e80).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff            @@
##              main       #93   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files           10        10           
  Lines          900       922   +22     
=========================================
+ Hits           900       922   +22     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@cometkim
Copy link
Owner Author

cometkim commented Aug 5, 2025

Slightly better than open models,

But still not working for optimization tasks, even with live benchmarks

@cometkim cometkim closed this Aug 5, 2025
@cometkim cometkim deleted the claude-4-opus branch August 5, 2025 11:22
@cometkim cometkim changed the title PoC: Optimized by Claude 4 Opus PoC: Optimized by OpenCode Aug 5, 2025
@cometkim
Copy link
Owner Author

cometkim commented Aug 5, 2025

Claude Opus 4.1 has just dropped

https://opencode.ai/s/nd6x7ZD9

@cometkim cometkim restored the claude-4-opus branch August 5, 2025 18:30
@cometkim cometkim reopened this Aug 5, 2025
@cometkim cometkim force-pushed the claude-4-opus branch 8 times, most recently from dec2b99 to a669d7a Compare August 5, 2025 21:36
@cometkim
Copy link
Owner Author

cometkim commented Aug 5, 2025

Horizon Beta: https://opencode.ai/s/Lkry3w28

Think removing all comments is a perf improvement

@cometkim
Copy link
Owner Author

cometkim commented Aug 5, 2025

GPT OSS 120B: https://opencode.ai/s/5HnW18a4

@cometkim
Copy link
Owner Author

cometkim commented Aug 5, 2025

Btw, using a precomputed lookup table for the BMP range is an interesting idea. It can potentially improve the perf for most cases.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants