Skip to content

Turn benchmarks into a monorepo #1822

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 100 commits into from
Closed

Turn benchmarks into a monorepo #1822

wants to merge 100 commits into from

Conversation

@cte
Copy link
Collaborator

@cte cte commented Mar 20, 2025

Context

Implementation

Screenshots

before after

How to Test

Get in Touch

@changeset-bot
Copy link

changeset-bot bot commented Mar 20, 2025 •
edited
Loading

⚠️ No Changeset found

Latest commit: 4fe32dc

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@hannesrudolph hannesrudolph moved this from New to PR [Pre Approval Review] in Roo Code Roadmap Mar 21, 2025
cte and others added 26 commits March 31, 2025 02:21
@cte
More progress
689e104
@cte
More progress
a1fb08a
@cte
Dockerize evals (#2157)
53ab683 
* Dockerize evals

* Update README

* Add git config commands

* Increase task time limit

* More progress

* Remove debuggin

* Log cli output to tempfile

* It's working
@diarmidmackenzie @cte
Split webviewMessageHandler out of ClineProvider.ts (#2149)
60437fd
@cte @ellipsis-dev
Update the webview when changing settings via the API (#2143)
3f84296 
* Update the webview when changing settings via the API

* Update src/exports/api.ts

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

---------

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
@mrubens @cte
Add requesty to connect-src (#2155)
a6d6301
@mrubens @cte
Include inference-profile in Bedrock arnRegex (#2156)
dc16241
@R00-B0T @github-actions
@mrubens @cte
Changeset version bump (#2154)
372e27d 
* changeset version bump

* Update CHANGELOG.md

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Matt Rubens <[email protected]>
@mrubens @cte
Revert "feat @-mention window path style & file with space (#1924)" (#…
05c0057 
…2162)

* Revert "feat @-mention window path style & file with space (#1924)"

This reverts commit c62e8f2.

* Add changeset
@R00-B0T @github-actions
@mrubens @cte
Changeset version bump (#2163)
44211a4 
* changeset version bump

* Updating CHANGELOG.md format

* Update CHANGELOG.md

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: R00-B0T <[email protected]>
Co-authored-by: Matt Rubens <[email protected]>
@mrubens @cte
Update app icon (#2166)
f06cd96
@cte
Get rid of VSCodeCommand
6082ec2
@cte
More progress
3298c41
@cte
Merge main
257e14d
@cte
Add install script
a770ff5
@cte
More progress
cd60b34
@cte
More progress
afc1278
@cte
Fix evals repo path
63280ad
@cte
Update README.md
61efee8
@cte
Merge branch 'main' into cte/benchmark-monorepo
9164e5e
@cte
Add mode switch event
238a413
@cte
Looser assertion
0377680
@cte
Merge main
6774890
@cte
Revert these
52cb41e
@cte
Revert these
0a236ad
@cte
Rename folder
4fe32dc
@cte cte closed this Apr 12, 2025
@github-project-automation github-project-automation bot moved this from PR [Pre Approval Review] to Done in Roo Code Roadmap Apr 12, 2025
@cte cte deleted the cte/benchmark-monorepo branch April 12, 2025 05:47
@mrubens mrubens restored the cte/benchmark-monorepo branch May 29, 2025 19:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mrubens mrubens Awaiting requested review from mrubens mrubens will be requested when the pull request is marked ready for review mrubens is a code owner

@jr jr Awaiting requested review from jr jr will be requested when the pull request is marked ready for review jr is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@cte @diarmidmackenzie @mrubens @R00-B0T