Skip to content

Conversation

@cte
Copy link
Collaborator

@cte cte commented Mar 31, 2025

Context

This was not very easy 😢

Implementation

Screenshots

before after

How to Test

Get in Touch


Important

Dockerized Roo Code evaluations with updated Dockerfile, scripts, and documentation for streamlined container-based execution.

  • Dockerization:
    • Added Docker support for Roo Code evaluations in Dockerfile.
    • Updated .dockerignore to include necessary files for Docker build.
    • Added Docker-related scripts in package.json for building and running containers.
  • Code Changes:
    • Modified index.ts in apps/cli to handle task execution and concurrency.
    • Updated runs.ts in apps/web to spawn processes with logging.
    • Adjusted api.ts to handle IPC commands and task management.
    • Increased TERMINAL_SHELL_INTEGRATION_TIMEOUT in Terminal.ts to 15000ms.
  • Documentation:
    • Updated README.md with new Docker setup instructions.
    • Removed outdated local debugging instructions.

This description was created by Ellipsis for 8470280. It will automatically update as commits are pushed.

@changeset-bot
Copy link

changeset-bot bot commented Mar 31, 2025

⚠️ No Changeset found

Latest commit: 8470280

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Mar 31, 2025
@ellipsis-dev
Copy link
Contributor

ellipsis-dev bot commented Mar 31, 2025

The pull request involves several changes related to Dockerization and improvements in error handling and logging. While these changes are interconnected as part of the Dockerization process, it might be beneficial to consider splitting the pull request if there are distinct, unrelated changes. For instance, if the error handling and logging improvements are not directly tied to the Dockerization, they could be separated into a different pull request. This would make the review process more manageable and focused. Please consider if any changes can be logically separated and, if so, create smaller pull requests for them.

@dosubot dosubot bot added the enhancement New feature or request label Mar 31, 2025
try {
console.log("[cli#run]", result)
// eslint-disable-next-line @typescript-eslint/no-unused-vars
} catch (error) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Avoid empty catch blocks. Instead of commenting out the error log (lines 151-155), consider logging error details using a structured logging method so that errors aren’t silently ignored.

```sh
pnpm cli run [cpp|go|java|javascript|python|rust|all] [<exercise>|all]
```
Navigation to [localhost:3000](http://localhost:3000/) in your browser.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider changing 'Navigation to localhost:3000 in your browser.' to 'Navigate to localhost:3000 in your browser.' for a clearer call to action.

Suggested change
Navigation to [localhost:3000](http://localhost:3000/) in your browser.
Navigate to [localhost:3000](http://localhost:3000/) in your browser.

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Mar 31, 2025
@cte cte merged commit 53ab683 into cte/benchmark-monorepo Apr 1, 2025
@cte cte deleted the cte/docker-evals branch April 1, 2025 03:24
@github-project-automation github-project-automation bot moved this from New to Done in Roo Code Roadmap Apr 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants