Document how to add evals

[cte]

Description

Explain how to add new evals exercises.

---

Important

Adds ADDING-EVALS.md to document how to add new coding exercises and support new languages in the Roo Code evals system.

• Documentation:
  • Adds ADDING-EVALS.md to packages/evals explaining how to add new coding exercises.
  • Includes sections on system overview, adding exercises to existing languages, and adding support for new languages.
• Exercise Structure:
  • Describes standardized directory structure for exercises.
  • Provides examples for Python and Go.
• Steps for Adding Exercises:
  • Details steps to create exercise directory, write instructions, create stubs, write tests, and test locally.
• Adding New Language Support:
  • Instructions for updating language configuration, creating prompts, updating Docker configuration, and test runner integration.

^{This description was created by for 9ebc444. You can customize this summary. It will automatically update as commits are pushed.}

[adamhill]

@cte Thanks for documenting all this!

Do you have any guidance for evals + swapping out prompts / modes / footgunning?

I know we don't have UX for it, but I know some peeps that would not be afraid to SSH into a command line and swap things out manually (roo-rocket or roo-bakery CLI's) 🦘 🤟

[cte]

@cte Thanks for documenting all this!

Do you have any guidance for evals + swapping out prompts / modes / footgunning?

I know we don't have UX for it, but I know some peeps that would not be afraid to SSH into a command line and swap things out manually (roo-rocket or roo-bakery CLI's) 🦘 🤟

Good call - I'll document this as well.