Skip to content

Conversation

@richardcsuwandi
Copy link
Contributor

@richardcsuwandi richardcsuwandi commented Aug 4, 2025

This PR integrates AlgoTune tasks into OpenEvolve.

Key Additions

  • Task Adapter: Converts AlgoTune tasks to OpenEvolve format
  • Full Coverage: Supports all 155 AlgoTune tasks
  • Unified Workflow: Consistent setup via initial_program.py, evaluator.py, and config.yaml

Implementation

  • Pulls task config from AlgoTune’s registry
  • Generates evolution-ready code with EVOLVE-BLOCK markers
  • Builds evaluators for correctness and performance
  • Maps AlgoTune parameters to OpenEvolve settings

Example: SVM Task

python create_task.py svm
python ../../../openevolve-run.py ./initial_program.py ./evaluator.py --config ./config.yaml --output openevolve_output/

@CLAassistant
Copy link

CLAassistant commented Aug 4, 2025

CLA assistant check
All committers have signed the CLA.

@ofirpress
Copy link

Hi thank you so much for doing this! Did you obtain any results that beat the ones in the paper?

@richardcsuwandi
Copy link
Contributor Author

richardcsuwandi commented Aug 5, 2025

Hi thank you so much for doing this! Did you obtain any results that beat the ones in the paper?

@ofirpress Thank you for creating such a great benchmark! I'm still running experiments on it, so I don't have results yet, but it's been interesting so far. Would be cool to see others try it too!

@codelion
Copy link
Member

codelion commented Aug 6, 2025

We did benchmark with AlgoTune recently, here are some early results - https://huggingface.co/blog/driaforall/towards-open-evolutionary-agents

@ofirpress
Copy link

@codelion Super cool!!! Looking forward to what you'll discover next there.

@codelion
Copy link
Member

codelion commented Aug 7, 2025

@richardcsuwandi we do not need the full source of all the algotune tasks we can just clone the repo and then use your create_task.py to adapt the task. Can you remove all the existing tasks and update the script so that it can take the location of the algotune repo/folder that ways we can generate the openeolve programs and evaluators as needed.

@richardcsuwandi
Copy link
Contributor Author

@codelion Hi, thanks for the suggestions! I have refactored the AlgoTune task adapter to work with external AlgoTune repositories instead of maintaining duplicate task copies in the OpenEvolve repository.

@codelion
Copy link
Member

I took over this PR to get algotune in the repo. Will be part of the new 0.1.1 release.

@codelion codelion merged commit 599cd54 into algorithmicsuperintelligence:main Aug 13, 2025
3 checks passed
@ofirpress
Copy link

Thanks so much @codelion!

wangcheng0825 pushed a commit to wangcheng0825/openevolve that referenced this pull request Sep 15, 2025
…ndi/main

Add AlgoTune tasks for OpenEvolve
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants