This repository was archived by the owner on Dec 11, 2025. It is now read-only.
Benchmarking with SWE-Bench (or its "Lite" version) #296
Description
Currently there is this benchmark that is designed for full-on repo fixing https://www.swebench.com/
It is used for other software such as OpenDevin, AutoCodeRover, Aider, and SWE-Agent.
Reference for testing: https://github.com/aorwall/SWE-bench-docker