Benchmark link in blog post returns 404

[wh0t-is-love]

Hi!
I wanted to point out that the benchmark link in your blog post (https://github.com/Team-Atlanta/aixcc-afc-benchmark) is returning a 404 error. It might be private or no longer accessible.

Thank you for your work! I'm really interested in exploring/using this benchmark if you could help with access or update the link. 😊

If there’s any additional information on where to find the resource, I’d be grateful!

[DaramG]

Hi,
Thanks for your interest!

We’ve temporarily made the benchmark repository private.
This is because we’re considering how best to protect the benchmark from LLMs learning the answer POVs, vulnerabilities, and patches.
I expect we’ll release it again soon. :)

[ssarfaty]

any ETA on that ?

[ssarfaty]

"I expect we’ll release it again soon. :)"

what is "soon" ?!
it's been almost half a year

[0xdkay]

We are waiting for the organizer's call.