Add benchmark results for openai/gpt-5-codex #102
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
![cursor[bot]](https://avatars.githubusercontent.com/in/1210556?s=60&v=4){kind=small}
There was a problem hiding this comment.
This is the final PR Bugbot will review for you during this billing cycle
Your free Bugbot reviews will reset on October 2
Details
Your team is on the Bugbot Free tier. On this plan, Bugbot will review limited PRs each billing cycle for each member of your team.
To receive Bugbot reviews on all of your PRs, visit the Cursor dashboard to activate Pro and start your 14-day free trial.
| "numericMatches": 30, | ||
| "avgExactDistance": 0.525909090909091, | ||
| "avgNumericDistance": 0.384980939108282, | ||
| "avgFScore": 0.4819999999999999 |
There was a problem hiding this comment.
Bug: Fictional Model Data in Benchmark Results
The benchmark results file includes data for a non-existent model, openai/gpt-5-codex. This model is fictional (GPT-5 is unreleased, Codex deprecated), suggesting test or placeholder data was accidentally committed. This invalidates benchmark comparisons and provides misleading performance metrics.
Additional Locations (1)
1 participant
This PR adds benchmark results for the openai/gpt-5-codex model.
The following files have been updated:
src/benchmark/results.json- Raw benchmark resultssrc/benchmark/validation-results.json- Validation results against human baselineThis PR was automatically generated by the benchmark workflow.
Note: If you don't want to merge this PR, close it and the model will be added to the untested list to prevent re-processing.
@alrocar