Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR adds benchmark results for the deepseek/deepseek-v3.2-exp model.

The following files have been updated:

  • src/benchmark/results.json - Raw benchmark results
  • src/benchmark/validation-results.json - Validation results against human baseline

This PR was automatically generated by the benchmark workflow.

Note: If you don't want to merge this PR, close it and the model will be added to the untested list to prevent re-processing.

@alrocar

@vercel
Copy link

vercel bot commented Sep 29, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
llm-benchmark Ready Ready Preview Comment Sep 29, 2025 5:16pm

@github-actions
Copy link
Contributor Author

Model Rejected

The model deepseek/deepseek-v3.2-exp has been added to the untested models list to prevent automatic re-processing.

What this means:

  • This model will not be automatically benchmarked again
  • It's now in the "untested" category (not failed, just not wanted)
  • You can manually remove it from the untested list if you change your mind

To manage this model:

# Remove from untested list (if you want to try again later)
npm run manage-failed-models remove deepseek deepseek-v3.2-exp

# List all untested models
npm run manage-failed-models list

@alrocar

github-actions bot pushed a commit that referenced this pull request Sep 29, 2025
- Model: deepseek/deepseek-v3.2-exp
- Reason: PR rejected/closed without merging
- PR: #115

This prevents the model from being automatically benchmarked again.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant