-
Notifications
You must be signed in to change notification settings - Fork 41
Add OSQB model #70
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Add OSQB model #70
Conversation
|
Eval run succeeded! Link to run: link Here are the results of the submission(s): OSQBRelease date: 2025-12-02 I've committed detailed results of this detector's performance on the test set to this PR. On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.60 and a TPR of 98.59% at FPR=5% and 95.19% at FPR=1%. If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID! |
|
Nice job on the submission! Let me know if you'd like us to merge your results |
|
@ganeshpatelQB any updates? Happy to merge if you'd like or keep the PR open if you'd like to improve further |
|
Hey @liamdugan , added a new model for the ealuations. |
|
Eval run succeeded! Link to run: link Here are the results of the submission(s): QuillBotRelease date: 2025-12-23 I've committed detailed results of this detector's performance on the test set to this PR. On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.24 and a TPR of 96.26% at FPR=5% and 88.26% at FPR=1%. If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID! |
|
@ganeshpatelQB let me know if you'd like to merge this one |
|
Hey, thanks, @liamdugan, not yet. |
@liamdugan We want to evaluate our model, thanks!!!