Skip to content

Conversation

@ganeshpatelQB
Copy link

@ganeshpatelQB ganeshpatelQB commented Dec 2, 2025

@liamdugan We want to evaluate our model, thanks!!!

@github-actions
Copy link

github-actions bot commented Dec 2, 2025

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

OSQB

Release date: 2025-12-02

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.60 and a TPR of 98.59% at FPR=5% and 95.19% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.91 and a TPR of 99.71% at FPR=5% and 99.07% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@liamdugan
Copy link
Owner

Nice job on the submission! Let me know if you'd like us to merge your results

@liamdugan
Copy link
Owner

@ganeshpatelQB any updates? Happy to merge if you'd like or keep the PR open if you'd like to improve further

@ganeshpatelQB
Copy link
Author

Hey @liamdugan , added a new model for the ealuations.

@github-actions
Copy link

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

QuillBot

Release date: 2025-12-23

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.24 and a TPR of 96.26% at FPR=5% and 88.26% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.68 and a TPR of 98.88% at FPR=5% and 94.79% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@liamdugan
Copy link
Owner

@ganeshpatelQB let me know if you'd like to merge this one

@ganeshpatelQB
Copy link
Author

Hey, thanks, @liamdugan, not yet.
Will give it another try.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants