Skip to content

Commit b55b56f

Browse files
authored
Update verdict classifications in moderator.yml (#3669)
1 parent f408f18 commit b55b56f

File tree

1 file changed

+6
-6
lines changed

1 file changed

+6
-6
lines changed

.github/workflows/moderator.yml

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -139,25 +139,25 @@ jobs:
139139
Always return valid JSON with the exact keys requested.
140140
prompt: |
141141
Classify this GitHub item as one of these verdicts.
142-
ok, ai-assisted, ai-gen-needs-review, spam.
142+
ok, ai-assisted, ai-slop, spam.
143143
144144
Return a JSON object with exactly these keys.
145145
verdict, confidence, reasons, evidence, action.
146146
147147
Verdict meanings.
148148
ok, normal contribution, no strong issues.
149149
ai-assisted, contributor disclosed AI use in the template and nothing else looks wrong.
150-
ai-gen-needs-review, contributor claimed no AI use or disclosure is incomplete or contradictory, but signals suggest AI generated text or unreviewed bulk edits, or the PR scope suggests misuse such as sweeping unrelated changes.
150+
ai-slop, contributor claimed no AI use or disclosure is incomplete or contradictory, but signals suggest AI generated text or unreviewed bulk edits, or the PR scope suggests misuse such as sweeping unrelated changes.
151151
spam, promotional, scam, or irrelevant.
152152
153153
How to detect actual disclosure, without guessing.
154154
Count AI disclosure as present only if the body shows a checked box marked with [x] or [X], or the author wrote specific tools, specific models, or a non generic prompt summary.
155155
Do not mark ai-assisted just because the template mentions AI.
156156
157157
MAS contributing alignment checks to consider.
158-
Low effort PRs, generic text, unrelated changes, and sweeping rewrites not justified by the title or described intent should be flagged for ai-gen-needs-review or spam.
158+
Low effort PRs, generic text, unrelated changes, and sweeping rewrites not justified by the title or described intent should be flagged for ai-slop or spam.
159159
If PR change summary shows many files or high churn but the description is minimal or generic, raise suspicion.
160-
If the author disclosed AI use but the PR looks like an unreviewed bulk rewrite, keep ai-assisted only if the description explains why the scope is necessary, otherwise ai-gen-needs-review with an action to request justification and review evidence.
160+
If the author disclosed AI use but the PR looks like an unreviewed bulk rewrite, keep ai-assisted only if the description explains why the scope is necessary, otherwise ai-slop with an action to request justification and review evidence.
161161
162162
Output constraints.
163163
confidence is an integer 0 to 100.
@@ -216,7 +216,7 @@ jobs:
216216
const evidence = Array.isArray(report.evidence) ? report.evidence : []
217217
const action = String(report.action || "").trim()
218218
219-
const allowed = new Set(["ok", "ai-assisted", "ai-gen-needs-review", "spam"])
219+
const allowed = new Set(["ok", "ai-assisted", "ai-slop", "spam"])
220220
if (!allowed.has(verdict)) {
221221
core.setFailed(`Unexpected verdict: ${verdict}`)
222222
return
@@ -228,7 +228,7 @@ jobs:
228228
229229
const labelForVerdict = {
230230
"ai-assisted": "ai-assisted",
231-
"ai-gen-needs-review": "ai-gen-needs-review",
231+
"ai-slop": "ai-slop",
232232
"spam": "spam"
233233
}
234234

0 commit comments

Comments
 (0)