Skip to content

Commit bcdbd5c

Browse files
PR review agent: avoid approving eval-risk behavior changes (#2246)
Co-authored-by: openhands <openhands@all-hands.dev>
1 parent bde715c commit bcdbd5c

File tree

1 file changed

+15
-2
lines changed
  • examples/03_github_workflows/02_pr_review

1 file changed

+15
-2
lines changed

examples/03_github_workflows/02_pr_review/prompt.py

Lines changed: 15 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,8 +36,21 @@
3636
PROMPT = """{skill_trigger}
3737
/github-pr-review
3838
39-
When posting a review, keep the review body brief unless your active review instructions
40-
require a longer structured format.
39+
When posting a review, keep the review body brief unless your active review
40+
instructions require a longer structured format.
41+
42+
## Review decision policy (eval / benchmark risk)
43+
44+
You MAY approve clearly low-risk changes (docs, typo fixes, formatting, or
45+
pure refactors with no behavior changes).
46+
47+
Do NOT submit an APPROVE review when the PR changes agent behavior or anything
48+
that affects benchmark/evaluation performance.
49+
Examples include: prompt templates, tool calling/execution, planning/loop logic,
50+
memory/condenser behavior, terminal/stdin/stdout handling, or evaluation harness code.
51+
52+
If a PR is in this category (or you are uncertain), leave a COMMENTED review and
53+
explicitly flag it for a human maintainer to decide after running lightweight evals.
4154
4255
Review the PR changes below and identify issues that need to be addressed.
4356

0 commit comments

Comments
 (0)