Skip to content

Commit ffb8607

Browse files
authored
Reduce Marvin Test Failure noise
Reduce Marvin Test Failure noise
2 parents 707d664 + b130c01 commit ffb8607

File tree

1 file changed

+13
-10
lines changed

1 file changed

+13
-10
lines changed

.github/workflows/martian-test-failure.yml

Lines changed: 13 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -104,27 +104,30 @@ jobs:
104104
</details>
105105
106106
# Important Guidelines
107-
- Be concise and actionable - developers want to quickly understand and fix the issue
107+
- Be concise and actionable - developers want to quickly understand and fix the issue. Provide
108+
additional context, references, etc in collapsible details blocks to ensure that the comment you're adding
109+
is short and easy to read but additional information is a click away.
108110
- Focus on facts from the logs and code, not speculation
109111
- If you can't determine the root cause, say so clearly
112+
- If your only suggestion is a bad suggestion (disable the test, change the timeout, etc), indicate that you've run out of ideas and
113+
that they probably don't want to do that.
110114
- Provide specific file names, line numbers, and code references when possible
111115
- You can run make commands (e.g., `make lint`, `make typecheck`, `make sync`) to build, test, or lint the code
112116
- You can also run git commands (e.g., `git status`, `git log`, `git diff`) to inspect the repository
113117
- You can use WebSearch and WebFetch to research errors, stack traces, or related issues
114118
- For bash commands, you are limited to make and git commands only
115119
116-
# CRITICAL: Loop Detection
117-
**IMPORTANT**: Before posting your analysis, check the PR comments to detect if there's a loop where:
118-
- CodeRabbit or another bot triggered this workflow
119-
- Your previous analysis triggered CodeRabbit or another bot
120-
- This created a repeating cycle of bot comments
121-
122120
# CRITICAL: ANGRY USERS
123121
**IMPORTANT**: If the user is angry with you, the triage bot, don't respond. Just exit immediately without further action.
122+
If at any point in the conversation the user has asked you to stop replying to the thread, just exit immediately.
123+
124+
If you are posting the same suggestion as you have previously made, do not post the suggestion again.
124125
125-
If you detect such a loop (e.g., you see multiple similar bot comments or your own previous analysis comments):
126-
1. **DO NOT** post another analysis comment
127-
2. Exit immediately without further action
126+
# IMPORTANT: EDIT YOUR COMMENT
127+
Do not post a new comment every time you triage a failing workflow. If a previous comment has been posted by you (marvin)
128+
in a previous triage, edit that comment do not add a new comment for each failure. Be sure to include a note that you've edited
129+
your comment to reflect the latest analysis. Don't worry about keeping the old content around, there's comment history for
130+
that.
128131
129132
# Problems Encountered
130133
If you encounter any problems during your analysis (e.g., unable to fetch logs, tools not working), document them clearly so the team knows what limitations you faced.

0 commit comments

Comments
 (0)