Skip to content

Commit 1b9c4f9

Browse files
authored
PYTHON-5390 Document explicit policy on test skipping for AI/ML Testing Pipeline (#75)
1 parent 1adad95 commit 1b9c4f9

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -182,3 +182,11 @@ For example
182182
```bash
183183
evergreen patch -p ai-ml-pipeline-testing --param REPO_ORG=caseyclements --param REPO_NAME="langchain-mongodb" --param REPO_BRANCH="INTPYTHON-629" -y -d "Increased retries to 4."
184184
```
185+
186+
### Handling Failing Tests
187+
188+
If tests are found to be failing, and cannot be addressed quickly, the responsible team MUST create a JIRA ticket, and disable the relevant tests
189+
in the `config.yml` file, with a comment about the JIRA ticket that will address it.
190+
191+
This policy will help ensure that a single failing integration does not cause noise in the `dbx-ai-ml-testing-pipeline-notifications` that would mask other
192+
failures.

0 commit comments

Comments
 (0)