You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/contrib.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -85,7 +85,7 @@ PDL executes nightly runs for Run Examples, which searches for all the `.pdl` pr
85
85
86
86
If you wish to make a contribution to PDL and modify or add any PDL program to the repo, it is important that you provide the new expected results for those files so that the Run Examples nightly test does not break.
87
87
88
-
### Local dev
88
+
#### Local dev
89
89
90
90
Under `check`, you can provide a list of files that you want to run Pytest against. If you leave it empty (`check: ` or `check: []`), then by default, Pytest will be executed against all files in the repo, except for those under `skip`. For local development, it is useful to only test against a subset of files so that Pytest executes faster.
91
91
@@ -97,18 +97,18 @@ Run this Pytest command for Run Examples, which is the same command for the nigh
A slight variation in the Python version and OS environment can cause a different LLM response, thus Run Examples might fail because it uses exact string matching for PDL outputs. You can utilize the `update_results` when opening a PR to capture the expected results in the GH Actions environment.
103
103
104
104
When you open a pull request (PR) against the `main` branch, a series of status checks will be executed. Specificially, three Run Examples test will be initiated against the files you have added and modified.
105
105
106
-
- If in the PR, `update_results: false`, Pytest will be executed against those files
106
+
- If in the PR, `update_results: false`,
107
107
- If Pytest fails, you can manually examine the failures and add the results to your PR
108
-
- If in the PR, `update_results: true`, Pytest will be executed against those files.
108
+
- If in the PR, `update_results: true`,
109
109
- If Pytest fails, a GH-Actions bot will push a commit with the new results produced in the GH environment to your PR
110
-
- Additionally, another commit will push `update_results: false`.
111
-
- If you need to make other changes to your PR, make sure to pull the new changes first.
110
+
- Additionally, another commit will push `update_results: false`. This is to ensure that for the nightly test, different results are not committed
111
+
- If you need to make other changes to your PR, make sure to pull the new changes first
112
112
113
113
Your PR should always set `update_results: false` before merging.
0 commit comments