You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: spec/2023-07-draft.md
+5-3Lines changed: 5 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -664,10 +664,12 @@ Their goal is to ensure the integrity and quality of the test data and validatio
664
664
665
665
#### Invalid Input
666
666
667
-
The files under `invalid_input` are invalid inputs.
667
+
The files under `invalid_input` are invalid inputs.
668
668
Unlike in `sample` and `secret`, there are no `.ans` files.
669
669
Each `tc.in` under `invalid_input` must be rejected by at least one input validator.
670
670
671
+
The relevant settings from [Test Case Configuration](#test-case-configuration) (`input_validator_args`, and `description`) can be set in `tc.yaml` for one test case, or `test_group.yaml` for all test cases in the same directory.
672
+
671
673
#### Invalid Output
672
674
673
675
The test cases in `invalid_output` describe invalid outputs for non-interactive problems.
@@ -681,7 +683,7 @@ In particular, for any test case in `invalid_output/`, for example `invalid_outp
681
683
<output_validator_program> tc.in tc.ans dir [arguments] < tc.out # MUST FAIL
682
684
```
683
685
684
-
The directory `invalid_output` must be organized into a tree-like structure similar to `secret` and may contain arguments in`test_group.yaml`files that are passed to the validators.
686
+
The relevant settings from [Test Case Configuration](#test-case-configuration) (`input_validator_args`, `output_validator_args`, and `description`) can be set in `tc.yaml` for one test case, or`test_group.yaml`for all test cases in the same directory.
685
687
686
688
### Valid Output
687
689
@@ -698,7 +700,7 @@ In particular, for any test case in `valid_output/`, for example `valid_output/t
698
700
<output_validator_program> tc.in tc.ans dir [arguments] < tc.out # MUST PASS
699
701
```
700
702
701
-
The directory `valid_output` must be organized into a tree-like structure similar to `secret` and may contain arguments in`test_group.yaml`files that are passed to the validators.
703
+
The relevant settings from [Test Case Configuration](#test-case-configuration) (`input_validator_args`, `output_validator_args`, and `description`) can be set in `tc.yaml` for one test case, or`test_group.yaml`for all test cases in the same directory.
0 commit comments