Skip to content

Commit e264111

Browse files
committed
Clarify test data config for validator test data
1 parent 380e365 commit e264111

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

spec/2023-07-draft.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -664,10 +664,12 @@ Their goal is to ensure the integrity and quality of the test data and validatio
664664
665665
#### Invalid Input
666666
667-
The files under `invalid_input` are invalid inputs.
667+
The files under `invalid_input` are invalid inputs.
668668
Unlike in `sample` and `secret`, there are no `.ans` files.
669669
Each `tc.in` under `invalid_input` must be rejected by at least one input validator.
670670
671+
The relevant settings from [Test Case Configuration](#test-case-configuration) (`input_validator_args`, and `description`) can be set in `tc.yaml` for one test case, or `test_group.yaml` for all test cases in the same directory.
672+
671673
#### Invalid Output
672674
673675
The test cases in `invalid_output` describe invalid outputs for non-interactive problems.
@@ -681,7 +683,7 @@ In particular, for any test case in `invalid_output/`, for example `invalid_outp
681683
<output_validator_program> tc.in tc.ans dir [arguments] < tc.out # MUST FAIL
682684
```
683685

684-
The directory `invalid_output` must be organized into a tree-like structure similar to `secret` and may contain arguments in `test_group.yaml` files that are passed to the validators.
686+
The relevant settings from [Test Case Configuration](#test-case-configuration) (`input_validator_args`, `output_validator_args`, and `description`) can be set in `tc.yaml` for one test case, or `test_group.yaml` for all test cases in the same directory.
685687

686688
### Valid Output
687689

@@ -698,7 +700,7 @@ In particular, for any test case in `valid_output/`, for example `valid_output/t
698700
<output_validator_program> tc.in tc.ans dir [arguments] < tc.out # MUST PASS
699701
```
700702

701-
The directory `valid_output` must be organized into a tree-like structure similar to `secret` and may contain arguments in `test_group.yaml` files that are passed to the validators.
703+
The relevant settings from [Test Case Configuration](#test-case-configuration) (`input_validator_args`, `output_validator_args`, and `description`) can be set in `tc.yaml` for one test case, or `test_group.yaml` for all test cases in the same directory.
702704

703705
### Samples
704706

0 commit comments

Comments
 (0)