Skip to content

Commit c81e493

Browse files
Etienne Vouganiemela
authored andcommitted
Refactor test group scoring to account for secret not being a test group
1 parent dd63d01 commit c81e493

File tree

1 file changed

+6
-3
lines changed

1 file changed

+6
-3
lines changed

spec/2023-07-draft.md

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1342,20 +1342,23 @@ It is a judge error if:
13421342

13431343
#### Scoring Test Data Groups
13441344

1345-
The score of `secret` is determined by its groups or test cases (it can only have one or the other).
13461345
The score of a test data group is determined by its test cases.
13471346
The score depends on the aggregation mode, which is either `pass-fail`, `sum`, or `min`.
13481347

13491348
- If a group uses `pass-fail` aggregation, the group must have bounded maximum score.
13501349
If the submission receives an accepted verdict for all test cases in the group,
13511350
the score of the group is equal to its maximum possible score.
13521351
Otherwise the group score is 0.
1353-
- If a group uses `sum` aggregation, the group score is the sum of the scores of its test cases or groups.
1352+
- If a group uses `sum` aggregation, the group score is the sum of the scores of its test cases.
13541353
- If a group uses `min` aggregation, then the group score is the minimum of these scores.
13551354

1355+
The score of `secret` is determined by its groups or test cases (it can only have one or the other).
1356+
- If `secret` uses `pass-fail` aggregation, then `secret` must have bounded maximum score. If the submission receives an accepted verdict for all test cases in `secret`, or for all test cases in its test data groups (which must also have `pass-fail` aggregation), then the score of `secret` is equal to its maximum possible score. Otherwise the score of `secret` is 0.
1357+
- If `secret` uses `sum` or `min` aggregation, then the score of `secret` is computed from the scores of its test cases or test data groups, analogously to test data group scoring above.
1358+
13561359
The submission score is the score of `secret`.
13571360

1358-
It is a judge error if the score of `secret`, or any test data group exceeds its `max_score`.
1361+
It is a judge error if the score of `secret` or any test data group exceeds its `max_score`.
13591362

13601363
#### Required Dependent Groups
13611364

0 commit comments

Comments
 (0)