"runs" notification and "runs" endpoing should contain score for point scoring contests

[johnbrvc]

Both @meisterT and I believe for "score" type contests, the "runs" object should contain a "score" property (number) that gives the score for the run.

[niemela]

How would this be used? When would it be useful?

There certainly could be a score per run (and almost always is), but how this related to the per submission score can differ.

[meisterT]

It can be used for shadowing / results verification.

[niemela]

How would (the very common) case of e.g. "you have 12 test cases, if you pass them all you get 20 points" be reported?

[meisterT]

Fair question, I was mostly thinking about the cases where the validator assigns a score.

[niemela]

Yes, I can see how this would be useful for testing. If we add this, we should add a note that "the meaning of this score is problem dependent, don't assume that the final score must be the minimum, the maximum, or the sum of the scores of the runs".