Skip to content

Commit 608ede5

Browse files
committed
evalperf: add explanations
1 parent 2d84baa commit 608ede5

File tree

1 file changed

+6
-2
lines changed

1 file changed

+6
-2
lines changed

evalperf.html

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -98,8 +98,9 @@ <h1 class="text-nowrap mt-5" style="font-size: xx-large;">
9898
</li>
9999
</ul>
100100

101-
Check out our <a href="https://jw-liu.xyz/assets/pdf/jiawei-colm-evalperf-poster.pdf">COLM'24 poster</a> for
102-
a more detailed overview!
101+
Check out our <a href="https://jw-liu.xyz/assets/pdf/jiawei-colm-evalperf-poster.pdf">COLM'24 poster</a> and
102+
the <a href="https://github.com/evalplus/evalplus/blob/master/docs/evalperf.md">latest experimental
103+
configurations</a> for more details!
103104
</div>
104105

105106
<div class="col-md-12 overflow-auto">
@@ -140,6 +141,9 @@ <h3>Win-rate Leaderboard</h3>
140141

141142
<br>
142143
<h3>Heatmap of Pairwise DPS Comparison</h3>
144+
<p>What's DPS? Differential Performance Score (DPS) is a LeetCode-inspired metric, which shows the overall
145+
code efficiency ranking percentile (0-100%) based on the LLM-generated code. For example, "DPS=80" means the
146+
LLM's "submissions can outperform/match 80% LLM solutions."</p>
143147
<div class="row w-100">
144148
<div class="col-12">
145149
<div class="card">

0 commit comments

Comments
 (0)