File tree Expand file tree Collapse file tree 1 file changed +6
-2
lines changed
Expand file tree Collapse file tree 1 file changed +6
-2
lines changed Original file line number Diff line number Diff line change @@ -98,8 +98,9 @@ <h1 class="text-nowrap mt-5" style="font-size: xx-large;">
9898 </ li >
9999 </ ul >
100100
101- Check out our < a href ="https://jw-liu.xyz/assets/pdf/jiawei-colm-evalperf-poster.pdf "> COLM'24 poster</ a > for
102- a more detailed overview!
101+ Check out our < a href ="https://jw-liu.xyz/assets/pdf/jiawei-colm-evalperf-poster.pdf "> COLM'24 poster</ a > and
102+ the < a href ="https://github.com/evalplus/evalplus/blob/master/docs/evalperf.md "> latest experimental
103+ configurations</ a > for more details!
103104 </ div >
104105
105106 < div class ="col-md-12 overflow-auto ">
@@ -140,6 +141,9 @@ <h3>Win-rate Leaderboard</h3>
140141
141142 < br >
142143 < h3 > Heatmap of Pairwise DPS Comparison</ h3 >
144+ < p > What's DPS? Differential Performance Score (DPS) is a LeetCode-inspired metric, which shows the overall
145+ code efficiency ranking percentile (0-100%) based on the LLM-generated code. For example, "DPS=80" means the
146+ LLM's "submissions can outperform/match 80% LLM solutions."</ p >
143147 < div class ="row w-100 ">
144148 < div class ="col-12 ">
145149 < div class ="card ">
You can’t perform that action at this time.
0 commit comments