Skip to content

Commit 8cc12f6

Browse files
committed
add citations and improve fmt
1 parent 186704d commit 8cc12f6

File tree

3 files changed

+603
-610
lines changed

3 files changed

+603
-610
lines changed

evalperf.html

Lines changed: 14 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,7 @@
1818
<link href="https://cdn.jsdelivr.net/npm/[email protected]/themes/prism.css" rel="stylesheet" />
1919
<script src="https://cdn.jsdelivr.net/npm/[email protected]/components/prism-core.min.js"></script>
2020
<script src="https://cdn.jsdelivr.net/npm/[email protected]/plugins/autoloader/prism-autoloader.min.js"></script>
21+
<script src="https://cdn.jsdelivr.net/npm/[email protected]/prism-bibtex.min.js"></script>
2122

2223
<style>
2324
body {
@@ -63,9 +64,9 @@ <h1 class="text-nowrap mt-5" style="font-size: xx-large;">
6364
<div>
6465
🚀 Code Efficiency Evaluation requires:
6566
<ul>
66-
<li><strong>Performance-exercising tasks & inputs</strong>
67+
<li><strong>Performance-exercising tasks & inputs --</strong> "all complexities are equal when N is small"
6768
</li>
68-
<li><strong>Meaningful compound metric:</strong>
69+
<li><strong>Meaningful compound metric --</strong> avg. speedup does not fit multi-task evaluation
6970
</li>
7071
</ul>
7172
<p>Based on <strong>Differential Performance Evaluation</strong>, the EvalPerf dataset (current
@@ -96,6 +97,17 @@ <h1 class="text-nowrap mt-5" style="font-size: xx-large;">
9697
<table id="leaderboard"
9798
class="table table-responsive table-striped table-bordered flex-shrink-1 border border-5">
9899
</table>
100+
<h2 id="sponsor" class="text-nowrap mt-5">🖊️ Citation</h2>
101+
<pre style="padding-top: 0; padding-bottom: 0;">
102+
<code class="language-bibtex">
103+
@inproceedings{evalperf,
104+
title = {Evaluating Language Models for Efficient Code Generation},
105+
author = {Liu, Jiawei and Xie, Songrun and Wang, Junhao and Wei, Yuxiang and Ding, Yifeng and Zhang, Lingming},
106+
booktitle = {First Conference on Language Modeling},
107+
year = {2024},
108+
url = {https://openreview.net/forum?id=IBCBMeAhmC},
109+
}</code>
110+
</pre>
99111
<h2 id="sponsor" class="text-nowrap mt-5">🤗 Acknowledgment</h2>
100112
<p>
101113
We thank

0 commit comments

Comments
 (0)