This repository was archived by the owner on Apr 23, 2026. It is now read-only.
Commit aba476b
Update benchmark scores for Claude Opus 4.7 and 4.6 families, and GPT-5.4/Grok-4.20 models (#305)
Verified and updated missing or outdated benchmark values in `data/showdown.json` based on current LiveBench, LMArena, and ArtificialAnalysis data:
- `claude-opus-4-7-20260401-thinking-32k`: Added LiveBench (76.91), LiveBench subscores, output_speed_tps (87), latency_ttft_ms (14120), lmarena_en_elo (1504), lmarena_coding_elo (1576), and lmarena_vision_elo (1307).
- `claude-opus-4-7-20260401`: Updated lmarena_en_elo (1497), lmarena_coding_elo (1569), and lmarena_vision_elo (1300).
- `claude-opus-4-6-20260205-thinking-32k`: Updated lmarena_en_elo (1502), lmarena_coding_elo (1549), and lmarena_vision_elo (1304).
- `claude-opus-4-6-20260205`: Updated lmarena_en_elo (1496), lmarena_coding_elo (1544), and lmarena_vision_elo (1293).
- `claude-sonnet-4-6-20260217`: Updated lmarena_coding_elo (1525) and lmarena_vision_elo (1269).
- `gpt-5.4-high`: Updated lmarena_coding_elo (1457) and lmarena_en_elo (1482).
- `grok-4-20-thinking`: Updated lmarena_en_elo (1480).
All updates conform to strict verification requirements from two independent sources where applicable, preserving null values for insufficient or ambiguous data. Updated `meta.last_update` timestamp to reflect current dataset modification.
Co-authored-by: google-labs-jules[bot] <161369871+google-labs-jules[bot]@users.noreply.github.com>1 parent caa5f02 commit aba476b
1 file changed
Lines changed: 26 additions & 26 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
4 | | - | |
| 4 | + | |
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
| |||
133 | 133 | | |
134 | 134 | | |
135 | 135 | | |
136 | | - | |
137 | | - | |
| 136 | + | |
| 137 | + | |
138 | 138 | | |
139 | 139 | | |
140 | 140 | | |
141 | 141 | | |
142 | | - | |
143 | | - | |
| 142 | + | |
| 143 | + | |
144 | 144 | | |
145 | 145 | | |
146 | 146 | | |
| |||
149 | 149 | | |
150 | 150 | | |
151 | 151 | | |
152 | | - | |
| 152 | + | |
153 | 153 | | |
154 | 154 | | |
155 | 155 | | |
| |||
167 | 167 | | |
168 | 168 | | |
169 | 169 | | |
170 | | - | |
171 | | - | |
172 | | - | |
173 | | - | |
174 | | - | |
175 | | - | |
176 | | - | |
177 | | - | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
178 | 178 | | |
179 | 179 | | |
180 | 180 | | |
| |||
196 | 196 | | |
197 | 197 | | |
198 | 198 | | |
199 | | - | |
200 | | - | |
| 199 | + | |
| 200 | + | |
201 | 201 | | |
202 | 202 | | |
203 | 203 | | |
| |||
224 | 224 | | |
225 | 225 | | |
226 | 226 | | |
227 | | - | |
| 227 | + | |
228 | 228 | | |
229 | 229 | | |
230 | 230 | | |
| |||
262 | 262 | | |
263 | 263 | | |
264 | 264 | | |
265 | | - | |
| 265 | + | |
266 | 266 | | |
267 | | - | |
| 267 | + | |
268 | 268 | | |
269 | 269 | | |
270 | 270 | | |
271 | | - | |
| 271 | + | |
272 | 272 | | |
273 | 273 | | |
274 | 274 | | |
| |||
326 | 326 | | |
327 | 327 | | |
328 | 328 | | |
329 | | - | |
| 329 | + | |
330 | 330 | | |
331 | | - | |
| 331 | + | |
332 | 332 | | |
333 | 333 | | |
334 | 334 | | |
335 | | - | |
| 335 | + | |
336 | 336 | | |
337 | 337 | | |
338 | 338 | | |
| |||
513 | 513 | | |
514 | 514 | | |
515 | 515 | | |
516 | | - | |
| 516 | + | |
517 | 517 | | |
518 | 518 | | |
519 | 519 | | |
| |||
1171 | 1171 | | |
1172 | 1172 | | |
1173 | 1173 | | |
1174 | | - | |
| 1174 | + | |
1175 | 1175 | | |
1176 | 1176 | | |
1177 | 1177 | | |
| |||
2009 | 2009 | | |
2010 | 2010 | | |
2011 | 2011 | | |
2012 | | - | |
| 2012 | + | |
2013 | 2013 | | |
2014 | 2014 | | |
2015 | 2015 | | |
| |||
0 commit comments