File tree Expand file tree Collapse file tree 2 files changed +4601
-2
lines changed
results/repoqa/ntoken_16384 Expand file tree Collapse file tree 2 files changed +4601
-2
lines changed Original file line number Diff line number Diff line change @@ -325,8 +325,8 @@ <h3 id="non-determinism" class="text-nowrap mt-5">Non-determinism</h3>
325325 deterministic. In practice, the results may slightly vary: (i) for
326326 OpenAI/Anthropic models, they do not seem to be deterministic all
327327 the time (Thanks to @scottinallcaps); and (ii) for local inference,
328- the configuration of library versions and tensor parallelism sizes
329- may also slightly impact reproducibility.
328+ the library configuration such as tensor parallelism sizes may also
329+ slightly impact reproducibility.
330330 </ p >
331331 < h3 id ="limit " class ="text-nowrap mt-5 "> Known limitations</ h3 >
332332 < ul >
@@ -371,6 +371,7 @@ <h3 id="limit" class="text-nowrap mt-5">Known limitations</h3>
371371 "claude-3-sonnet-20240229-SCORES.json" ,
372372 "CohereForAI_slash_c4ai-command-r-plus-SCORES.json" ,
373373 "gpt-4o-2024-05-13-SCORES.json" ,
374+ "gemini-1.5-flash-latest-SCORES.json" ,
374375 ] ;
375376 const linkMapping = new Map ( [ ] ) ;
376377 const hfLinkPrefix = "https://huggingface.co/" ;
You can’t perform that action at this time.
0 commit comments