Skip to content

Commit 8fa9e66

Browse files
committed
repoqa: add gemini-1.5-flash
1 parent e4af07a commit 8fa9e66

File tree

2 files changed

+4601
-2
lines changed

2 files changed

+4601
-2
lines changed

repoqa.html

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -325,8 +325,8 @@ <h3 id="non-determinism" class="text-nowrap mt-5">Non-determinism</h3>
325325
deterministic. In practice, the results may slightly vary: (i) for
326326
OpenAI/Anthropic models, they do not seem to be deterministic all
327327
the time (Thanks to @scottinallcaps); and (ii) for local inference,
328-
the configuration of library versions and tensor parallelism sizes
329-
may also slightly impact reproducibility.
328+
the library configuration such as tensor parallelism sizes may also
329+
slightly impact reproducibility.
330330
</p>
331331
<h3 id="limit" class="text-nowrap mt-5">Known limitations</h3>
332332
<ul>
@@ -371,6 +371,7 @@ <h3 id="limit" class="text-nowrap mt-5">Known limitations</h3>
371371
"claude-3-sonnet-20240229-SCORES.json",
372372
"CohereForAI_slash_c4ai-command-r-plus-SCORES.json",
373373
"gpt-4o-2024-05-13-SCORES.json",
374+
"gemini-1.5-flash-latest-SCORES.json",
374375
];
375376
const linkMapping = new Map([]);
376377
const hfLinkPrefix = "https://huggingface.co/";

0 commit comments

Comments
 (0)