Skip to content

Commit deab116

Browse files
authored
Moved debug config to use Claude 3 Haiku (#991)
1 parent 78dac69 commit deab116

File tree

2 files changed

+5
-2
lines changed

2 files changed

+5
-2
lines changed

paperqa/configs/debug.json

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{
2-
"llm": "text-completion-openai/babbage-002",
3-
"summary_llm": "text-completion-openai/babbage-002",
2+
"llm": "claude-3-haiku-20240307",
3+
"summary_llm": "claude-3-haiku-20240307",
44
"answer": {
55
"evidence_k": 2,
66
"evidence_summary_length": "25 to 50 words",

tests/test_paperqa.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -467,6 +467,9 @@ async def test_evidence(docs_fixture) -> None:
467467
)
468468
).contexts
469469
assert len(evidence) >= debug_settings.answer.evidence_k
470+
assert len({e.context for e in evidence}) == len(
471+
evidence
472+
), "Expected unique contexts"
470473

471474

472475
@pytest.mark.asyncio

0 commit comments

Comments
 (0)