Skip to content
This repository was archived by the owner on Jul 22, 2025. It is now read-only.

Commit 3a7085b

Browse files
committed
small note on evals
1 parent 6e8620b commit 3a7085b

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed

README.md

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,3 +3,26 @@
33
**Plugin Summary**
44

55
For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco
6+
7+
### Evals
8+
9+
The directory `evals` contains AI evals for the Discourse AI plugin.
10+
11+
To run them use:
12+
13+
cd evals
14+
./run --help
15+
16+
```
17+
Usage: evals/run [options]
18+
-e, --eval NAME Name of the evaluation to run
19+
--list-models List models
20+
-m, --model NAME Model to evaluate (will eval all models if not specified)
21+
-l, --list List evals
22+
```
23+
24+
To run evals you will need to configure API keys in your environment:
25+
26+
OPENAI_API_KEY=your_openai_api_key
27+
ANTHROPIC_API_KEY=your_anthropic_api_key
28+
GEMINI_API_KEY=your_gemini_api_key

0 commit comments

Comments
 (0)