Skip to content

Commit 9997645

Browse files
GolovnevaOlga Golovneva
andauthored
fix versioning alerts (#32)
Co-authored-by: Olga Golovneva <olggol@meta.com>
1 parent ab92088 commit 9997645

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

projects/self_taught_evaluator/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ First, the model was trained on data comprising responses and evaluation plans g
1414

1515
## Inference and Evaluation
1616

17-
We provide example scripts to use the Self-Taught Evaluator as a judge to choose a better response from a pair. We provide a set of scripts to reproduce the RewardBench evaluation scores for this model. Please refer to [src/requirements.txt](./src/requirements.txt)
17+
We provide example scripts to use the Self-Taught Evaluator as a judge to choose a better response from a pair. We provide a set of scripts to reproduce the RewardBench evaluation scores for this model. Please refer to [src/requirements.txt](./src/requirements.txt). Our experiments were run with `vllm` version 0.6.1.
1818

1919
> [!IMPORTANT]
2020
> This model was trained to judge a pair of responses using the specific prompt format from the RewardBench benchmark. Make sure to adopt the same prompt format when you run the model on your data.

projects/self_taught_evaluator/src/requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
vllm==0.6.1
1+
vllm
22
fastchat
33
fire
44
rewardbench

0 commit comments

Comments
 (0)