Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

lm_eval: fix links and pin version #1326

Merged
merged 1 commit into from
Oct 25, 2024
Merged

lm_eval: fix links and pin version #1326

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions install/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,3 +30,6 @@ streamlit

# Server mode
flask

# eval
lm_eval==0.4.2
4 changes: 2 additions & 2 deletions torchchat/utils/docs/evaluation.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@

Torchchat provides evaluation functionality for your language model on
a variety of tasks using the
[lm-evaluation-harness](https://github.com/facebookresearch/lm_eval)
[lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness)
library.

## Usage
Expand All @@ -34,6 +34,6 @@ Running multiple tasks and calling eval.py directly:
python3 torchchat.py eval stories15M --pte-path stories15M.pte --tasks wikitext hellaswag
```

For more information and a list of tasks/metrics see [lm-evaluation-harness](https://github.com/facebookresearch/lm_eval).
For more information and a list of tasks/metrics see [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness).

[end default]: end
Loading