Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Commit f460c3e

Browse files
authored
Update evaluation.md
1 parent e24c33c commit f460c3e

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

torchchat/utils/docs/evaluation.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -35,9 +35,9 @@ Running wikitext with torch.compile for 10 iterations
3535
python3 torchchat.py eval stories15M --compile --tasks wikitext --limit 10
3636
```
3737

38-
Running multiple tasks and calling eval.py directly (with torch.compile):
38+
Running multiple tasks with torch.compile for evaluation and prefill:
3939
```
40-
python3 torchchat.py eval stories15M --compile --tasks wikitext hellaswag
40+
python3 torchchat.py eval stories15M --compile --compile-prefill --tasks wikitext hellaswag
4141
```
4242

4343
### Evaluation with model exported to PTE with ExecuTorch
@@ -50,7 +50,7 @@ python3 torchchat.py export stories15M --output-pte-path stories15M.pte
5050
python3 torchchat.py eval stories15M --pte-path stories15M.pte
5151
```
5252

53-
Running multiple tasks directly (with PTE):
53+
Running multiple tasks directly by creating a PTE mobile model:
5454
```
5555
python3 torchchat.py eval stories15M --pte-path stories15M.pte --tasks wikitext hellaswag
5656
```
@@ -71,7 +71,7 @@ python3 torchchat.py export stories15M --dtype fast16 --output-dso-path stories1
7171
python3 torchchat.py eval stories15M --dtype fast16 --dso-path stories15M.so
7272
```
7373

74-
Running multiple tasks directly (with AOTI):
74+
Running multiple tasks with AOTI:
7575
```
7676
python3 torchchat.py eval stories15M --dso-path stories15M.so --tasks wikitext hellaswag
7777
```

0 commit comments

Comments
 (0)