This repository was archived by the owner on Sep 10, 2025. It is now read-only.
File tree Expand file tree Collapse file tree 1 file changed +4
-4
lines changed Expand file tree Collapse file tree 1 file changed +4
-4
lines changed Original file line number Diff line number Diff line change @@ -35,9 +35,9 @@ Running wikitext with torch.compile for 10 iterations
3535python3 torchchat.py eval stories15M --compile --tasks wikitext --limit 10
3636```
3737
38- Running multiple tasks and calling eval.py directly ( with torch.compile) :
38+ Running multiple tasks with torch.compile for evaluation and prefill :
3939```
40- python3 torchchat.py eval stories15M --compile --tasks wikitext hellaswag
40+ python3 torchchat.py eval stories15M --compile --compile-prefill -- tasks wikitext hellaswag
4141```
4242
4343### Evaluation with model exported to PTE with ExecuTorch
@@ -50,7 +50,7 @@ python3 torchchat.py export stories15M --output-pte-path stories15M.pte
5050python3 torchchat.py eval stories15M --pte-path stories15M.pte
5151```
5252
53- Running multiple tasks directly (with PTE) :
53+ Running multiple tasks directly by creating a PTE mobile model :
5454```
5555python3 torchchat.py eval stories15M --pte-path stories15M.pte --tasks wikitext hellaswag
5656```
@@ -71,7 +71,7 @@ python3 torchchat.py export stories15M --dtype fast16 --output-dso-path stories1
7171python3 torchchat.py eval stories15M --dtype fast16 --dso-path stories15M.so
7272```
7373
74- Running multiple tasks directly ( with AOTI) :
74+ Running multiple tasks with AOTI:
7575```
7676python3 torchchat.py eval stories15M --dso-path stories15M.so --tasks wikitext hellaswag
7777```
You can’t perform that action at this time.
0 commit comments