Skip to content

Commit 2e6b5ae

Browse files
authored
Update ADVANCED-USERS.md
Need to download files before using them, lol. We expect the users to do this, but we should verbalize. Plus, if we extract for testing, then it obviously fails.
1 parent 278b3fc commit 2e6b5ae

File tree

1 file changed

+11
-1
lines changed

1 file changed

+11
-1
lines changed

docs/ADVANCED-USERS.md

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -185,6 +185,16 @@ MODEL_OUT=~/torchchat-exports
185185
186186
mkdir -p ${MODEL_DIR}
187187
mkdir -p ${MODEL_OUT}
188+
189+
# Change to the MODELDIR directory
190+
pushd ${MODEL_DIR}
191+
192+
# Download the files for stories15M using wget
193+
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.pt
194+
wget https://github.com/karpathy/llama2.c/raw/refs/heads/master/tokenizer.model
195+
196+
# Go back to the original directory
197+
popd
188198
```
189199

190200
When we export models with AOT Inductor for servers and desktops, and
@@ -335,7 +345,7 @@ tests against the exported model with the same interface, and support
335345
additional experiments to confirm model quality and speed.
336346

337347
```
338-
python3 torchchat.py generate --device [ cuda | cpu ] --dso-path ${MODEL_NAME}.so --prompt "Once upon a time"
348+
python3 torchchat.py generate --device [ cuda | cpu ] --checkpoint-path ${MODEL_PATH} --dso-path ${MODEL_NAME}.so --prompt "Once upon a time"
339349
```
340350

341351

0 commit comments

Comments
 (0)