Skip to content

Commit 4eda3e2

Browse files
committed
polish
Signed-off-by: h-guo18 <[email protected]>
1 parent 95bbe5d commit 4eda3e2

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

examples/speculative_decoding/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,8 @@ python collect_hidden_states/compute_hidden_states_hf.py \
9393
--output-dir $HIDDEN_STATES_DIR
9494
```
9595

96+
See [`run_hf_compute_hiddens_dp.sh`](./collect_hidden_states/run_hf_compute_hiddens_dp.sh) for a simple example using data parallelism (DP) to accelerate hidden state generation.
97+
9698
Then, train draft model with `--offline-data` argument:
9799

98100
```bash

0 commit comments

Comments
 (0)