Skip to content

Commit b8b5007

Browse files
committed
minor: update readme
Signed-off-by: h-guo18 <[email protected]>
1 parent 63cf465 commit b8b5007

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/speculative_decoding/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ After training draft model, we can evaluate the saved modelopt checkpoint on MT-
115115
python ar_validate.py --model_path $OUTPUT_DIR
116116
```
117117

118-
Alternatively, we can export the checkpoint and run evaluation on serving frameworks. See sections below.
118+
**Note**: In-framework evaluation is supported only for online training. For offline training checkpoints, please export the model and evaluate it using serving frameworks.
119119

120120
## Export
121121

0 commit comments

Comments
 (0)