Skip to content

Commit 7a60161

Browse files
authored
update readme (#6116)
1 parent a15ab13 commit 7a60161

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

applications/ColossalChat/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -284,7 +284,7 @@ For more details, see [`inference/`](https://github.com/hpcaitech/ColossalAI/tre
284284
## O1 Journey
285285
### Inference with Self-refined MCTS
286286
We provide the implementation of MCT Self-Refine (MCTSr) algorithm, an innovative integration of Large Language Models with Monte Carlo Tree Search.
287-
To run inference with MCTS, simply use the following script.
287+
You can serve model using vLLM and update the config file in `Qwen32B_prompt_CFG` and then run the following script.
288288
```python
289289
from coati.reasoner.guided_search.mcts import MCTS
290290
from coati.reasoner.guided_search.prompt_store.qwen import Qwen32B_prompt_CFG

0 commit comments

Comments
 (0)