Skip to content

Commit 1330b57

Browse files
committed
add ray timeout handling instruction
1 parent dc29c74 commit 1330b57

File tree

1 file changed

+8
-0
lines changed
  • applications/ColossalChat/coati/distributed

1 file changed

+8
-0
lines changed

applications/ColossalChat/coati/distributed/README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,6 +47,14 @@ pip install cupy-cuda12x
4747
python -m cupyx.tools.install_library --cuda 12.x --library nccl
4848
```
4949

50+
To support long input/output sequence length (e.g., 32K), you may need to manually change the default setting (180 seconds) for the `timeout_s` variable in your ray installation to a larger value as shown in the screenshot below.
51+
52+
<div align="center">
53+
<p align="center">
54+
<img src="https://raw.githubusercontent.com/hpcaitech/public_assets/main/applications/chat/change_ray_timeout.png" width=700/>
55+
</p>
56+
</div>
57+
5058
Prepare Model & dataset
5159
```bash
5260
huggingface-cli download --local-dir-use-symlinks False Qwen/Qwen2.5-7B --local-dir /models/Qwen/Qwen2.5-7B

0 commit comments

Comments
 (0)