File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed
Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -11,7 +11,7 @@ git clone https://github.com/alibaba/rtp-llm.git
1111cd docker
1212# 注意:以下两条指令,不要使用sudo执行
1313# 如果是cuda11的环境,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda11
14- # 如果是cuda11的环境 ,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda12
14+ # 如果是cuda12的环境 ,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda12
1515sh ./create_container.sh < CONTAINER_NAME>
1616sh CONTAINER_NAME/sshme.sh
1717```
@@ -27,4 +27,4 @@ TOKENIZER_PATH=/path/to/tokenizer CHECKPOINT_PATH=/path/to/model MODEL_TYPE=your
2727# request to server
2828curl -XPOST http://localhost:8088 -d ' {"prompt": "hello, what is your name", "generate_config": {"max_new_tokens": 1000}}'
2929```
30- 其中 your_model_type 可以在 maga_transformer/models/__ init__ .py 中查找到
30+ 其中 your_model_type 可以在 maga_transformer/models/__ init__ .py 中查找到
You can’t perform that action at this time.
0 commit comments