Skip to content

Commit ae84aee

Browse files
authored
Create README.txt
1 parent 9531924 commit ae84aee

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

README.txt

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
【预下载的模型配置】
2+
1、DeepSeek-R1:/app/model/deepseek-ai/DeepSeek-R1
3+
2、DeepSeek-V3-0324:/app/model/deepseek-ai/DeepSeek-V3-0324
4+
3、DeepSeek-V2-Lite-Chat:/app/model/deepseek-ai/DeepSeek-V2-Lite-Chat
5+
6+
【启动命令:本地】
7+
1、DeepSeek-R1:python -m ktransformers.local_chat --model_path /app/model/deepseek-ai/DeepSeek-R1 --gguf_path /app/model/DeepSeek-R1-GGUF
8+
2、DeepSeek-V3-0324:python -m ktransformers.local_chat --model_path /app/model/deepseek-ai/DeepSeek-V3-0324 --gguf_path /app/model/DeepSeek-V3-0324-GGUF
9+
3、DeepSeek-V2-Lite-Chat:python -m ktransformers.local_chat --model_path /app/model/deepseek-ai/DeepSeek-V2-Lite-Chat --gguf_path /app/model/DeepSeek-V2-Lite-Chat-GGUF
10+
(GGUF文件需要下载到对应的目录内)
11+
12+
【部分GGUF的地址:国内可访问】
13+
1、DeepSeek-R1:https://hf-mirror.com/unsloth/DeepSeek-R1-GGUF
14+
2、DeepSeek-V3-0324:https://hf-mirror.com/unsloth/DeepSeek-V3-0324-GGUF
15+
3、DeepSeek-V2-Lite-Chat:https://hf-mirror.com/mradermacher/DeepSeek-V2-Lite-GGUF
16+
17+
【官方部署文档】
18+
https://kvcache-ai.github.io/ktransformers/en/install.html

0 commit comments

Comments
 (0)