File tree Expand file tree Collapse file tree 1 file changed +18
-0
lines changed
Expand file tree Collapse file tree 1 file changed +18
-0
lines changed Original file line number Diff line number Diff line change 1+ 【预下载的模型配置】
2+ 1、DeepSeek-R1:/app/model/deepseek-ai/DeepSeek-R1
3+ 2、DeepSeek-V3-0324:/app/model/deepseek-ai/DeepSeek-V3-0324
4+ 3、DeepSeek-V2-Lite-Chat:/app/model/deepseek-ai/DeepSeek-V2-Lite-Chat
5+
6+ 【启动命令:本地】
7+ 1、DeepSeek-R1:python -m ktransformers.local_chat --model_path /app/model/deepseek-ai/DeepSeek-R1 --gguf_path /app/model/DeepSeek-R1-GGUF
8+ 2、DeepSeek-V3-0324:python -m ktransformers.local_chat --model_path /app/model/deepseek-ai/DeepSeek-V3-0324 --gguf_path /app/model/DeepSeek-V3-0324-GGUF
9+ 3、DeepSeek-V2-Lite-Chat:python -m ktransformers.local_chat --model_path /app/model/deepseek-ai/DeepSeek-V2-Lite-Chat --gguf_path /app/model/DeepSeek-V2-Lite-Chat-GGUF
10+ (GGUF文件需要下载到对应的目录内)
11+
12+ 【部分GGUF的地址:国内可访问】
13+ 1、DeepSeek-R1:https://hf-mirror.com/unsloth/DeepSeek-R1-GGUF
14+ 2、DeepSeek-V3-0324:https://hf-mirror.com/unsloth/DeepSeek-V3-0324-GGUF
15+ 3、DeepSeek-V2-Lite-Chat:https://hf-mirror.com/mradermacher/DeepSeek-V2-Lite-GGUF
16+
17+ 【官方部署文档】
18+ https://kvcache-ai.github.io/ktransformers/en/install.html
You can’t perform that action at this time.
0 commit comments