Skip to content

Commit cd6418c

Browse files
authored
WIP: add DeepSeek guide (#84)
1 parent 1f7b60d commit cd6418c

File tree

2 files changed

+71
-0
lines changed

2 files changed

+71
-0
lines changed

mint.json

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -91,6 +91,10 @@
9191
"modus/error-handling"
9292
]
9393
},
94+
{
95+
"group": "How-To Guides",
96+
"pages": ["modus/deepseek-model"]
97+
},
9498
{
9599
"group": "API Reference",
96100
"pages": [

modus/deepseek-model.mdx

Lines changed: 67 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,67 @@
1+
---
2+
title: Using DeepSeek
3+
description: "Use the DeepSeek Models with your Modus app"
4+
mode: "wide"
5+
"og:title": "Using DeepSeek - Modus"
6+
---
7+
8+
DeepSeek is an AI lab that has developed and released a series of open source
9+
LLMs that are notable for both their performance and cost-efficiency. By using a
10+
Mixture-of-Experts (MoE) system that utilizes only 37 billion of the models' 671
11+
billion parameters for any task, the DeepSeek-R1 model is able to achieve best
12+
in class performance at a fraction of cost of inference on other comparable
13+
models. In this guide we review how to leverage the DeepSeek models using Modus.
14+
15+
## Options for using DeepSeek with Modus
16+
17+
There are two options for invoking DeepSeek models in your Modus app:
18+
19+
1. [Use the distilled DeepSeek model hosted by Hypermode](#using-the-distilled-deepseek-model-hosted-by-Hypermode)
20+
Hypermode hosts and makes available the distilled DeepSeek model which can be
21+
used by Modus apps developed locally and deployed to Hypermode
22+
2. [Use the DeepSeek API with your Modus app](#using-the-deepseek-api-with-modus)
23+
Access DeepSeek models hosted on the DeepSeek platform by configuring a
24+
DeepSeek connection in your Modus app and using your DeepSeek API key
25+
26+
## Using the distilled DeepSeek model hosted by Hypermode
27+
28+
TODO: explain what a distilled model is
29+
30+
```json modus.json
31+
"deepseek-r1-distill": {
32+
"sourceModel": "deepseek-ai/DeepSeek-R1-Distill-Llama-8B",
33+
"provider": "hugging-face",
34+
"connection": "hypermode"
35+
}
36+
```
37+
38+
## Using the DeepSeek API with Modus
39+
40+
```json modus.json
41+
{
42+
"$schema": "https://schema.hypermode.com/modus.json",
43+
"endpoints": {
44+
"default": {
45+
"type": "graphql",
46+
"path": "/graphql",
47+
"auth": "bearer-token"
48+
}
49+
},
50+
"models": {
51+
"deepseek-chat": {
52+
"sourceModel": "deepseek-chat",
53+
"connection": "deepseek",
54+
"path": "v1/chat/completions"
55+
}
56+
},
57+
"connections": {
58+
"deepseek": {
59+
"type": "http",
60+
"baseUrl": "https://api.deepseek.com/",
61+
"headers": {
62+
"Authorization": "Bearer {{API_TOKEN}}"
63+
}
64+
}
65+
}
66+
}
67+
```

0 commit comments

Comments
 (0)