|
| 1 | +--- |
| 2 | +title: Using DeepSeek |
| 3 | +description: "Use the DeepSeek Models with your Modus app" |
| 4 | +mode: "wide" |
| 5 | +"og:title": "Using DeepSeek - Modus" |
| 6 | +--- |
| 7 | + |
| 8 | +DeepSeek is an AI lab that has developed and released a series of open source |
| 9 | +LLMs that are notable for both their performance and cost-efficiency. By using a |
| 10 | +Mixture-of-Experts (MoE) system that utilizes only 37 billion of the models' 671 |
| 11 | +billion parameters for any task, the DeepSeek-R1 model is able to achieve best |
| 12 | +in class performance at a fraction of cost of inference on other comparable |
| 13 | +models. In this guide we review how to leverage the DeepSeek models using Modus. |
| 14 | + |
| 15 | +## Options for using DeepSeek with Modus |
| 16 | + |
| 17 | +There are two options for invoking DeepSeek models in your Modus app: |
| 18 | + |
| 19 | +1. [Use the distilled DeepSeek model hosted by Hypermode](#using-the-distilled-deepseek-model-hosted-by-Hypermode) |
| 20 | + Hypermode hosts and makes available the distilled DeepSeek model which can be |
| 21 | + used by Modus apps developed locally and deployed to Hypermode |
| 22 | +2. [Use the DeepSeek API with your Modus app](#using-the-deepseek-api-with-modus) |
| 23 | + Access DeepSeek models hosted on the DeepSeek platform by configuring a |
| 24 | + DeepSeek connection in your Modus app and using your DeepSeek API key |
| 25 | + |
| 26 | +## Using the distilled DeepSeek model hosted by Hypermode |
| 27 | + |
| 28 | +TODO: explain what a distilled model is |
| 29 | + |
| 30 | +```json modus.json |
| 31 | +"deepseek-r1-distill": { |
| 32 | + "sourceModel": "deepseek-ai/DeepSeek-R1-Distill-Llama-8B", |
| 33 | + "provider": "hugging-face", |
| 34 | + "connection": "hypermode" |
| 35 | +} |
| 36 | +``` |
| 37 | + |
| 38 | +## Using the DeepSeek API with Modus |
| 39 | + |
| 40 | +```json modus.json |
| 41 | +{ |
| 42 | + "$schema": "https://schema.hypermode.com/modus.json", |
| 43 | + "endpoints": { |
| 44 | + "default": { |
| 45 | + "type": "graphql", |
| 46 | + "path": "/graphql", |
| 47 | + "auth": "bearer-token" |
| 48 | + } |
| 49 | + }, |
| 50 | + "models": { |
| 51 | + "deepseek-chat": { |
| 52 | + "sourceModel": "deepseek-chat", |
| 53 | + "connection": "deepseek", |
| 54 | + "path": "v1/chat/completions" |
| 55 | + } |
| 56 | + }, |
| 57 | + "connections": { |
| 58 | + "deepseek": { |
| 59 | + "type": "http", |
| 60 | + "baseUrl": "https://api.deepseek.com/", |
| 61 | + "headers": { |
| 62 | + "Authorization": "Bearer {{API_TOKEN}}" |
| 63 | + } |
| 64 | + } |
| 65 | + } |
| 66 | +} |
| 67 | +``` |
0 commit comments