You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Released January 21, 2025, Deepseek’s R1 Distilled Llama 70B is a distilled version of Llama model family based on Deepseek R1.
40
-
DeepSeek R1 Distill Llama 70B is designed to improve performance of Llama models on reasoning use case such as mathematics and coding tasks.
39
+
Released January 21, 2025, Deepseek’s R1 Distilled Llama 70B is a distilled version of the Llama model family based on Deepseek R1.
40
+
DeepSeek R1 Distill Llama 70B is designed to improve the performance of Llama models on reasoning use case such as mathematics and coding tasks.
41
41
42
42
## Why is it useful?
43
43
44
44
It is great to see Deepseek improving open(weight) models, and we are excited to fully support their mission with integration in the Scaleway ecosystem.
45
45
46
46
- DeepSeek-R1-Distill-Llama was optimized to reach accuracy close to Deepseek-R1 in tasks like mathematics and coding, while keeping inference costs limited and tokens speed efficient.
47
-
- DeepSeek-R1-Distill-Llama supports a context window up to 56K tokens and tool calling, keeping interaction with other components possible.
47
+
- DeepSeek-R1-Distill-Llama supports a context window of up to 56K tokens and tool calling, keeping interaction with other components possible.
48
48
49
49
## How to use it
50
50
@@ -71,9 +71,9 @@ Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [I
71
71
This model is better used without `system prompt`, as suggested by the model provider.
72
72
</Message>
73
73
74
-
### Receiving Inference responses
74
+
### Receiving inference responses
75
75
76
-
Upon sending the HTTP request to the public or private endpoints exposed by the server, you will receive inference responses from the managed Managed Inference server.
76
+
Upon sending the HTTP request to the public or private endpoints exposed by the server, you will receive inference responses from the Managed Inference server.
77
77
Process the output data according to your application's needs. The response will contain the output generated by the LLM model based on the input provided in the request.
Released January 21, 2025, Deepseek’s R1 Distilled Llama 8B is a distilled version of Llama model family based on Deepseek R1.
41
-
DeepSeek R1 Distill Llama 8B is designed to improve performance of Llama models on reasoning use case such as mathematics and coding tasks.
40
+
Released January 21, 2025, Deepseek’s R1 Distilled Llama 8B is a distilled version of the Llama model family based on Deepseek R1.
41
+
DeepSeek R1 Distill Llama 8B is designed to improve the performance of Llama models on reasoning use cases such as mathematics and coding tasks.
42
42
43
43
## Why is it useful?
44
44
45
45
It is great to see Deepseek improving open(weight) models, and we are excited to fully support their mission with integration in the Scaleway ecosystem.
46
46
47
47
- DeepSeek-R1-Distill-Llama was optimized to reach accuracy close to Deepseek-R1 in tasks like mathematics and coding, while keeping inference costs limited and tokens speed efficient.
48
-
- DeepSeek-R1-Distill-Llama supports a context window up to 131K tokens and tool calling, keeping interaction with other components possible.
48
+
- DeepSeek-R1-Distill-Llama supports a context window of up to 131K tokens and tool calling, keeping interaction with other components possible.
49
49
50
50
## How to use it
51
51
@@ -72,7 +72,7 @@ Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [I
72
72
This model is better used without `system prompt`, as suggested by the model provider.
73
73
</Message>
74
74
75
-
### Receiving Inference responses
75
+
### Receiving inference responses
76
76
77
77
Upon sending the HTTP request to the public or private endpoints exposed by the server, you will receive inference responses from the managed Managed Inference server.
78
78
Process the output data according to your application's needs. The response will contain the output generated by the LLM model based on the input provided in the request.
0 commit comments