Skip to content

Commit bc23306

Browse files
authored
Update deepseek-r1-distill-llama-8b.mdx
1 parent 6ea8d31 commit bc23306

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

pages/managed-inference/reference-content/deepseek-r1-distill-llama-8b.mdx

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ categories:
1919
|-----------------|------------------------------------|
2020
| Provider | [Deepseek](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B) |
2121
| License | [MIT](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md) |
22-
| Compatible Instances | L4, L40S, H100 (BF16) |
22+
| Compatible Instances | L4, L40S, H100 (FP8, BF16) |
2323
| Context Length | up to 131k tokens |
2424

2525
## Model names
@@ -32,9 +32,9 @@ deepseek/deepseek-r1-distill-llama-8b:bf16
3232

3333
| Instance type | Max context length |
3434
| ------------- |-------------|
35-
| L4 | 39k (BF16) |
36-
| L40S | 131k (BF16) |
37-
| H100 | 131k (BF16) |
35+
| L4 | 90k (FP8), 39k (BF16) |
36+
| L40S | 131k (FP8, BF16) |
37+
| H100 | 131k (FP8, BF16) |
3838

3939
## Model introduction
4040

0 commit comments

Comments
 (0)