Skip to content

Commit 188c967

Browse files
committed
fix: tested another model for novita
1 parent d7f079e commit 188c967

File tree

3 files changed

+24
-2
lines changed

3 files changed

+24
-2
lines changed

packages/inference/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -50,10 +50,10 @@ Currently, we support the following providers:
5050
- [Fal.ai](https://fal.ai)
5151
- [Fireworks AI](https://fireworks.ai)
5252
- [Nebius](https://studio.nebius.ai)
53+
- [Novita](https://novita.ai/?utm_source=github_huggingface&utm_medium=github_readme&utm_campaign=link)
5354
- [Replicate](https://replicate.com)
5455
- [Sambanova](https://sambanova.ai)
5556
- [Together](https://together.xyz)
56-
- [Novita](https://novita.ai/?utm_source=github_huggingface&utm_medium=github_readme&utm_campaign=link)
5757

5858
To send requests to a third-party provider, you have to pass the `provider` parameter to the inference function. Make sure your request is authenticated with an access token.
5959
```ts

packages/inference/test/HfInference.spec.ts

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1183,6 +1183,7 @@ describe.concurrent("HfInference", () => {
11831183

11841184
HARDCODED_MODEL_ID_MAPPING["novita"] = {
11851185
"meta-llama/llama-3.1-8b-instruct": "meta-llama/llama-3.1-8b-instruct",
1186+
"deepseek/deepseek-r1-distill-qwen-14b": "deepseek/deepseek-r1-distill-qwen-14b",
11861187
};
11871188

11881189
it("chatCompletion", async () => {
@@ -1199,7 +1200,7 @@ describe.concurrent("HfInference", () => {
11991200

12001201
it("chatCompletion stream", async () => {
12011202
const stream = client.chatCompletionStream({
1202-
model: "meta-llama/llama-3.1-8b-instruct",
1203+
model: "deepseek/deepseek-r1-distill-qwen-14b",
12031204
provider: "novita",
12041205
messages: [{ role: "user", content: "Say this is a test" }],
12051206
stream: true,

packages/inference/test/tapes.json

Lines changed: 21 additions & 0 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)