Skip to content

Commit f4ded01

Browse files
committed
add README and populate getProviderHelper.ts
1 parent 3452916 commit f4ded01

File tree

2 files changed

+7
-0
lines changed

2 files changed

+7
-0
lines changed

packages/inference/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,7 @@ Currently, we support the following providers:
6060
- [Blackforestlabs](https://blackforestlabs.ai)
6161
- [Cohere](https://cohere.com)
6262
- [Cerebras](https://cerebras.ai/)
63+
- [CentML](https://centml.ai)
6364
- [Groq](https://groq.com)
6465

6566
To send requests to a third-party provider, you have to pass the `provider` parameter to the inference function. Make sure your request is authenticated with an access token.
@@ -89,6 +90,7 @@ Only a subset of models are supported when requesting third-party providers. You
8990
- [Together supported models](https://huggingface.co/api/partners/together/models)
9091
- [Cohere supported models](https://huggingface.co/api/partners/cohere/models)
9192
- [Cerebras supported models](https://huggingface.co/api/partners/cerebras/models)
93+
- [CentML supported models](https://huggingface.co/api/partners/centml/models)
9294
- [Groq supported models](https://console.groq.com/docs/models)
9395
- [HF Inference API (serverless)](https://huggingface.co/models?inference=warm&sort=trending)
9496

packages/inference/src/lib/getProviderHelper.ts

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,6 @@
11
import * as BlackForestLabs from "../providers/black-forest-labs";
22
import * as Cerebras from "../providers/cerebras";
3+
import * as CentML from "../providers/centml";
34
import * as Cohere from "../providers/cohere";
45
import * as FalAI from "../providers/fal-ai";
56
import * as FeatherlessAI from "../providers/featherless-ai";
@@ -55,6 +56,10 @@ export const PROVIDERS: Record<InferenceProvider, Partial<Record<InferenceTask,
5556
cerebras: {
5657
conversational: new Cerebras.CerebrasConversationalTask(),
5758
},
59+
centml: {
60+
conversational: new CentML.CentMLConversationalTask(),
61+
"text-generation": new CentML.CentMLTextGenerationTask(),
62+
},
5863
cohere: {
5964
conversational: new Cohere.CohereConversationalTask(),
6065
},

0 commit comments

Comments
 (0)