Skip to content

Commit 46493d3

Browse files
committed
add stuff
1 parent 3db0c22 commit 46493d3

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

packages/inference/README.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -70,6 +70,11 @@ Only a subset of models are supported when requesting third-party providers. You
7070
- [Together supported models](./src/providers/together.ts)
7171
- [HF Inference API (serverless)](https://huggingface.co/models?inference=warm&sort=trending)
7272

73+
**Important note:** To be compatible, the third-party API must adhere to the "standard" shape API we expect on HF model pages for each pipeline task type.
74+
This is not an issue for LLMs as everyone converged on the OpenAI API anyways, but can be more tricky for other tasks like "text-to-image" or "automatic-speech-recognition" where there exists no standard API. Let us know if any help is needed or if we can make things easier for you!
75+
76+
👋**Want to add another provider?** Get in touch if you'd like to add support for another Inference provider, and/or request it on https://huggingface.co/spaces/huggingface/HuggingDiscussions/discussions/49
77+
7378
### Tree-shaking
7479

7580
You can import the functions you need directly from the module instead of using the `HfInference` class.

0 commit comments

Comments
 (0)