-
Notifications
You must be signed in to change notification settings - Fork 374
Revamp Inference Providers doc #1652
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
69b16f7
4e6ccd4
b18eddd
f4d6689
51f6468
2b16f3e
74833f8
be30296
fa8efb6
353a7e4
bf55fb1
668df05
2e99c0d
4d7fd47
95f0171
61b3717
63034eb
6a2660e
751ac5a
63a795d
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
This file was deleted.
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| # Hub API | ||
|
|
||
| **TODO** | ||
| - search for models (API): https://huggingface.co/api/models?inference_provider=fireworks-ai | ||
| - get warm models (any provider): https://huggingface.co/api/models?inference=warm | ||
| - get warm status for a model: https://huggingface.co/api/models/google/gemma-3-27b-it?expand[]=inference | ||
| - get providers for a model: https://huggingface.co/api/models/Qwen/QwQ-32B?expand[]=inferenceProviderMapping | ||
|
|
||
| Document raw HTTP requests + JS/Python equivalent in SDKs |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| # Hub Integration | ||
|
|
||
| **TODO:** | ||
| - search for models (UI): https://huggingface.co/models?inference_provider=fireworks-ai&sort=trending | ||
| - search all models (UI): https://huggingface.co/models?inference_provider=all&sort=trending | ||
| - set custom API key from provider (optional) | ||
| - order providers by preference (apply to widget and code snippets) | ||
|
|
||
| ### Features using Inference Providers | ||
|
|
||
| Several Hugging Face features utilize the Inference Providers API and count towards your monthly credits: | ||
|
|
||
| - Inference Widgets: Interactive widgets available on model pages. | ||
| - [Inference Playground](https://huggingface.co/playground): A comprehensive chat interface supporting various models and providers. | ||
| - Data Studio AI: Converts text to SQL queries for datasets. | ||
|
||
|
|
||
| The included monthly credits for PRO and Enterprise should cover moderate usage of these features for most users. | ||
Uh oh!
There was an error while loading. Please reload this page.