You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/hub/billing.md
+4-3Lines changed: 4 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,9 +25,10 @@ Private repository storage above the [included storage](./storage-limits) will b
25
25
26
26
The PRO subscription unlocks additional features for users, including:
27
27
28
-
- Higher free tier for the Serverless Inference API and when consuming ZeroGPU Spaces
29
-
- Higher [storage capacity](./storage-limits) for private repositories
28
+
- Higher tier for ZeroGPU Spaces usage
30
29
- Ability to create ZeroGPU Spaces and use Dev Mode
30
+
- Included credits for [Inference Providers](/docs/inference-providers/)
31
+
- Higher [storage capacity](./storage-limits) for private repositories
31
32
- Ability to write Social Posts and Community Blogs
32
33
- Leverage the Dataset Viewer on private datasets
33
34
@@ -48,7 +49,7 @@ It is billed with the renewal invoices of your PRO or Enterprise Hub subscriptio
48
49
49
50
## Compute Services on the Hub
50
51
51
-
We also directly provide compute services with [Spaces](./spaces), [Inference Endpoints](https://huggingface.co/docs/inference-endpoints/index) and the [Serverless Inference API](https://huggingface.co/docs/api-inference/index).
52
+
We also directly provide compute services with [Spaces](./spaces), [Inference Endpoints](https://huggingface.co/docs/inference-endpoints/index) and [Inference Providers](https://huggingface.co/docs/inference-providers/index).
52
53
53
54
While most of our compute services have a comprehensive free tier, users and organizations can pay to access more powerful hardware accelerators.
Please refer to [Serverless Inference API Documentation](https://huggingface.co/docs/api-inference) for detailed information.
3
+
Please refer to the [Inference Providers Documentation](https://huggingface.co/docs/inference-providers) for detailed information.
4
4
5
5
6
-
## What technology do you use to power the Serverless Inference API?
6
+
## What technology do you use to power the HF-Inference API?
7
7
8
8
For 🤗 Transformers models, [Pipelines](https://huggingface.co/docs/transformers/main_classes/pipelines) power the API.
9
9
@@ -14,13 +14,13 @@ On top of `Pipelines` and depending on the model type, there are several product
14
14
15
15
For models from [other libraries](./models-libraries), the API uses [Starlette](https://www.starlette.io) and runs in [Docker containers](https://github.com/huggingface/api-inference-community/tree/main/docker_images). Each library defines the implementation of [different pipelines](https://github.com/huggingface/api-inference-community/tree/main/docker_images/sentence_transformers/app/pipelines).
16
16
17
-
## How can I turn off the Serverless Inference API for my model?
17
+
## How can I turn off the HF-Inference API for my model?
18
18
19
19
Specify `inference: false` in your model card's metadata.
20
20
21
21
## Why don't I see an inference widget, or why can't I use the API?
22
22
23
-
For some tasks, there might not be support in the Serverless Inference API, and, hence, there is no widget.
23
+
For some tasks, there might not be support in the HF-Inference API, and, hence, there is no widget.
24
24
For all libraries (except 🤗 Transformers), there is a [library-to-tasks.ts file](https://github.com/huggingface/huggingface.js/blob/main/packages/tasks/src/library-to-tasks.ts) of supported tasks in the API. When a model repository has a task that is not supported by the repository library, the repository has `inference: false` by default.
25
25
26
26
## Can I send large volumes of requests? Can I get accelerated APIs?
@@ -31,6 +31,6 @@ If you are interested in accelerated inference, higher volumes of requests, or a
31
31
32
32
You can check your usage in the [Inference Dashboard](https://ui.endpoints.huggingface.co/endpoints). The dashboard shows both your serverless and dedicated endpoints usage.
33
33
34
-
## Is there programmatic access to the Serverless Inference API?
34
+
## Is there programmatic access to the HF-Inference API?
35
35
36
-
Yes, the `huggingface_hub` library has a client wrapper documented [here](https://huggingface.co/docs/huggingface_hub/how-to-inference).
36
+
Yes, the `huggingface_hub` library has a client wrapper documented [here](https://huggingface.co/docs/huggingface_hub/guides/inference).
Copy file name to clipboardExpand all lines: docs/hub/models-the-hub.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
## What is the Model Hub?
4
4
5
-
The Model Hub is where the members of the Hugging Face community can host all of their model checkpoints for simple storage, discovery, and sharing. Download pre-trained models with the [`huggingface_hub` client library](https://huggingface.co/docs/huggingface_hub/index), with 🤗 [`Transformers`](https://huggingface.co/docs/transformers/index) for fine-tuning and other usages or with any of the over [15 integrated libraries](./models-libraries). You can even leverage the [Serverless Inference API](./models-inference) or [Inference Endpoints](https://huggingface.co/docs/inference-endpoints). to use models in production settings.
5
+
The Model Hub is where the members of the Hugging Face community can host all of their model checkpoints for simple storage, discovery, and sharing. Download pre-trained models with the [`huggingface_hub` client library](https://huggingface.co/docs/huggingface_hub/index), with 🤗 [`Transformers`](https://huggingface.co/docs/transformers/index) for fine-tuning and other usages or with any of the over [15 integrated libraries](./models-libraries). You can even leverage [Inference Providers](/docs/inference-providers/) or [Inference Endpoints](https://huggingface.co/docs/inference-endpoints) to use models in production settings.
6
6
7
7
You can refer to the following video for a guide on navigating the Model Hub:
Copy file name to clipboardExpand all lines: docs/hub/models-widgets.md
+5-3Lines changed: 5 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -168,9 +168,9 @@ Here are some links to examples:
168
168
- `table-question-answering`, for instance [`google/tapas-base-finetuned-wtq`](https://huggingface.co/google/tapas-base-finetuned-wtq)
169
169
- `sentence-similarity`, for instance [`osanseviero/full-sentence-distillroberta2`](/osanseviero/full-sentence-distillroberta2)
170
170
171
-
## How can I control my model's widget Inference API parameters?
171
+
## How can I control my model's widget HF-Inference API parameters?
172
172
173
-
Generally, the Inference API for a model uses the default pipeline settings associated with each task. But if you'd like to change the pipeline's default settings and specify additional inference parameters, you can configure the parameters directly through the model card metadata. Refer [here](https://huggingface.co/docs/api-inference/detailed_parameters) for some of the most commonly used parameters associated with each task.
173
+
Generally, the HF-Inference API for a model uses the default pipeline settings associated with each task. But if you'd like to change the pipeline's default settings and specify additional inference parameters, you can configure the parameters directly through the model card metadata. Refer [here](https://huggingface.co/docs/inference-providers/detailed_parameters) for some of the most commonly used parameters associated with each task.
174
174
175
175
For example, if you want to specify an aggregation strategy for a NER task in the widget:
176
176
@@ -188,4 +188,6 @@ inference:
188
188
temperature: 0.7
189
189
```
190
190
191
-
The Serverless inference API allows you to send HTTP requests to models in the Hugging Face Hub programatically. ⚡⚡ Learn more about it by reading the [Inference API documentation](./models-inference). Finally, you can also deploy all those models to dedicated [Inference Endpoints](https://huggingface.co/docs/inference-endpoints).
191
+
Inference Providers allows you to send HTTP requests to models in the Hugging Face Hub programatically. It is an abstraction layer on top of External providers. ⚡⚡ Learn more about it by reading the [
Copy file name to clipboardExpand all lines: docs/hub/oauth.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -35,7 +35,7 @@ The currently supported scopes are:
35
35
-`read-repos`: Get read access to the user's personal repos.
36
36
-`write-repos`: Get write/read access to the user's personal repos.
37
37
-`manage-repos`: Get full access to the user's personal repos. Also grants repo creation and deletion.
38
-
-`inference-api`: Get access to the [Inference API](https://huggingface.co/docs/api-inference/index), you will be able to make inference requests on behalf of the user.
38
+
-`inference-api`: Get access to the [Inference API](https://huggingface.co/docs/inference-providers/index), you will be able to make inference requests on behalf of the user.
39
39
-`write-discussions`: Open discussions and Pull Requests on behalf of the user as well as interact with discussions (including reactions, posting/editing comments, closing discussions, ...). To open Pull Requests on private repos, you need to request the `read-repos` scope as well.
40
40
41
41
All other information is available in the [OpenID metadata](https://huggingface.co/.well-known/openid-configuration).
Copy file name to clipboardExpand all lines: docs/hub/spaces-oauth.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -81,7 +81,7 @@ Those scopes are optional and can be added by setting `hf_oauth_scopes` in your
81
81
- `read-repos`: Get read access to the user's personal repos.
82
82
- `write-repos`: Get write/read access to the user's personal repos.
83
83
- `manage-repos`: Get full access to the user's personal repos. Also grants repo creation and deletion.
84
-
- `inference-api`: Get access to the [Inference API](https://huggingface.co/docs/api-inference/index), you will be able to make inference requests on behalf of the user.
84
+
- `inference-api`: Get access to the [Inference API](https://huggingface.co/docs/inference-providers/index), you will be able to make inference requests on behalf of the user.
85
85
- `write-discussions`: Open discussions and Pull Requests on behalf of the user as well as interact with discussions (including reactions, posting/editing comments, closing discussions, ...). To open Pull Requests on private repos, you need to request the `read-repos` scope as well.
0 commit comments