Skip to content

[inference providers] add some more info in the "register as provider" docs #2026

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Oct 30, 2025
Merged

[inference providers] add some more info in the "register as provider" docs #2026

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
873d554
add some more inofo in the register as provider docs
SBrandeis Oct 30, 2025
0d44aa4
Update docs/inference-providers/register-as-a-provider.md
SBrandeis Oct 30, 2025
dfc730b
Update docs/inference-providers/register-as-a-provider.md
SBrandeis Oct 30, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 36 additions & 0 deletions docs/inference-providers/register-as-a-provider.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,7 @@ Congratulations! You now have a JS implementation to successfully make inference
First step is to use the Model Mapping API to register which HF models are supported.

> [!TIP]
> The completion of step 1. and 2. are pre-requisites for this step.
> To proceed with this step, we have to enable your account server-side. Make sure you have an organization on the Hub for your company, and upgrade it to a [Team or Enterprise plan](https://huggingface.co/pricing).

### Register a mapping item
Expand Down Expand Up @@ -366,6 +367,8 @@ Content-Type: application/json
}
```

This API endpoint will be requested by our system every minute, in batches of up to 10,000 requests.

### Price Unit

We require the price to be a **non-negative integer** number of **nano-USDs** (10^-9 USD).
Expand Down Expand Up @@ -393,6 +396,39 @@ Inference-Id: unique-id-00131
[response body]
```

### Exposing pricing through OpenAI /models routes

If your API is OpenAI-compatible, we expect that you expose LLM pricing information and context length through the [`/v1/models` endpoint](https://platform.openai.com/docs/api-reference/models/list).

This powers our [provider comparison table](https://huggingface.co/inference/models) and other provider selection features like `:cheapest` (which selects the cheapest provider for a model).


<div class="flex justify-center">
<picture>
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/provider-comparison-table.png">
<img class="hidden dark:block" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/provider-comparison-table-dark.png">
</picture>
</div>

The format we expect is as follows:

```json
{
{
"id": "model-id-0",
"object": "model",
"created": 1686935002,
"owned_by": "organization-owner",
/// [...] other fields
"pricing": {
"input": 0.2, /// Price in US dollars per million input tokens
"output": 2, /// Price in US dollars per million output tokens
},
"context_length": 200000, /// Supported context length in tokens
},
}
```

## 5. Python client integration

> [!TIP]
Expand Down