Skip to content

restructure inference providers index page #1802

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jul 1, 2025
Merged

restructure inference providers index page #1802

Changes from 2 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a10a09d
restructure index page
burtenshaw Jul 1, 2025
99773d7
move playground back down
burtenshaw Jul 1, 2025
55d4123
move partners table back to the top
burtenshaw Jul 1, 2025
a4e37c0
use shared title for quick start
burtenshaw Jul 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
57 changes: 33 additions & 24 deletions docs/inference-providers/index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,27 +9,6 @@ Hugging Face’s Inference Providers give developers streamlined, unified access

To learn more about the launch of Inference Providers, check out our [announcement blog post](https://huggingface.co/blog/inference-providers).

## Partners

Here is the complete list of partners integrated with Inference Providers, and the supported tasks for each of them:

| Provider | Chat completion (LLM) | Chat completion (VLM) | Feature Extraction | Text to Image | Text to video |
| ---------------------------------------- | :-------------------: | :-------------------: | :----------------: | :-----------: | :-----------: |
| [Cerebras](./providers/cerebras) | ✅ | | | | |
| [Cohere](./providers/cohere) | ✅ | ✅ | | | |
| [Fal AI](./providers/fal-ai) | | | | ✅ | ✅ |
| [Featherless AI](./providers/featherless-ai) | ✅ | ✅ | | | |
| [Fireworks](./providers/fireworks-ai) | ✅ | ✅ | | | |
| [Groq](./providers/groq) | ✅ | | | | |
| [HF Inference](./providers/hf-inference) | ✅ | ✅ | ✅ | ✅ | |
| [Hyperbolic](./providers/hyperbolic) | ✅ | ✅ | | | |
| [Nebius](./providers/nebius) | ✅ | ✅ | ✅ | ✅ | |
| [Novita](./providers/novita) | ✅ | ✅ | | | ✅ |
| [Nscale](./providers/nscale) | ✅ | ✅ | | ✅ | |
| [Replicate](./providers/replicate) | | | | ✅ | ✅ |
| [SambaNova](./providers/sambanova) | ✅ | | ✅ | | |
| [Together](./providers/together) | ✅ | ✅ | | ✅ | |

## Why use Inference Providers?

Inference Providers offers a fast and simple way to explore thousands of models for a variety of tasks. Whether you're experimenting with ML capabilities or building a new application, this API gives you instant access to high-performing models across multiple domains:
Expand All @@ -53,9 +32,29 @@ Inference Providers offers a fast and simple way to explore thousands of models

To get started quickly with [Chat Completion models](http://huggingface.co/models?inference_provider=all&sort=trending&other=conversational), use the [Inference Playground](https://huggingface.co/playground) to easily test and compare models with your prompts.


<a href="https://huggingface.co/playground" target="blank"><img src="https://cdn-uploads.huggingface.co/production/uploads/5f17f0a0925b9863e28ad517/9_Tgf0Tv65srhBirZQMTp.png" style="max-width: 550px; width: 100%;"/></a>

## Partners

Here is the complete list of partners integrated with Inference Providers, and the supported tasks for each of them:

| Provider | Chat completion (LLM) | Chat completion (VLM) | Feature Extraction | Text to Image | Text to video |
| ---------------------------------------- | :-------------------: | :-------------------: | :----------------: | :-----------: | :-----------: |
| [Cerebras](./providers/cerebras) | ✅ | | | | |
| [Cohere](./providers/cohere) | ✅ | ✅ | | | |
| [Fal AI](./providers/fal-ai) | | | | ✅ | ✅ |
| [Featherless AI](./providers/featherless-ai) | ✅ | ✅ | | | |
| [Fireworks](./providers/fireworks-ai) | ✅ | ✅ | | | |
| [Groq](./providers/groq) | ✅ | | | | |
| [HF Inference](./providers/hf-inference) | ✅ | ✅ | ✅ | ✅ | |
| [Hyperbolic](./providers/hyperbolic) | ✅ | ✅ | | | |
| [Nebius](./providers/nebius) | ✅ | ✅ | ✅ | ✅ | |
| [Novita](./providers/novita) | ✅ | ✅ | | | ✅ |
| [Nscale](./providers/nscale) | ✅ | ✅ | | ✅ | |
| [Replicate](./providers/replicate) | | | | ✅ | ✅ |
| [SambaNova](./providers/sambanova) | ✅ | | ✅ | | |
| [Together](./providers/together) | ✅ | ✅ | | ✅ | |

## Get Started

You can use Inference Providers with your preferred tools, such as Python, JavaScript, or cURL. To simplify integration, we offer both a Python SDK (`huggingface_hub`) and a JavaScript SDK (`huggingface.js`).
Expand All @@ -72,6 +71,9 @@ Inference Providers requires passing a user token in the request headers. You ca

For more details about user tokens, check out [this guide](https://huggingface.co/docs/hub/en/security-tokens).

<hfoptions id="inference-providers-examples">
<hfoption id="curl">

### cURL

Let's start with a cURL command highlighting the raw HTTP request. You can adapt this request to be run with the tool of your choice.
Expand All @@ -92,6 +94,9 @@ curl https://router.huggingface.co/novita/v3/openai/chat/completions \
}'
```

</hfoption>
<hfoption id="python">

### Python

In Python, you can use the `requests` library to make raw requests to the API:
Expand Down Expand Up @@ -140,11 +145,13 @@ completion = client.chat.completions.create(
print(completion.choices[0].message)
```

</hfoption>
<hfoption id="javascript">

### JavaScript

In JS, you can use the `fetch` library to make raw requests to the API:


```js
import fetch from "node-fetch";

Expand Down Expand Up @@ -173,7 +180,6 @@ console.log(await response.json());

For convenience, the JS library `@huggingface/inference` provides an [`InferenceClient`](https://huggingface.co/docs/huggingface.js/inference/classes/InferenceClient) that handles inference for you. You can install it with `npm install @huggingface/inference`.


```js
import { InferenceClient } from "@huggingface/inference";

Expand All @@ -193,6 +199,9 @@ const chatCompletion = await client.chatCompletion({
console.log(chatCompletion.choices[0].message);
```

</hfoption>
</hfoptions>

## Next Steps

In this introduction, we've covered the basics of Inference Providers. To learn more about this service, check out our guides and API Reference:
Expand Down