Skip to content

feat: add model links to inference provider templates #1803

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jul 1, 2025
Merged

feat: add model links to inference provider templates #1803

Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
e636d6a
feat: add model links to inference provider templates
google-labs-jules[bot] Jul 1, 2025
8a7b679
Run the generate script.
Vaibhavs10 Jul 1, 2025
f4baaaa
docs
Vaibhavs10 Jul 1, 2025
41280c7
up.
Vaibhavs10 Jul 1, 2025
f87ea2e
newline in tip
Vaibhavs10 Jul 1, 2025
b5cf0a3
forgot to push the main files
Vaibhavs10 Jul 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion docs/inference-providers/providers/cerebras.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,10 @@ Logos must be in .png format and be named `cerebras-light.png` and `cerebras-dar
For more details, check out the `generate.ts` script: https://github.com/huggingface/hub-docs/blob/main/scripts/inference-providers/scripts/generate.ts.
--->

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

# Cerebras

<div class="flex justify-center">
Expand Down Expand Up @@ -44,7 +48,7 @@ Find out more about Chat Completion (LLM) [here](../tasks/chat-completion).

<InferenceSnippet
pipeline=text-generation
providersMapping={ {"cerebras":{"modelId":"Qwen/Qwen3-32B","providerModelId":"qwen-3-32b"} } }
providersMapping={ {"cerebras":{"modelId":"meta-llama/Llama-3.3-70B-Instruct","providerModelId":"llama-3.3-70b"} } }
conversational />


Expand Down
4 changes: 4 additions & 0 deletions docs/inference-providers/providers/cohere.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Cohere

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://cohere.com/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/cohere-light.png"/>
Expand Down
16 changes: 15 additions & 1 deletion docs/inference-providers/providers/fal-ai.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Fal

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://fal.ai/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/fal-ai-light.png"/>
Expand Down Expand Up @@ -48,6 +52,16 @@ Find out more about Automatic Speech Recognition [here](../tasks/automatic_speec
/>


### Image To Image

Find out more about Image To Image [here](../tasks/image_to_image).

<InferenceSnippet
pipeline=image-to-image
providersMapping={ {"fal-ai":{"modelId":"black-forest-labs/FLUX.1-Kontext-dev","providerModelId":"fal-ai/flux-kontext/dev"} } }
/>


### Text To Image

Find out more about Text To Image [here](../tasks/text_to_image).
Expand All @@ -64,6 +78,6 @@ Find out more about Text To Video [here](../tasks/text_to_video).

<InferenceSnippet
pipeline=text-to-video
providersMapping={ {"fal-ai":{"modelId":"Lightricks/LTX-Video","providerModelId":"fal-ai/ltx-video"} } }
providersMapping={ {"fal-ai":{"modelId":"tencent/HunyuanVideo","providerModelId":"fal-ai/hunyuan-video"} } }
/>

10 changes: 7 additions & 3 deletions docs/inference-providers/providers/featherless-ai.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Featherless AI

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
Copy link
Contributor

@NielsRogge NielsRogge Jul 1, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This results in a 404, I assume it needs to be https://huggingface.co/models?inference_provider=featherless-ai&sort=trending

Copy link
Member Author

@Vaibhavs10 Vaibhavs10 Jul 1, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm.. let me see what went wrong

</Tip>

<div class="flex justify-center">
<a href="https://featherless.ai/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/featherless-ai-light.png"/>
Expand Down Expand Up @@ -46,7 +50,7 @@ Find out more about Chat Completion (LLM) [here](../tasks/chat-completion).

<InferenceSnippet
pipeline=text-generation
providersMapping={ {"featherless-ai":{"modelId":"mistralai/Magistral-Small-2506","providerModelId":"mistralai/Magistral-Small-2506"} } }
providersMapping={ {"featherless-ai":{"modelId":"deepseek-ai/DeepSeek-R1-0528","providerModelId":"deepseek-ai/DeepSeek-R1-0528"} } }
conversational />


Expand All @@ -56,7 +60,7 @@ Find out more about Chat Completion (VLM) [here](../tasks/chat-completion).

<InferenceSnippet
pipeline=image-text-to-text
providersMapping={ {"featherless-ai":{"modelId":"google/gemma-3-27b-it","providerModelId":"google/gemma-3-27b-it"} } }
providersMapping={ {"featherless-ai":{"modelId":"google/medgemma-4b-it","providerModelId":"google/medgemma-4b-it"} } }
conversational />


Expand All @@ -66,6 +70,6 @@ Find out more about Text Generation [here](../tasks/text_generation).

<InferenceSnippet
pipeline=text-generation
providersMapping={ {"featherless-ai":{"modelId":"mistralai/Magistral-Small-2506","providerModelId":"mistralai/Magistral-Small-2506"} } }
providersMapping={ {"featherless-ai":{"modelId":"deepseek-ai/DeepSeek-R1-0528","providerModelId":"deepseek-ai/DeepSeek-R1-0528"} } }
/>

4 changes: 4 additions & 0 deletions docs/inference-providers/providers/fireworks-ai.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Fireworks AI

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://fireworks.ai/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/fireworks-ai-light.png"/>
Expand Down
6 changes: 5 additions & 1 deletion docs/inference-providers/providers/groq.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Groq

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://groq.com/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/groq-light.png"/>
Expand Down Expand Up @@ -54,7 +58,7 @@ Find out more about Chat Completion (LLM) [here](../tasks/chat-completion).

<InferenceSnippet
pipeline=text-generation
providersMapping={ {"groq":{"modelId":"Qwen/Qwen3-32B","providerModelId":"qwen/qwen3-32b"} } }
providersMapping={ {"groq":{"modelId":"meta-llama/Llama-3.3-70B-Instruct","providerModelId":"llama-3.3-70b-versatile"} } }
conversational />


Expand Down
14 changes: 9 additions & 5 deletions docs/inference-providers/providers/hf-inference.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# HF Inference

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://huggingface.co/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/hf-inference-light.png"/>
Expand Down Expand Up @@ -55,7 +59,7 @@ Find out more about Chat Completion (LLM) [here](../tasks/chat-completion).

<InferenceSnippet
pipeline=text-generation
providersMapping={ {"hf-inference":{"modelId":"sarvamai/sarvam-m","providerModelId":"sarvamai/sarvam-m"} } }
providersMapping={ {"hf-inference":{"modelId":"meta-llama/Llama-3.1-8B-Instruct","providerModelId":"meta-llama/Llama-3.1-8B-Instruct"} } }
conversational />


Expand All @@ -65,7 +69,7 @@ Find out more about Chat Completion (VLM) [here](../tasks/chat-completion).

<InferenceSnippet
pipeline=image-text-to-text
providersMapping={ {"hf-inference":{"modelId":"meta-llama/Llama-3.2-11B-Vision-Instruct","providerModelId":"meta-llama/Llama-3.2-11B-Vision-Instruct"} } }
providersMapping={ {"hf-inference":{"modelId":"mistralai/Mistral-Small-3.1-24B-Instruct-2503","providerModelId":"mistralai/Mistral-Small-3.1-24B-Instruct-2503"} } }
conversational />


Expand Down Expand Up @@ -135,7 +139,7 @@ Find out more about Summarization [here](../tasks/summarization).

<InferenceSnippet
pipeline=summarization
providersMapping={ {"hf-inference":{"modelId":"facebook/bart-large-cnn","providerModelId":"facebook/bart-large-cnn"} } }
providersMapping={ {"hf-inference":{"modelId":"Falconsai/text_summarization","providerModelId":"Falconsai/text_summarization"} } }
/>


Expand All @@ -155,7 +159,7 @@ Find out more about Text Classification [here](../tasks/text_classification).

<InferenceSnippet
pipeline=text-classification
providersMapping={ {"hf-inference":{"modelId":"distilbert/distilbert-base-uncased-finetuned-sst-2-english","providerModelId":"distilbert/distilbert-base-uncased-finetuned-sst-2-english"} } }
providersMapping={ {"hf-inference":{"modelId":"tabularisai/multilingual-sentiment-analysis","providerModelId":"tabularisai/multilingual-sentiment-analysis"} } }
/>


Expand All @@ -165,7 +169,7 @@ Find out more about Text Generation [here](../tasks/text_generation).

<InferenceSnippet
pipeline=text-generation
providersMapping={ {"hf-inference":{"modelId":"sarvamai/sarvam-m","providerModelId":"sarvamai/sarvam-m"} } }
providersMapping={ {"hf-inference":{"modelId":"meta-llama/Llama-3.1-8B-Instruct","providerModelId":"meta-llama/Llama-3.1-8B-Instruct"} } }
/>


Expand Down
4 changes: 4 additions & 0 deletions docs/inference-providers/providers/hyperbolic.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Hyperbolic: The On-Demand AI Cloud

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://hyperbolic.xyz/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/hyperbolic-light.png"/>
Expand Down
6 changes: 5 additions & 1 deletion docs/inference-providers/providers/nebius.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Nebius

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://nebius.com/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/nebius-light.png"/>
Expand Down Expand Up @@ -64,7 +68,7 @@ Find out more about Feature Extraction [here](../tasks/feature_extraction).

<InferenceSnippet
pipeline=feature-extraction
providersMapping={ {"nebius":{"modelId":"intfloat/e5-mistral-7b-instruct","providerModelId":"intfloat/e5-mistral-7b-instruct"} } }
providersMapping={ {"nebius":{"modelId":"Qwen/Qwen3-Embedding-8B","providerModelId":"Qwen/Qwen3-Embedding-8B"} } }
/>


Expand Down
4 changes: 4 additions & 0 deletions docs/inference-providers/providers/novita.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Novita

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://novita.ai/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/novita-light.png"/>
Expand Down
4 changes: 4 additions & 0 deletions docs/inference-providers/providers/nscale.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Nscale

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://www.nscale.com/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/nscale-light.png"/>
Expand Down
16 changes: 15 additions & 1 deletion docs/inference-providers/providers/replicate.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Replicate

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://replicate.com/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/replicate-light.png"/>
Expand All @@ -38,6 +42,16 @@ Replicate is building tools so all software engineers can use AI as if it were n
## Supported tasks


### Image To Image

Find out more about Image To Image [here](../tasks/image_to_image).

<InferenceSnippet
pipeline=image-to-image
providersMapping={ {"replicate":{"modelId":"black-forest-labs/FLUX.1-Kontext-dev","providerModelId":"black-forest-labs/flux-kontext-dev"} } }
/>


### Text To Image

Find out more about Text To Image [here](../tasks/text_to_image).
Expand All @@ -54,6 +68,6 @@ Find out more about Text To Video [here](../tasks/text_to_video).

<InferenceSnippet
pipeline=text-to-video
providersMapping={ {"replicate":{"modelId":"Lightricks/LTX-Video","providerModelId":"lightricks/ltx-video:8c47da666861d081eeb4d1261853087de23923a268a69b63febdf5dc1dee08e4"} } }
providersMapping={ {"replicate":{"modelId":"Wan-AI/Wan2.1-T2V-14B","providerModelId":"wavespeedai/wan-2.1-t2v-480p"} } }
/>

6 changes: 5 additions & 1 deletion docs/inference-providers/providers/sambanova.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# SambaNova

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://sambanova.ai/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/sambanova-light.png"/>
Expand Down Expand Up @@ -55,7 +59,7 @@ Find out more about Chat Completion (VLM) [here](../tasks/chat-completion).

<InferenceSnippet
pipeline=image-text-to-text
providersMapping={ {"sambanova":{"modelId":"meta-llama/Llama-4-Scout-17B-16E-Instruct","providerModelId":"Llama-4-Scout-17B-16E-Instruct"} } }
providersMapping={ {"sambanova":{"modelId":"meta-llama/Llama-4-Maverick-17B-128E-Instruct","providerModelId":"Llama-4-Maverick-17B-128E-Instruct"} } }
conversational />


Expand Down
4 changes: 4 additions & 0 deletions docs/inference-providers/providers/together.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ For more details, check out the `generate.ts` script: https://github.com/hugging

# Together

<Tip>
All supported models can be found [here](https://huggingface.co/models?inference_provider=&sort=trending)
</Tip>

<div class="flex justify-center">
<a href="https://together.xyz/" target="_blank">
<img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/logos/together-light.png"/>
Expand Down
Loading