Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ APIs run by the companies that train or fine-tune the models themselves.

Third-party platforms that host open-weight models from various sources.

- [AIHubMix](https://console.aihubmix.com/token) ๐Ÿ‡บ๐Ÿ‡ธ - GPT-4o, Gemini 3.1 Flash, GLM-5 +17 more. 5 RPM, 500 RPD.
- [Cerebras](https://cloud.cerebras.ai/) ๐Ÿ‡บ๐Ÿ‡ธ - Llama 3.3 70B, Qwen3 235B, GPT-OSS-120B +3 more. 30 RPM, 14,400 RPD.
- [Cloudflare Workers AI](https://dash.cloudflare.com/profile/api-tokens) ๐Ÿ‡บ๐Ÿ‡ธ - Llama 3.3 70B, Qwen QwQ 32B +47 more. 10K neurons/day.
- [GitHub Models](https://github.com/marketplace/models) ๐Ÿ‡บ๐Ÿ‡ธ - GPT-4o, Llama 3.3 70B, DeepSeek-R1 +more. 10-15 RPM, 50-150 RPD.
Expand Down
37 changes: 37 additions & 0 deletions free-llm-apis/references/inference-providers.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,43 @@

Third-party platforms that host open-weight models from various sources.

## AIHubMix

**Models:** GPT-4o, Gemini 3.1 Flash, GLM-5 +17 more
**Limits:** 5 RPM, 500 RPD

### Get your API key

1. Go to [AIHubMix Console](https://console.aihubmix.com/token).
2. Create an account or sign in.
3. Click "Create Token."
4. Copy the token.

### Usage example

```python
from openai import OpenAI

client = OpenAI(
api_key="YOUR_AIHUBMIX_API_KEY",
base_url="https://aihubmix.com/v1/"
)

response = client.chat.completions.create(
model="gpt-4o-free",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)
```

### Environment variable

```bash
export AIHUBMIX_API_KEY="your-key-here"
```

---

## GitHub Models

**Models:** GPT-4o, Llama 3.3 70B, DeepSeek-R1 +more
Expand Down