Skip to content

Conversation

vijayth2-cerebras
Copy link
Contributor

What

Adds Cerebras as an inference provider.

Test Plan

Added new tests for Cerebras both with and without streaming.

What Should Reviewers Focus On?

I used the Cohere PR as an example.

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@julien-c
Copy link
Member

julien-c commented Mar 3, 2025

i launched the CI runs

@vijayth2-cerebras
Copy link
Contributor Author

The failing tests are unrelated.

@vijayth2-cerebras
Copy link
Contributor Author

@julien-c Is there something that I need to do to make the tests pass?

@hagayl-cerebras
Copy link

@vijayth2-cerebras - let's make sure the model mapping includes all Cerebras GA models on shared replicas:

  • Llama-3.3-70b
  • Llama-3.1-8b
  • DeepSeek-R1-Distill-Llama-70B

Copy link
Contributor

@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All good! Thanks for the clean PR, getting approval on first shot! 🤗

I opened its Python's counterpart here: huggingface/huggingface_hub#2901

Copy link
Contributor

@SBrandeis SBrandeis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clean!

@julien-c julien-c merged commit 85250e7 into huggingface:main Mar 4, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants