Skip to content

Conversation

@jyotirmoy-devops
Copy link

@jyotirmoy-devops jyotirmoy-devops commented Dec 29, 2025

In the Unit 2 code for HuggingFaceInferenceAPIm the below code gives a 404 inference client not found error

llm = HuggingFaceInferenceAPI(model_name="Qwen/Qwen2.5-Coder-32B-Instruct")

In order to fix the issue, we need to add the provider and the token

llm = HuggingFaceInferenceAPI(model_name="Qwen/Qwen2.5-Coder-32B-Instruct", token=userdata.get('HF_TOKEN'), provider="auto")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant