Having Problem registering anthropic Models on Llama-Stack #3701
Replies: 4 comments 9 replies
-
|
check which models Anthropic's model listing endpoint (https://api.anthropic.com/v1/models) is advertising. you can use anything in the |
Beta Was this translation helpful? Give feedback.
-
|
Hey Yes I did that. I tried registering all the models listed for my anthropic api endpoint. But I keep getting the same error every time. Traceback (most recent call last): |
Beta Was this translation helpful? Give feedback.
-
|
Also I am facing another issue where I want to use a filesystem mcp server hosted on port 8000. But everytimne I run the code I get an error that my sever is not compatible with my client. Code: import json client = LlamaStackClient(base_url="http://localhost:8321") llm = next( client.toolgroups.register( agent = Agent( print("Agent created:", agent.agent_id) turn = agent.create_turn( print("\n--- Agent response (stream) ---") ERROR: INFO:httpx:HTTP Request: GET http://localhost:8321/v1/models "HTTP/1.1 426 Upgrade Required" |
Beta Was this translation helpful? Give feedback.
-
|
@mansiUnifynd unfortunately i'm not sure how to help. the problematic environment has been py3.10, py3.12, py.3.13 with various combinations of old and new llama stack and llama stack client installed. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
I’ve been trying to register Anthropic models, but every time I add one it says the model isn’t supported.
Could someone please guide me on how to properly register Anthropic models on Llama Stack? It would be a great help.
Heres the list of things I have done:
I have update the API Key in my run.yaml
- provider_id: anthropic
provider_type: remote::anthropic
config:
api_key: ${env.ANTHROPIC_API_KEY:""}
Below is the command that i am using to register the model:
llama-stack-client models register claude-3-5-sonnet --provider-id anthropic --provider-model-id claude-3-5-sonnet-latest --metadata {} --model-type llm
ERROR I AM GETTING:
INFO:httpx:HTTP Request: POST http://localhost:8321/v1/models "HTTP/1.1 400 Bad Request"
╭─────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Failed to register model │
│ │
│ Error Type: BadRequestError │
│ Details: Error code: 400 - {'detail': 'Invalid value: Unsupported model: claude-3-5-sonnet-latest'} │
Beta Was this translation helpful? Give feedback.
All reactions