Claude 3.7 "top_k must be unset" [REQUIRES UPDATE]
#6032
Replies: 3 comments 12 replies
-
|
Simply start a new chat without setting Top K. LibreChat is not opinionated with the parameters and does not set it for you, nor will it try to remove params if they were set manually based on model support. |
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
Thanks. Would have sworn I've never touched the |
Beta Was this translation helpful? Give feedback.
-
|
@danny-avila LibreChat actually does set the top_k parameter after you switch from Google endpoint to Claude. Manually setting it back to 5 from 40 didn't help either. |
Beta Was this translation helpful? Give feedback.
-
|
@KiGamji you bring up a different point, I'll address that soon |
Beta Was this translation helpful? Give feedback.
-
|
I have the same problem (with top_p), I don't see any way to make Claude 3.7 thinking work. It always says top_p must be unset. If I set it at 0 or 1, it doesn't solve the problem. If I switch from another Anthropic model, or from another provider, or if I set this model as default preset and then press new chat, it does not get rid of the problem. |
Beta Was this translation helpful? Give feedback.
-
|
Removing the default preset worked for me, thanks. |
Beta Was this translation helpful? Give feedback.
-
|
update resolves this: #6074 |
Beta Was this translation helpful? Give feedback.
-
|
The latest commit still doesn't seem to fully resolve the issue for me. When I have a default preset set and I select 3.7 thinking, it doesn't work. When I create another preset for it, the resulting preset does not work. However, I was just able to get around it by doing the following:
|
Beta Was this translation helpful? Give feedback.
-
chrome_gVKBrCnyf7.mp4Updating Instructions (docker): # Linux command to Remove all existing images
docker images -a | grep "librechat" | awk '{print $3}' | xargs docker rmi
# Windows Powershell
docker images -a | findstr "librechat" | ForEach-Object { docker rmi $_.Split()[2] }Then follow the directions here: https://www.librechat.ai/docs/local/docker#update-librechat |
Beta Was this translation helpful? Give feedback.
-
|
note same effect with or w/o a default preset |
Beta Was this translation helpful? Give feedback.
-
Recently, I have also been studying how to control the parameters of claude-3.7-sonnet thinking. I saw that the parameters in your graph have the options of 
There are no these two buttons in my parameter sidebar. Are you the anthropic endpoint configured through |
Beta Was this translation helpful? Give feedback.
-
|
In a custom endpoint, it's not yet supported, but will be: #6503 |
Beta Was this translation helpful? Give feedback.
-
|
THX a lot😊 |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
What happened?
I am trying to use the new Claude 3.7 model with Thinking enabled. I edited the line in my
.envfile:ANTHROPIC_MODELS=claude-3-7-sonnet-20250219,claude-3-opus-20240229,claude-3-5-haiku-20241022But when I run a test query with that model, I get this:
Something went wrong. Here's the specific error message we encountered: Operation failed after 3 attempts: 400 {"type":"error","error":{"type":"invalid_request_error","message":"top_kmust be unset when thinking is enabled. Please consult our documentation at https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking#important-considerations-when-using-extended-thinking"}}Changing the
top_kparameter in the sidebar does not make the error go away.Queries without thinking mode enabled do not cause an error.
Version Information
Steps to Reproduce
claude-3-7-sonnet-20250219modelWhat browsers are you seeing the problem on?
No response
Screenshots
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions