Cannot Run Sonnet 3.7 Natively [REQUIRES UPDATE]

[cryptoguard]

What happened?

Hello,

It seems I am not able to run any Claude Sonnet 3.7 when natively using their API. Claude Sonnet 3.5 works fine, and 3.7 works fine when using it via OpenRouter.

Error I get:

Something went wrong. Here's the specific error message we encountered: Operation failed after 3 attempts: 400 {"type":"error","error":{"type":"invalid_request_error","message":"prompt: Input should be a valid string"}}

I'm using the Docker version of LibreChat self-hosted on a VM. The docker image is up-to-date as of this writing. I've added both model versions to my .env file, that is to say, both claude-3-7-sonnet-20250219 and claude-3-7-sonnet-latest. Neither work.

Thanks

Version Information

4471de87c1289947c0aab222004c9db1e8fa22cf (LibreChat v0.7.7-rc1)

Steps to Reproduce

1. Send any query to Anthropic's Claude Sonnet 3.7 via their API.

What browsers are you seeing the problem on?

No response

Relevant log output

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Updating Instructions (docker):

# Linux command to Remove all existing images
docker images -a | grep "librechat" | awk '{print $3}' | xargs docker rmi

# Windows Powershell
docker images -a | findstr "librechat" | ForEach-Object { docker rmi $_.Split()[2] }

Then follow the directions here: https://www.librechat.ai/docs/local/docker#update-librechat

[cryptoguard]

Thank you, I was missing this command when updating: docker images -a | grep "librechat" | awk '{print $3}' | xargs docker rmi

[kukoboris]

@danny-avila Sorry, but it does not work for me:

1. I did docker images -a | grep "librechat" | awk '{print $3}' | xargs docker rmi
2. I did normal update after that
3. I use librechat-dev-api:latest in my docker-compose.yml
4. I turned off "thinking" (I do not need this)

And I get this error anyway: "Something went wrong. Here's the specific error message we encountered: Operation failed after 3 attempts: 400 {"type":"error","error":{"type":"invalid_request_error","message":"topP: Extra inputs are not permitted"}}"

[jutton1]

I encountered an issue with @danny-avila's PowerShell script for removing Docker images. The original command doesn't work correctly:

docker images -a | findstr "librechat" | ForEach-Object { docker rmi $_.Split()[2] }

This results in the error:

docker: 'docker rmi' requires at least 1 argument
Usage:  docker rmi [OPTIONS] IMAGE [IMAGE...]

I found that the following alternative approach works properly:

docker images -a --format "{{.ID}}" --filter "reference=*librechat*" | ForEach-Object { docker rmi $_ }

This uses Docker's built-in filtering and formatting capabilities, which (I think) handles the image ID extraction correctly.

Could you please add this corrected command to the documentation at https://www.librechat.ai/docs/local/docker#update-librechat? This would help other users avoid the same issue when updating.

[jutton1]

@danny-avila
I just went ahead and added a pull request for the markdown code.
LibreChat-AI/librechat.ai#281

[publicvirtualvoid]

Unfortunately running through the updated instructions doesn't resolve the problem in my case. The error message is the same.

Something went wrong. Here's the specific error message we encountered: Operation failed after 3 attempts: 400 {"type":"error","error":{"type":"invalid_request_error","message":"prompt: Input should be a valid string"}}

[srcnkmn]

I also get this one, still, after following the instructions by @danny-avila
It also keeps repeating itself when I am using it in an agent and when the code is very long. "Go on" etc. seem to just let it start again with the answer

[danny-avila]

likely not using the -dev-latest image if you tried the update instructions.

by default, the docker compose file uses it, but check just in case:

LibreChat/docker-compose.yml

Line 12 in 2293cd6

image: ghcr.io/danny-avila/librechat-dev:latest

[publicvirtualvoid]

@danny-avila thanks for you patience, I was indeed missing the -dev part of the image string. Working well now!

[faerazo]

For the ones using the docker-compose override, change the image to:

image: ghcr.io/danny-avila/librechat-dev:latest 

LibreChat/docker-compose.override.yml.example

Line 20 in 2293cd6

# image: ghcr.io/danny-avila/librechat:latest