SGLang QwQ Tool use with LibreChat agent fails

[JohnZolton]

What happened?

I'm running Librechat in docker and connect to sglang server QwQ per below. When I make an assistant message via the librechat agent it fails during the tool call with the following:

pydantic_core._pydantic_core.ValidationError: 5 validation errors for ChatCompletionRequest
messages.1.ChatCompletionMessageGenericParam.content.str
  Input should be a valid string [type=string_type, input_value=None, input_type=NoneType]
    For further information visit https://errors.pydantic.dev/2.10/v/string_type
messages.1.ChatCompletionMessageGenericParam.content.list[ChatCompletionMessageContentTextPart]
  Input should be a valid list [type=list_type, input_value=None, input_type=NoneType]
    For further information visit https://errors.pydantic.dev/2.10/v/list_type
messages.1.ChatCompletionMessageUserParam.role
  Input should be 'user' [type=literal_error, input_value='assistant', input_type=str]
    For further information visit https://errors.pydantic.dev/2.10/v/literal_error
messages.1.ChatCompletionMessageUserParam.content.str
  Input should be a valid string [type=string_type, input_value=None, input_type=NoneType]
    For further information visit https://errors.pydantic.dev/2.10/v/string_type
messages.1.ChatCompletionMessageUserParam.content.list[union[ChatCompletionMessageContentTextPart,ChatCompletionMessageContentImagePart]]
  Input should be a valid list [type=list_type, input_value=None, input_type=NoneType]
    For further information visit https://errors.pydantic.dev/2.10/v/list_type

I'm not sure where to begin, if this is a librechat or sglang issue so i asked in both

Version Information

hcr.io/danny-avila/librechat-dev latest 59660cbf7aa2 46 hours ago 872MB
ghcr.io/danny-avila/librechat-rag-api-dev-lite latest 6550e7ddf180 2 days ago 1.3GB
ghcr.io/danny-avila/librechat-dev e74e0207d3c8 4 months ago 882MB
ghcr.io/danny-avila/librechat-dev cd66b4721fa1 4 months ago 882MB
ghcr.io/danny-avila/librechat-rag-api-dev-lite 46d2ae2253d1 4 months ago 2.1GB

Steps to Reproduce

Reproduction

python -m sglang.launch_server --model-path Qwen/QwQ-32B-AWQ --tp 2 --enable-p2p-check --host 0.0.0.0 --reasoning-parser deepseek-r1 --tool-call-parser qwen25 --port 30000

restart Librechat, make an agent with QwQ and ask it to use a tool. the thinking will run, then when the tool call happens, it crashes with the above error

What browsers are you seeing the problem on?

No response

Relevant log output

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

sglang issue

It's an SGLang issue. This is my first time hearing of the project, but so long as it is fully openai-compatible, including the way tools are used, it would be supported like many of the other endpoints already supported.