Chat template is passed #6
Description
when running Multi-tool-search agent,
Error code: 400 - {'detail': 'Invalid request. Please check the parameters and try again. Details: Chat template is passed with request, but
--trust-request-chat-template is not set. Refused request with untrusted chat template.'}
Investigation:
We intercepted the actual HTTP request being sent and confirmed that NO chat_template parameter is present in the request body. The request only contains:
{
"messages": [{"role": "user", "content": "..."}],
"model": "meta-llama/Meta-Llama-3.1-8B-Instruct"
}
Environment
- LiteLLM version: 1.80.0
- Google ADK (Agent Development Kit)
- Nebius API Base: https://api.studio.nebius.ai/v1
- Models tested:
- meta-llama/Meta-Llama-3.1-8B-Instruct
- meta-llama/Meta-Llama-3.1-8B-Instruct-fast