Sonnet 3.5 Token Limit at 8192?

[srcnkmn]

Hi,

I am very happy with librechat and am playing around all the time to see its capabilities.

Since I installed the Anthropic API Key I was wondering whether sonnet 3.5 has the max token limit set to 8192 or 4096.

There seems to be "hack" to activate the higher token limit, see https://www.reddit.com/r/ClaudeAI/s/OHNJnddvjg

Is this set? How can I check or edit that? :
Thanks a lot in advance

Best regards

[danny-avila]

Glad you are enjoying LibreChat! It’s already set when using the regular endpoint option:

LibreChat/api/app/clients/AnthropicClient.js

Lines 182 to 184 in 9b118d4

	options.defaultHeaders = {
	'anthropic-beta': 'max-tokens-3-5-sonnet-2024-07-15,prompt-caching-2024-07-31',
	};

but will need to add it to Anthropic agents

[srcnkmn]

Thank you :)
Now I have generated an agent with sonnet-3-5-latest

Is there anything else to do? Sorry for being a noob right now with Agents