Is it possible to redact\customise the returned response to align with model_name, not model? #7492
spammenotinoz
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi I have a model called "llama-3-lumimaid-8b" yet when I call this model LLM responds with model_name
litellm_params:
model: openrouter/neversleep/llama-3-lumimaid-8b
When calling this model LiteLLM returns;
"model": "openrouter/neversleep/llama-3-lumimaid-70b",
And other information back as such provider;
"provider": "Mancer"
Is it possible to filter\redact this information without a proxy?
Beta Was this translation helpful? Give feedback.
All reactions