Is function calling supported with Litellm + Llama3 (with huggingface TGI) #4634
Unanswered
ManivannanGuru
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have the setup with Litellm + Llama3 (with huggingface TGI) where function calling is not working.
But function calling is working fine with Litellm + Llama3 (With Ollama)
So does this mean litellm does not support function calling with TGI ? Or is there any settings to enable this ? FYI i tried add_function_to_prompt=True but that doesn't help
Beta Was this translation helpful? Give feedback.
All reactions