How to use tool invocation?

[Anatoly03]

Thank you for this project! It's awesome and running great.

I'm using the readme example and wanted to know if there's a way to provide the LLM with tools to be called with the <tool_call> token? Do you have examples of how to achieve it?

[lucasjinreal]

Hi, am implementing it, does the tool should supported in openai server side maybe