Commit 153a004
authored
feat: Generic chatml Function Calling (#957)
* Add demo notebook
* Add initial chat handler
* Update OpenAI types
* Add generic chatml function calling (wip)
* Update chatml generic function calling.
* Progress on auto-tool calls
* fix streaming functions
* Remove print statements
* fix: Suppress output from llama.cpp init and grammar creation
* Add OpenAI v1 python api compatible chat completion function
* Support non-streaming multi-tool calls
* Format
* Include function_call in response.1 parent 69413ce commit 153a004
File tree
4 files changed
+1660
-60
lines changed- examples/notebooks
- llama_cpp
4 files changed
+1660
-60
lines changed
0 commit comments