[WIP] agent example (w/ sandboxable Tools!) & improved OAI compatibility layer (in Python)#6389

Closed

ochafik wants to merge 73 commits intoggml-org:masterfrom

ochafik:agent-example

Commits on Apr 27, 2024

gguf: add GGUFReader.read_field(field) method + read template example
ochafik
committed
grammars: add troubleshooting section to readme
ochafik
committed
server.py: hacky code
ochafik
committed
agents: scripts to run scripts as sandboxed fastapi servers
ochafik
committed
server.py: default tools work!
ochafik
committed
server.py: make tools work w/ mixtral-8x7b-instruct
ochafik
committed
server.py: kinda api-compliant output, disabled grammar
ochafik
committed
server.py: reenable grammar, accommodate mistral's escaped underscores
ochafik
committed
server.py: raise n_predict
ochafik
committed
server.py: pass all request options, comments in ts sigs, render tool calls
ochafik
committed
server.py: refactor chat handlers
ochafik
committed
server.py: crude reactor
ochafik
committed
agent: split code from openai example
ochafik
committed
Update agent.py
ochafik
committed
Update example_weather_tools.py
ochafik
committed
agent: add --allow_parallel_calls
ochafik
committed
agent/openai:nits
ochafik
committed
openai: fix message merging for mixtral (parallel calls)
ochafik
committed
Update prompting.py
ochafik
committed
agent: --style
ochafik
committed
Create requirements.txt
ochafik
committed
agent: disable parallel by default
ochafik
committed
agent: nits
ochafik
committed
agent: fix functionary tool_calls templating
ochafik
committed
Delete test.sh
ochafik
committed
agent: format still broken
ochafik
committed
agent: update readme
ochafik
committed
agent: prepare to test various templates
ochafik
committed
openai: test features of templates at runtime, to make sure no bits of intel are lost
ochafik
committed
Update test_chat_handlers.py
ochafik
committed
openai: quiet + update prompt output
ochafik
committed
openai: refactor chat handler vs. template
ochafik
committed
Update test_chat_handlers.md
ochafik
committed
openai: only special-format assistant in thoughtful mode
ochafik
committed
openai: actually use thoughtful examples in tests
ochafik
committed
openai: tests didn't catch output format
ochafik
committed
openai tools: TS signatures work well too at a fraction of the eval cost
ochafik
committed
Update test_chat_handlers.md
ochafik
committed
agent: fix response_format
ochafik
committed
agent: revert to json schemas (ts not ready for refs)
ochafik
committed
agent: fix sandbox dockerfile
Olivier Chafik
committed
agent: support basic openapi tools (incl. from fastify sandbox)
Olivier Chafik
committed
agent: nits
Olivier Chafik
committed
agent: cache_prompt=True
ochafik
committed
openai: nit
ochafik
committed
agent: hint at math import in python tool
ochafik
committed
agent: nit
ochafik
committed
agent: fix killing of subprocesses
ochafik
committed
agent: nits
ochafik
committed
agent: rename fake weather tools
ochafik
committed
agent: python tool: test serializability of variables
ochafik
committed
agent: python tool: return errors
ochafik
committed
agent: ensure DATA_DIR exists
Olivier Chafik
committed
agent: mypy type fixes
Olivier Chafik
committed
agent: fix wait --std-tools
Olivier Chafik
committed
grammars: early exit when no next_candidates to reject
ochafik
committed
grammars: cache decoded tokens
ochafik
committed
grammars: faster llama_grammar_copy
ochafik
committed
Merge branch 'gguf-read' into agent-example
ochafik
committed

Commits on Apr 30, 2024

Merge remote-tracking branch 'origin/master' into agent-example
Olivier Chafik
committed
openai: update after merge
Olivier Chafik
committed

Commits on May 2, 2024

server: tool call grammar-constraints
ochafik
committed
agent: url params
ochafik
committed
server: update tool calling, introduce system prompt for json schema
ochafik
committed

Commits on May 18, 2024

Commits on May 21, 2024

openai: fix merge
Olivier Chafik
committed
Merge remote-tracking branch 'origin/master' into agent-example
ochafik
committed

Commits on May 22, 2024

openai: make content optional for tool call grammar gen
ochafik
committed
openai: pretty indent json response
ochafik
committed
agent: support OpenAI: --endpoint https://api.openai.com --auth "Bearer $OPENAI_API_KEY"
ochafik
committed
server: ultra basic tools, tool_choice, tool_calls support
ochafik
committed

Commits on Jun 9, 2024

Merge remote-tracking branch 'origin/master' into agent-example
Olivier Chafik
committed