JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length#6555

Merged

ochafik merged 17 commits intoggml-org:masterfrom

ochafik:json-faster-repetitions2

Apr 12, 2024

Commits on Apr 8, 2024

json: rename python schema converter to make import easier
ochafik
committed
server: skip null json_schema / grammar fields
ochafik
committed
json: deps management for primitive rules (+ allow null values)
ochafik
committed
json: optimize repetitions for minItems/maxItems and regexps: `a{,3}` goes from `"a"? "a"? "a"?` (explosive combos) to `(a (a (a)?)?)?`
ochafik
committed
grammars: add troubleshooting section to readme
ochafik
committed
json: cap length of numbers to 15 digits before/after decimal point
ochafik
committed
json: unify all repetition code (w/ or w/o sep)
ochafik
committed
json: support string minLength/maxLength
ochafik
committed
server+json: update server/README w/ result_format
ochafik
committed
nits
ochafik
committed
json: fix type error w/ python 3.8
ochafik
committed

Commits on Apr 9, 2024

json: fix server/README (json_schema in /completion vs. result_format in /v1/chat/completions)
Olivier Chafik
committed

Commits on Apr 12, 2024

json: simplify DOT `{"type": "string", "pattern": "^.$"}`
ochafik
committed
Merge remote-tracking branch 'origin/master' into json-faster-repetitions2
ochafik
committed
json: remove recursion in opt_repetitions (avoids Python stack overflow)
ochafik
committed
json: rm dead code
ochafik
committed
json: rm useless assert & ggml.h import
Olivier Chafik
committed