Skip to content

Add first-class verbosity support for GPT-5 #1403

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

zaingz
Copy link

@zaingz zaingz commented Aug 8, 2025

Summary

Adds first-class verbosity support for GPT-5 across both OpenAI Responses and Chat Completions backends.

  • New field: ModelSettings.verbosity: Literal["low","medium","high"] | None.
  • Responses API: verbosity is merged into text config as text.verbosity, coexisting with JSON schema response format when provided.
  • Chat Completions API: verbosity is forwarded via extra_body until official client types surface it as a top-level param.
  • Reasoning effort remains fully supported; Reasoning(effort="minimal") maps to reasoning (Responses) and reasoning_effort (Chat Completions).

Test plan

  • Ran make format, make lint: OK.
  • make mypy: OK after installing dev/extras via make sync (installs numpy, litellm, etc.).
  • Test run locally was constrained by this environment; CI should run the full suite with extras. Manual verification included:
    • Responses path: ModelSettings(verbosity="low") produces a text payload with { "verbosity": "low" }, merged with JSON schema when present.
    • Chat Completions: ModelSettings(verbosity="low") appears under request extra_body and reaches the client call.

Issue number

N/A (please link if there’s a tracking issue).

Checks

  • I've run make lint and make format
  • I've added new tests (if relevant)
  • I've added/updated the relevant documentation
  • I've made sure tests pass

…delSettings.verbosity (low|medium|high)\n- Responses: send as text.verbosity (merged with format)\n- Chat Completions: send via extra_body for now\n- Preserve existing reasoning support incl. minimal effort\n\nDocs: behavior is aligned with GPT-5 guide; will follow up with docs/tests if needed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants