v1.82.0.patch2

Full Changelog: v1.82.0.patch1...v1.82.0.patch2

v1.82.0.patch1

Full Changelog: v1.82.0-nightly...v1.82.0.patch1

v1.81.14.gemini-batches

Full Changelog: v1.81.14-stable...v1.81.14.gemini-batches

v1.81.14-redirect-alpha

Full Changelog: v1.81.14-stable...v1.81.14-redirect-alpha

v1.81.12-stable_gpt-5.3.patch1

What's Changed

Anthropic Beta Headers Configuration Update

This patch syncs the anthropic_beta_headers_config.json from main, bringing two key improvements:

1. Enabled context-1m-2025-08-07 beta header for Anthropic and Vertex AI

• Previously this header was disabled (null) for both the anthropic and vertex_ai providers
• Now correctly passes through the context-1m-2025-08-07 beta header, enabling support for Anthropic's 1M context window feature when requested by clients

2. Added Databricks provider beta header mappings

• Added a complete set of Anthropic beta header mappings for the databricks provider, enabling Databricks-hosted Anthropic models to correctly forward beta feature headers including:
  • advanced-tool-use-2025-11-20
  • code-execution-2025-08-25
  • compact-2026-01-12
  • computer-use-2025-01-24, computer-use-2025-11-24
  • context-1m-2025-08-07
  • context-management-2025-06-27
  • effort-2025-11-24
  • fast-mode-2026-02-01
  • files-api-2025-04-14
  • fine-grained-tool-streaming-2025-05-14
  • interleaved-thinking-2025-05-14
  • mcp-client-2025-11-20, mcp-client-2025-04-04
  • oauth-2025-04-20
  • output-128k-2025-02-19
  • prompt-caching-scope-2026-01-05
  • skills-2025-10-02
  • structured-outputs-2025-11-13
  • token-efficient-tools-2025-02-19
  • web-fetch-2025-09-10
  • web-search-2025-03-05

Impact

• Users routing Anthropic calls through Databricks can now use beta features that require specific header forwarding
• The 1M context window beta feature now works correctly on both direct Anthropic and Vertex AI providers

Full Changelog: v1.81.12-stable_gpt-5.3...v1.81.12-stable_gpt-5.3.patch1

v1.81.6.rc.9

Full Changelog: v1.81.6.rc.6...v1.81.6.rc.9

litellm-trace-dev-v1.81.16

What's Changed

• feat(vertex): add gemini-3.1-flash-image-preview to model DB by @emerzon in #22223
• perf(spendlogs): optimize old spendlog deletion cron job by @Harshit28j in #21930
• Fix converse handling for parallel_tool_calls by @Sameerlite in #22267
• [Fix]Preserve forwarding server side called tools by @Sameerlite in #22260
• Fix free models working from UI by @Sameerlite in #22258
• Add v1 for anthropic responses transformation by @Sameerlite in #22087
• [Bug]Add ChatCompletionImageObject in OpenAIChatCompletionAssistantMessage by @Sameerlite in #22155
• Fix: poetry lock by @Sameerlite in #22293
• Enable local file support for OCR by @noahnistler in #22133
• fix(mcp): Strip stale mcp-session-id to prevent 400 errors across proxy workers by @gavksingh in #21417
• [Feature] Access group CRUD: Bidirectional team/key sync by @yuneng-jiang in #22253
• Add LLMClientCache regression tests for httpx client eviction safety by @ryan-crabbe in #22306
• feat(models): add gpt-audio-1.5 to model cost map by @Chesars in #22303
• feat(models): add gpt-realtime-1.5 to model cost map by @Chesars in #22304
• fix(models): function calling for PublicAI Apertus models by @Chesars in #21582
• Tests: add llmclientcache regression tests by @ryan-crabbe in #22313
• Add deprecation dates for xAI grok-2-vision-1212 and grok-3-mini models by @Chesars in #20102
• feat(model_prices): add OpenRouter native models to model cost map by @Chesars in #20520
• docs: add OpenRouter Opus 4.6 to model map and update Claude Opus 4.6 docs by @Chesars in #20525
• [Fix] Include timestamps in /project/list response by @yuneng-jiang in #22323
• [Feature] UI - Projects: Add Projects page with list and create flows by @yuneng-jiang in #22315
• Fix/claude code plugin schema by @rahulrd25 in #22271
• Add Prometheus child_exit cleanup for gunicorn workers by @ryan-crabbe in #22324
• docs: update AssemblyAI docs with Universal-3 Pro, Speech Understanding, and LLM Gateway by @dylan-duan-aai in #21130
• feat: add in_flight_requests metric to /health/backlog + prometheus by @ishaan-jaff in #22319
• fix(test): update realtime guardrail test assertions for voice violation behavior by @jquinter in #22332
• fix(test): update Azure pass-through test after Responses API routing change by @jquinter in #22334
• fix(db): add missing migration for LiteLLM_ClaudeCodePluginTable by @jquinter in #22335
• fix(bedrock): restore parallel_tool_calls mapping in map_openai_params by @jquinter in #22333
• [Feat] Agent RBAC Permission Fix - Ensure Internal Users cannot create agents by @ishaan-jaff in #22329
• fix(mcp): update test mocks for renamed filter_server_ids_by_ip_with_info by @jquinter in #22327
• fix: Add PROXY_ADMIN role to system user for key rotation by @milan-berri in #21896
• fix: populate user_id and user_info for admin users in /user/info by @milan-berri in #22239
• fix(caching): store task references in LLMClientCache._remove_key by @shivaaang in #22143
• fix(image_generation): propagate extra_headers to Upstream by @ZeroClover in #22026
• [Fix] Pass MCP auth headers from request into tool fetch for /v1/responses and chat completions by @shivamrawat1 in #22291
• fix: shorten guardrail benchmark result filenames for Windows long path support by @demoray in #22039
• Remove Apache 2 license from SKILL.md by @rasmi in #22322
• fix(mcp): default available_on_public_internet to true by @ishaan-jaff in #22331
• fix(bedrock): filter internal json_tool_call when mixed with real tools by @jquinter in #21107
• fix(jwt): OIDC discovery URLs, roles array handling, dot-notation error hints by @ishaan-jaff in #22336
• perf: streaming latency improvements — 4 targeted hot-path fixes by @ishaan-jaff in #22346
• [Test] UI - CostTrackingSettings: Add comprehensive Vitest coverage by @yuneng-jiang in #22354
• [Feature] Key list endpoint: Add project_id and access_group_id filters by @yuneng-jiang in #22356
• [Feature] UI - Projects: Add Project Details Page by @yuneng-jiang in #22360
• [Feature] UI - Projects: Add project keys table and project dropdown to key create/edit by @yuneng-jiang in #22373
• Litellm health check tokens by @Harshit28j in #22299
• Doc: security vulnerability scan report to v1.81.14 release notes by @Harshit28j in #22385
• feat: ability to trace metrics datadog by @Harshit28j in #22103
• feat(ci): add duplicate issue detection and auto-close bot by @jquinter in #22034
• Litellm aws edge case by @Harshit28j in #22384
• Litellm presidio stream v3 by @Harshit28j in #22283

New Contributors

• @noahnistler made their first contribution in #22133
• @dylan-duan-aai made their first contribution in #21130
• @rasmi made their first contribution in #22322

Full Changelog: litellm_presidio-dev-v1.81.16...litellm-trace-dev-v1.81.16

v1.82.rc.1

What's Changed

• feat(vertex): add gemini-3.1-flash-image-preview to model DB by @emerzon in #22223
• perf(spendlogs): optimize old spendlog deletion cron job by @Harshit28j in #21930
• Fix converse handling for parallel_tool_calls by @Sameerlite in #22267
• [Fix]Preserve forwarding server side called tools by @Sameerlite in #22260
• Fix free models working from UI by @Sameerlite in #22258
• Add v1 for anthropic responses transformation by @Sameerlite in #22087
• [Bug]Add ChatCompletionImageObject in OpenAIChatCompletionAssistantMessage by @Sameerlite in #22155
• Fix: poetry lock by @Sameerlite in #22293
• Enable local file support for OCR by @noahnistler in #22133
• fix(mcp): Strip stale mcp-session-id to prevent 400 errors across proxy workers by @gavksingh in #21417
• [Feature] Access group CRUD: Bidirectional team/key sync by @yuneng-jiang in #22253
• Add LLMClientCache regression tests for httpx client eviction safety by @ryan-crabbe in #22306
• feat(models): add gpt-audio-1.5 to model cost map by @Chesars in #22303
• feat(models): add gpt-realtime-1.5 to model cost map by @Chesars in #22304
• fix(models): function calling for PublicAI Apertus models by @Chesars in #21582
• Tests: add llmclientcache regression tests by @ryan-crabbe in #22313
• Add deprecation dates for xAI grok-2-vision-1212 and grok-3-mini models by @Chesars in #20102
• feat(model_prices): add OpenRouter native models to model cost map by @Chesars in #20520
• docs: add OpenRouter Opus 4.6 to model map and update Claude Opus 4.6 docs by @Chesars in #20525
• [Fix] Include timestamps in /project/list response by @yuneng-jiang in #22323
• [Feature] UI - Projects: Add Projects page with list and create flows by @yuneng-jiang in #22315
• Fix/claude code plugin schema by @rahulrd25 in #22271
• Add Prometheus child_exit cleanup for gunicorn workers by @ryan-crabbe in #22324
• docs: update AssemblyAI docs with Universal-3 Pro, Speech Understanding, and LLM Gateway by @dylan-duan-aai in #21130
• feat: add in_flight_requests metric to /health/backlog + prometheus by @ishaan-jaff in #22319
• fix(test): update realtime guardrail test assertions for voice violation behavior by @jquinter in #22332
• fix(test): update Azure pass-through test after Responses API routing change by @jquinter in #22334
• fix(db): add missing migration for LiteLLM_ClaudeCodePluginTable by @jquinter in #22335
• fix(bedrock): restore parallel_tool_calls mapping in map_openai_params by @jquinter in #22333
• [Feat] Agent RBAC Permission Fix - Ensure Internal Users cannot create agents by @ishaan-jaff in #22329
• fix(mcp): update test mocks for renamed filter_server_ids_by_ip_with_info by @jquinter in #22327
• fix: Add PROXY_ADMIN role to system user for key rotation by @milan-berri in #21896
• fix: populate user_id and user_info for admin users in /user/info by @milan-berri in #22239
• fix(caching): store task references in LLMClientCache._remove_key by @shivaaang in #22143
• fix(image_generation): propagate extra_headers to Upstream by @ZeroClover in #22026
• [Fix] Pass MCP auth headers from request into tool fetch for /v1/responses and chat completions by @shivamrawat1 in #22291
• fix: shorten guardrail benchmark result filenames for Windows long path support by @demoray in #22039
• Remove Apache 2 license from SKILL.md by @rasmi in #22322
• fix(mcp): default available_on_public_internet to true by @ishaan-jaff in #22331
• fix(bedrock): filter internal json_tool_call when mixed with real tools by @jquinter in #21107
• fix(jwt): OIDC discovery URLs, roles array handling, dot-notation error hints by @ishaan-jaff in #22336
• perf: streaming latency improvements — 4 targeted hot-path fixes by @ishaan-jaff in #22346
• [Test] UI - CostTrackingSettings: Add comprehensive Vitest coverage by @yuneng-jiang in #22354
• [Feature] Key list endpoint: Add project_id and access_group_id filters by @yuneng-jiang in #22356
• [Feature] UI - Projects: Add Project Details Page by @yuneng-jiang in #22360
• [Feature] UI - Projects: Add project keys table and project dropdown to key create/edit by @yuneng-jiang in #22373
• Litellm health check tokens by @Harshit28j in #22299
• Doc: security vulnerability scan report to v1.81.14 release notes by @Harshit28j in #22385
• feat: ability to trace metrics datadog by @Harshit28j in #22103
• feat(ci): add duplicate issue detection and auto-close bot by @jquinter in #22034
• Litellm aws edge case by @Harshit28j in #22384
• Litellm presidio stream v3 by @Harshit28j in #22283
• fix: update_price_and_context_window workflow from running in forks by @Chesars in #18478
• fix(ci): remove duplicate env key in scan_duplicate_issues workflow by @Chesars in #22405
• fix(lint): suppress PLR0915 in complex transform methods by @jquinter in #22328
• fix: atomic RPM rate limiting in model rate limit check by @jquinter in #22002
• test(ci): add secret scan test and CI job by @jquinter in #22193
• fix(proxy): isolate get_config failures from model sync loop by @jquinter in #22224
• fix tts metrics issues by @Harshit28j in #20632
• [Release Fix] by @ishaan-jaff in #22411
• fix(ci): handle inline table in pyproject.toml for proxy-extras version check by @ishaan-jaff in #22414
• [Feature] UI - Projects: Add delete project action by @yuneng-jiang in #22412
• fix: bump litellm-proxy-extras to 0.4.50 and fix 3 failing tests by @ishaan-jaff in #22417
• [Fix] UI - resolve flaky tests from leaked @tremor/react Tooltip timer by @yuneng-jiang in #22420
• [Feature] UI - Admin Settings: Projects Opt-In Toggle by @yuneng-jiang in #22416
• [Infra] Building UI for Release by @yuneng-jiang in #22423
• fix(mypy): fix 3 mypy/pyright errors in presidio.py and _health_endpoints.py by @ishaan-jaff in #22422
• bump: litellm-enterprise 0.1.32 → 0.1.33 + manual publish workflow by @ishaan-jaff in #22421
• fix(mcp): set LITELLM_MASTER_KEY env var in e2e tests by @jquinter in #22413
• fix(ci): replace default CodeQL with custom workflow to unblock CI by @jquinter in #22397
• Development environment setup by @ishaan-jaff in #22432
• fix(test): add spend data polling + graceful skip to Gemini e2e spend… by @ishaan-jaff in #22446
• [Fix] UI - Virtual Keys: Fix beforeunload listener memory leak by @yuneng-jiang in #22430
• Litellm stability fix v2 by @ishaan-jaff in #22452

New Contributors

• @noahnistler made their first contribution in #22133
• @dylan-duan-aai made their first contribution in #21130
• @rasmi made their first contribution in #22322

Full Changelog: litellm_presidio-dev-v1.81.16...v1.82.rc.1

v1.82.0-nightly

What's Changed

• feat(vertex): add gemini-3.1-flash-image-preview to model DB by @emerzon in #22223
• perf(spendlogs): optimize old spendlog deletion cron job by @Harshit28j in #21930
• Fix converse handling for parallel_tool_calls by @Sameerlite in #22267
• [Fix]Preserve forwarding server side called tools by @Sameerlite in #22260
• Fix free models working from UI by @Sameerlite in #22258
• Add v1 for anthropic responses transformation by @Sameerlite in #22087
• [Bug]Add ChatCompletionImageObject in OpenAIChatCompletionAssistantMessage by @Sameerlite in #22155
• Fix: poetry lock by @Sameerlite in #22293
• Enable local file support for OCR by @noahnistler in #22133
• fix(mcp): Strip stale mcp-session-id to prevent 400 errors across proxy workers by @gavksingh in #21417
• [Feature] Access group CRUD: Bidirectional team/key sync by @yuneng-jiang in #22253
• Add LLMClientCache regression tests for httpx client eviction safety by @ryan-crabbe in #22306
• feat(models): add gpt-audio-1.5 to model cost map by @Chesars in #22303
• feat(models): add gpt-realtime-1.5 to model cost map by @Chesars in #22304
• fix(models): function calling for PublicAI Apertus models by @Chesars in #21582
• Tests: add llmclientcache regression tests by @ryan-crabbe in #22313
• Add deprecation dates for xAI grok-2-vision-1212 and grok-3-mini models by @Chesars in #20102
• feat(model_prices): add OpenRouter native models to model cost map by @Chesars in #20520
• docs: add OpenRouter Opus 4.6 to model map and update Claude Opus 4.6 docs by @Chesars in #20525
• [Fix] Include timestamps in /project/list response by @yuneng-jiang in #22323
• [Feature] UI - Projects: Add Projects page with list and create flows by @yuneng-jiang in #22315
• Fix/claude code plugin schema by @rahulrd25 in #22271
• Add Prometheus child_exit cleanup for gunicorn workers by @ryan-crabbe in #22324
• docs: update AssemblyAI docs with Universal-3 Pro, Speech Understanding, and LLM Gateway by @dylan-duan-aai in #21130
• feat: add in_flight_requests metric to /health/backlog + prometheus by @ishaan-jaff in #22319
• fix(test): update realtime guardrail test assertions for voice violation behavior by @jquinter in #22332
• fix(test): update Azure pass-through test after Responses API routing change by @jquinter in #22334
• fix(db): add missing migration for LiteLLM_ClaudeCodePluginTable by @jquinter in #22335
• fix(bedrock): restore parallel_tool_calls mapping in map_openai_params by @jquinter in #22333
• [Feat] Agent RBAC Permission Fix - Ensure Internal Users cannot create agents by @ishaan-jaff in #22329
• fix(mcp): update test mocks for renamed filter_server_ids_by_ip_with_info by @jquinter in #22327
• fix: Add PROXY_ADMIN role to system user for key rotation by @milan-berri in #21896
• fix: populate user_id and user_info for admin users in /user/info by @milan-berri in #22239
• fix(caching): store task references in LLMClientCache._remove_key by @shivaaang in #22143
• fix(image_generation): propagate extra_headers to Upstream by @ZeroClover in #22026
• [Fix] Pass MCP auth headers from request into tool fetch for /v1/responses and chat completions by @shivamrawat1 in #22291
• fix: shorten guardrail benchmark result filenames for Windows long path support by @demoray in #22039
• Remove Apache 2 license from SKILL.md by @rasmi in #22322
• fix(mcp): default available_on_public_internet to true by @ishaan-jaff in #22331
• fix(bedrock): filter internal json_tool_call when mixed with real tools by @jquinter in #21107
• fix(jwt): OIDC discovery URLs, roles array handling, dot-notation error hints by @ishaan-jaff in #22336
• perf: streaming latency improvements — 4 targeted hot-path fixes by @ishaan-jaff in #22346
• [Test] UI - CostTrackingSettings: Add comprehensive Vitest coverage by @yuneng-jiang in #22354
• [Feature] Key list endpoint: Add project_id and access_group_id filters by @yuneng-jiang in #22356
• [Feature] UI - Projects: Add Project Details Page by @yuneng-jiang in #22360
• [Feature] UI - Projects: Add project keys table and project dropdown to key create/edit by @yuneng-jiang in #22373
• Litellm health check tokens by @Harshit28j in #22299
• Doc: security vulnerability scan report to v1.81.14 release notes by @Harshit28j in #22385
• feat: ability to trace metrics datadog by @Harshit28j in #22103
• feat(ci): add duplicate issue detection and auto-close bot by @jquinter in #22034
• Litellm aws edge case by @Harshit28j in #22384
• Litellm presidio stream v3 by @Harshit28j in #22283
• fix: update_price_and_context_window workflow from running in forks by @Chesars in #18478
• fix(ci): remove duplicate env key in scan_duplicate_issues workflow by @Chesars in #22405
• fix(lint): suppress PLR0915 in complex transform methods by @jquinter in #22328
• fix: atomic RPM rate limiting in model rate limit check by @jquinter in #22002
• test(ci): add secret scan test and CI job by @jquinter in #22193
• fix(proxy): isolate get_config failures from model sync loop by @jquinter in #22224
• fix tts metrics issues by @Harshit28j in #20632
• [Release Fix] by @ishaan-jaff in #22411
• fix(ci): handle inline table in pyproject.toml for proxy-extras version check by @ishaan-jaff in #22414
• [Feature] UI - Projects: Add delete project action by @yuneng-jiang in #22412
• fix: bump litellm-proxy-extras to 0.4.50 and fix 3 failing tests by @ishaan-jaff in #22417
• [Fix] UI - resolve flaky tests from leaked @tremor/react Tooltip timer by @yuneng-jiang in #22420
• [Feature] UI - Admin Settings: Projects Opt-In Toggle by @yuneng-jiang in #22416
• [Infra] Building UI for Release by @yuneng-jiang in #22423
• fix(mypy): fix 3 mypy/pyright errors in presidio.py and _health_endpoints.py by @ishaan-jaff in #22422
• bump: litellm-enterprise 0.1.32 → 0.1.33 + manual publish workflow by @ishaan-jaff in #22421
• fix(mcp): set LITELLM_MASTER_KEY env var in e2e tests by @jquinter in #22413
• fix(ci): replace default CodeQL with custom workflow to unblock CI by @jquinter in #22397
• Development environment setup by @ishaan-jaff in #22432
• fix(test): add spend data polling + graceful skip to Gemini e2e spend… by @ishaan-jaff in #22446
• [Fix] UI - Virtual Keys: Fix beforeunload listener memory leak by @yuneng-jiang in #22430
• Litellm stability fix v2 by @ishaan-jaff in #22452

New Contributors

• @noahnistler made their first contribution in #22133
• @dylan-duan-aai made their first contribution in #21130
• @rasmi made their first contribution in #22322

Full Changelog: litellm_presidio-dev-v1.81.16...v1.82.0-nightly

v1.81.12-stable.2

Full Changelog: v1.81.12-stable.1...v1.81.12-stable.2