chore(deps): update dependency litellm to v1.61.15 [security] by renovate[bot] · Pull Request #201 · AureliusIvan/remembear

renovate · 2025-03-20T18:57:28Z

ℹ️ Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package	Change	Age	Confidence
litellm	`==1.44.8` → `==1.61.15`

GitHub Vulnerability Alerts

CVE-2024-10188

A vulnerability in BerriAI/litellm, as of commit 26c03c9, allows unauthenticated users to cause a Denial of Service (DoS) by exploiting the use of ast.literal_eval to parse user input. This function is not safe and is prone to DoS attacks, which can crash the litellm Python server.

CVE-2025-0628

An improper authorization vulnerability exists in the main-latest version of BerriAI/litellm. When a user with the role 'internal_user_viewer' logs into the application, they are provided with an overly privileged API key. This key can be used to access all the admin functionality of the application, including endpoints such as '/users/list' and '/users/get_users'. This vulnerability allows for privilege escalation within the application, enabling any account to become a PROXY ADMIN.

CVE-2024-9606

In berriai/litellm before version 1.44.12, the litellm/litellm_core_utils/litellm_logging.py file contains a vulnerability where the API key masking code only masks the first 5 characters of the key. This results in the leakage of almost the entire API key in the logs, exposing a significant amount of the secret key. The issue affects version v1.44.9.

CVE-2024-8984

A Denial of Service (DoS) vulnerability exists in berriai/litellm version v1.44.5. This vulnerability can be exploited by appending characters, such as dashes (-), to the end of a multipart boundary in an HTTP request. The server continuously processes each character, leading to excessive resource consumption and rendering the service unavailable. The issue is unauthenticated and does not require any user interaction, impacting all users of the service.

Release Notes

BerriAI/litellm (litellm)

`v1.61.7`

What's Changed

docs(perplexity.md): removing return_citations documentation by @miraclebakelaser in #8527
(docs - cookbook) litellm proxy x langfuse by @ishaan-jaff in #8541
UI Fixes and Improvements (02/14/2025) p1 by @krrishdholakia in #8546
(Feat) - Add /bedrock/meta.llama3-3-70b-instruct-v1:0 tool calling support + cost tracking + base llm unit test for tool calling by @ishaan-jaff in #8545
fix(general_settings.tsx): filter out empty dictionaries post fallbac… by @krrishdholakia in #8550
(perf) Fix memory leak on /completions route by @ishaan-jaff in #8551
Org Flow Improvements by @krrishdholakia in #8549
feat(openai/o_series_transformation.py): support native streaming for o1 by @krrishdholakia in #8552
fix(team_endpoints.py): fix team info check to handle team keys by @krrishdholakia in #8529
build: ui build update by @krrishdholakia in #8553
Optimize Alpine Dockerfile by removing redundant apk commands by @PeterDaveHello in #5016
fix(main.py): fix key leak error when unknown provider given by @krrishdholakia in #8556
(Feat) - return x-litellm-attempted-fallbacks in responses from litellm proxy by @ishaan-jaff in #8558
Add remaining org CRUD endpoints + support deleting orgs on UI by @krrishdholakia in #8561
Enable update/delete org members on UI by @krrishdholakia in #8560
(Bug Fix) - Add Regenerate Key on Virtual Keys Tab by @ishaan-jaff in #8567
(Bug Fix + Better Observability) - BudgetResetJob: for reseting key, team, user budgets by @ishaan-jaff in #8562
(Patch/bug fix) - UI, filter out litellm ui session tokens on Virtual Keys Page by @ishaan-jaff in #8568
refactor(teams.tsx): refactor to display all teams, across all orgs by @krrishdholakia in #8565
docs: update README.md API key and model example typos by @colesmcintosh in #8590
Fix typo in main readme by @scosman in #8574
(UI) Allow adding models for a Team by @ishaan-jaff in #8598
feat(ui): alert when adding model without STORE_MODEL_IN_DB by @Aditya8840 in #8591
Revert "(UI) Allow adding models for a Team" by @ishaan-jaff in #8600
Litellm stable UI 02 17 2025 p1 by @krrishdholakia in #8599

New Contributors

@PeterDaveHello made their first contribution in #5016
@colesmcintosh made their first contribution in #8590
@scosman made their first contribution in #8574
@Aditya8840 made their first contribution in #8591

Full Changelog: BerriAI/litellm@v1.61.3...v1.61.7

Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.7

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat


## Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.7

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Failed ❌	180.0	206.98769618433857	6.145029010811349	6.145029010811349	1839	1839	146.21495699998377	3174.8161250000067
Aggregated	Failed ❌	180.0	206.98769618433857	6.145029010811349	6.145029010811349	1839	1839	146.21495699998377	3174.8161250000067

`v1.61.3`

What's Changed

Improved wildcard route handling on /models and /model_group/info by @krrishdholakia in #8473
(Bug fix) - Using include_usage for /completions requests + unit testing by @ishaan-jaff in #8484
add sonar pricings by @themrzmaster in #8476
(bug fix) PerplexityChatConfig - track correct OpenAI compatible params by @ishaan-jaff in #8496
(fix #2) don't block proxy startup if license check fails & using prometheus by @ishaan-jaff in #8492
ci(config.yml): mark daily docker builds with -nightly by @krrishdholakia in #8499
(Redis Cluster) - Fixes for using redis cluster + pipeline by @ishaan-jaff in #8442
Litellm UI stable version 02 12 2025 by @krrishdholakia in #8497
fix: fix test by @krrishdholakia in #8501
enables no auth for SMTP by @krrishdholakia in #8494
UI Fixes p2 by @krrishdholakia in #8502
add phoenix docs for observability integration by @exiao in #8522
Added custom_attributes to additional_keys which can be sent to athina by @vivek-athina in #8518
(UI) fix log details page by @ishaan-jaff in #8524
Add UI Support for Admins to Call /cache/ping and View Cache Analytics (#8475) by @tahaali-dev in #8519
LiteLLM Improvements (02/13/2025) p1 by @krrishdholakia in #8523
fix(utils.py): fix vertex ai optional param handling by @krrishdholakia in #8477
Add 'prediction' param for Azure + Add gemini-2.0-pro-exp-02-05 vertex ai model to cost map + New bedrock/deepseek_r1/* route by @krrishdholakia in #8525
(UI) - Refactor View Key Table by @ishaan-jaff in #8526

Full Changelog: BerriAI/litellm@v1.61.1...v1.61.3

Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.3

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat


## Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.3

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Failed ❌	110.0	127.51554087063036	6.408067444109619	6.408067444109619	1917	1917	94.95955199997752	2825.282969
Aggregated	Failed ❌	110.0	127.51554087063036	6.408067444109619	6.408067444109619	1917	1917	94.95955199997752	2825.282969

`v1.61.1`

Compare Source

What's Changed

Show Guardrails on UI by @krrishdholakia in #8447
Log applied guardrails on LLM API call by @krrishdholakia in #8452
Ui Fixes Teams Setting #8347 by @tahaali-dev in #8353
(UI) allow adding model aliases for teams by @ishaan-jaff in #8471
(round 4 fixes) - Team model alias setting by @ishaan-jaff in #8474

Full Changelog: BerriAI/litellm@v1.61.0...v1.61.1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	160.0	180.272351294557	6.268555221678184	0.0	1874	0	118.979319999994	3618.562145999988
Aggregated	Passed ✅	160.0	180.272351294557	6.268555221678184	0.0	1874	0	118.979319999994	3618.562145999988

`v1.61.0`

What's Changed

(Feat) - Allow calling Nova models on /bedrock/invoke/ by @ishaan-jaff in #8397
Run litellm in dev mode by @CakeCrusher in #8404
(Bug Fix) - Bedrock completions with aws_region_name by @ishaan-jaff in #8384
added gemini 2.0 models to docs by @mubashir1osmani in #8412
Added filter in Teams and fixed spacing & height issues in Teams tabs (#6192) by @tahaali-dev in #8357
Revert "Added filter in Teams and fixed spacing & height issues in Teams tabs (#6192)" by @krrishdholakia in #8416
Allow editing model api key + provider on UI by @krrishdholakia in #8406
Allow org admin to create teams on UI by @krrishdholakia in #8407
Azure api version check - fix str compare to convert to int by @krrishdholakia in #8438
Fix callback add when user_config passed + support passing openai org client-side by @krrishdholakia in #8443
Org UI Improvements by @krrishdholakia in #8436
(e2e testing) - add tests for using litellm /team/ updates in multi-instance deployments with Redis by @ishaan-jaff in #8440
(Feat) - Allow viewing Request/Response Logs stored in GCS Bucket by @ishaan-jaff in #8449

New Contributors

@CakeCrusher made their first contribution in #8404

Full Changelog: BerriAI/litellm@v1.60.8...v1.61.0

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.0

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	180.0	213.86169773089247	6.297834462789351	0.003342799608699231	1884	1	81.07622899996159	4173.802059999957
Aggregated	Passed ✅	180.0	213.86169773089247	6.297834462789351	0.003342799608699231	1884	1	81.07622899996159	4173.802059999957

`v1.60.8`

What's Changed

UI Updates by @krrishdholakia in #8345
OIDC Scope based model access by @krrishdholakia in #8343
Fix azure max retries error by @krrishdholakia in #8340
Update deepseek API prices for 2025-02-08 by @Winston-503 in #8363
fix(nvidia_nim/embed.py): add 'dimensions' support by @krrishdholakia in #8302
fix: dictionary changed size during iteration error (#8327) by @krrishdholakia in #8341
fix: add azure/o1-2024-12-17 to model_prices_and_context_window.json by @byrongrogan in #8371
(Security fix) Mask redis pwd on /cache/ping + add timeout value and elapsed time on azure + http calls by @krrishdholakia in #8377
Handle azure deepseek reasoning response (#8288) by @krrishdholakia in #8366
Anthropic Citations API Support by @krrishdholakia in #8382
(Feat) - Add /bedrock/invoke support for all Anthropic models by @ishaan-jaff in #8383
O3 mini native streaming support by @krrishdholakia in #8387

Full Changelog: BerriAI/litellm@v1.60.6...v1.60.8

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.8

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	170.0	189.56173781509457	6.206468643400922	0.0	1855	0	149.30551800000558	3488.08786699999
Aggregated	Passed ✅	170.0	189.56173781509457	6.206468643400922	0.0	1855	0	149.30551800000558	3488.08786699999

`v1.60.6`

Compare Source

What's Changed

Azure OpenAI improvements - o3 native streaming, improved tool call + response format handling by @krrishdholakia in #8292
Fix edit team on ui by @krrishdholakia in #8295
Improve rpm check on keys by @krrishdholakia in #8301
docs: fix enterprise links by @wagnerjt in #8294
Add gemini-2.0-flash pricing + model info by @krrishdholakia in #8303
Add Arize Cookbook for Turning on LiteLLM Proxy by @exiao in #8336
Add aistudio GEMINI 2.0 to model_prices_and_context_window.json by @dceluis in #8335
Fix pricing for Gemini 2.0 Flash 001 by @elabbarw in #8320
[DOCS] Update local_debugging.md by @rokbenko in #8308
(Bug Fix - Langfuse) - fix for when model response has choices=[] by @ishaan-jaff in #8339
Fixed meta llama 3.3 key for Databricks API by @anton164 in #8093
fix(utils.py): handle key error in msg validation by @krrishdholakia in #8325
(bug fix router.py) - safely handle choices=[] on llm responses by @ishaan-jaff in #8342
(QA+UI) - e2e flow for adding assembly ai passthrough endpoints by @ishaan-jaff in #8337

New Contributors

@exiao made their first contribution in #8336
@dceluis made their first contribution in #8335
@rokbenko made their first contribution in #8308
@anton164 made their first contribution in #8093

Full Changelog: BerriAI/litellm@v1.60.5...v1.60.6

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.6

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	200.0	217.05167674521235	6.288425886864887	0.0	1880	0	164.17646499996863	2306.284880000021
Aggregated	Passed ✅	200.0	217.05167674521235	6.288425886864887	0.0	1880	0	164.17646499996863	2306.284880000021

`v1.60.5`

Compare Source

What's Changed

Added a guide for users who want to use LiteLLM with AI/ML API. by @waterstark in #7058
Added compatibility guidance, etc. for xAI Grok model by @zhaohan-dong in #8282
(Security fix) - remove code block that inserts master key hash into DB by @ishaan-jaff in #8268
(UI) - Add Assembly AI provider to UI by @ishaan-jaff in #8297
(feat) - Add Assembly AI to model cost map by @ishaan-jaff in #8298
fixed issues #8126 and #8127 (#8275) by @ishaan-jaff in #8299
(Refactor) - migrate bedrock invoke to BaseLLMHTTPHandler class by @ishaan-jaff in #8290

New Contributors

@waterstark made their first contribution in #7058

Full Changelog: BerriAI/litellm@v1.60.4...v1.60.5

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.5

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	210.0	251.44053604962153	6.19421782055854	0.0	1854	0	167.35073600000305	4496.06190000003
Aggregated	Passed ✅	210.0	251.44053604962153	6.19421782055854	0.0	1854	0	167.35073600000305	4496.06190000003

`v1.60.4`

Compare Source

What's Changed

Internal User Endpoint - vulnerability fix + response type fix by @krrishdholakia in #8228
Litellm UI fixes 8123 v2 (#8208) by @ishaan-jaff in #8245
Update model_prices_and_context_window.json by @superpoussin22 in #8249
Update model_prices_and_context_window.json by @superpoussin22 in #8256
(dependency) - pip loosen httpx version requirement by @ishaan-jaff in #8255
Add hyperbolic deepseek v3 model configurations by @lowjiansheng in #8232
fix(prometheus.py): fix setting key budget metrics by @krrishdholakia in #8234
(feat) - add supports tool choice to model cost map by @ishaan-jaff in #8265
(feat) - track org_id in SpendLogs by @ishaan-jaff in #8253
(Bug fix) - Langfuse / Callback settings stored in DB by @ishaan-jaff in #8251
Fix passing top_k parameter for Bedrock Anthropic models (#8131) by @ishaan-jaff in #8269
(Feat) - Add support for structured output on bedrock/nova models + add util litellm.supports_tool_choice by @ishaan-jaff in #8264
[BETA] Support OIDC role based access to proxy by @krrishdholakia in #8260
Fix deepseek calling - refactor to use base_llm_http_handler by @krrishdholakia in #8266
allows dynamic message redaction by @krrishdholakia in #8270

Full Changelog: BerriAI/litellm@v1.60.2...v1.60.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	210.0	243.98647747354212	6.187158959524932	0.0033407985742575225	1852	1	94.81396500007122	3976.009301999966
Aggregated	Passed ✅	210.0	243.98647747354212	6.187158959524932	0.0033407985742575225	1852	1	94.81396500007122	3976.009301999966

`v1.60.2`

Compare Source

What's Changed

Control Model Access by IDP 'groups' by @krrishdholakia in #8164
build(schema.prisma): add new sso_user_id to LiteLLM_UserTable by @krrishdholakia in #8167
Litellm dev contributor prs 01 31 2025 by @krrishdholakia in #8168
Improved O3 + Azure O3 support by @krrishdholakia in #8181
test: add more unit testing for team member endpoints by @krrishdholakia in #8170
Add azure/deepseek-r1 by @Klohto in #8177
[Bug Fix] - /vertex_ai/ was not detected as llm_api_route on pass through but vertex-ai was by @ishaan-jaff in #8186
(UI + SpendLogs) - Store SpendLogs in UTC Timezone, Fix filtering logs by start/end time by @ishaan-jaff in #8190
Azure AI Foundry - Deepseek R1 by @elabbarw in #8188
fix(main.py): fix passing openrouter specific params by @krrishdholakia in #8184
Complete o3 model support by @krrishdholakia in #8183
Easier user onboarding via SSO by @krrishdholakia in #8187
LiteLLM Minor Fixes & Improvements (01/16/2025) - p2 by @krrishdholakia in #7828
Added deprecation date for gemini-1.5 models by @yurchik11 in #8210
docs: Updating the available VoyageAI models in the docs by @fzowl in #8215
build: ui updates by @krrishdholakia in #8206
Fix tokens for deepseek by @SmartManoj in #8207
(UI Fixes for add new model flow) by @ishaan-jaff in #8216
Update xAI provider and fix some old model config by @zhaohan-dong in #8218
Support guardrails mode as list, fix valid keys error in pydantic, add more testing by @krrishdholakia in #8224
docs: fix typo in lm_studio.md by @foreign-sub in #8222
(Feat) - New pass through add assembly ai passthrough endpoints by @ishaan-jaff in #8220
fix(openai/): allows 'reasoning_effort' param to be passed correctly by @krrishdholakia in #8227

New Contributors

@Klohto made their first contribution in #8177
@zhaohan-dong made their first contribution in #8218
@foreign-sub made their first contribution in #8222

Full Changelog: BerriAI/litellm@v1.60.0...v1.60.2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	170.0	187.78487681207412	6.365583292626693	0.0	1905	0	135.5453470000043	3644.0179759999864
Aggregated	Passed ✅	170.0	187.78487681207412	6.365583292626693	0.0	1905	0	135.5453470000043	3644.0179759999864

`v1.60.0`

What's Changed

Important Changes between v1.50.xx to 1.60.0

def async_log_stream_event and def log_stream_event no longer supported for CustomLoggers https://docs.litellm.ai/docs/observability/custom_callback. If you want to log stream events use def async_log_success_event and def log_success_event for logging success stream events

Known Issues

🚨 Detected issue with Langfuse Logging when Langfuse credentials are stored in DB

Adding gemini-2.0-flash-thinking-exp-01-21 by @marcoaleixo in #8089
add groq/deepseek-r1-distill-llama-70b by @miraclebakelaser in #8078
(UI) Fix SpendLogs page - truncate bedrock models + show end_user by @ishaan-jaff in #8118
UI Fixes - Newly created key does not display on the View Key Page + Updated the validator to allow model editing when keyTeam.team_alias === "Default Team" by @ishaan-jaff in #8122
(Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added by @ishaan-jaff in #8112
(UI) fix adding Vertex Models by @ishaan-jaff in #8129
Fix json_mode parameter propagation in OpenAILikeChatHandler by @miraclebakelaser in #8133
Doc updates - add key rotations to docs by @krrishdholakia in #8136
Enforce default_on guardrails always run + expose new litellm.disable_no_log_param param by @krrishdholakia in #8134
Doc updates + management endpoint fixes by @krrishdholakia in #8138
New stable release - release notes by @krrishdholakia in #8148
FEATURE: OpenAI o3-mini by @ventz in #8151
build: fix model cost map with o3 model pricing by @krrishdholakia in #8153
(Fixes) OpenAI Streaming Token Counting + Fixes usage track when litellm.turn_off_message_logging=True by @ishaan-jaff in #8156
(UI) Allow adding custom pricing when adding new model by @ishaan-jaff in #8165
(Feat) add bedrock/deepseek custom import models by @ishaan-jaff in #8132
Adding Azure OpenAI o3-mini costs & specs by @yigitkonur in #8166
Adjust model pricing metadata by @yurchik11 in #8147

New Contributors

@marcoaleixo made their first contribution in #8089
@yigitkonur made their first contribution in #8166

Full Changelog: BerriAI/litellm@v1.59.10...v1.60.0

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.60.0

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	240.0	281.07272626532927	6.158354312051399	0.0	1843	0	215.79772499995897	3928.489000000013
Aggregated	Passed ✅	240.0	281.07272626532927	6.158354312051399	0.0	1843	0	215.79772499995897	3928.489000000013

`v1.59.10`

Compare Source

What's Changed

(UI) - View Logs Page - Refinement by @ishaan-jaff in #8087
(Feat) pass through vertex - allow using credentials defined on litellm router for vertex pass through by @ishaan-jaff in #8100
(UI) Allow using a model / credentials for pass through routes by @ishaan-jaff in #8099
ui - fix chat ui tab sending model param by @ishaan-jaff in #8105
Litellm dev 01 29 2025 p1 by @krrishdholakia in #8097
Support new bedrock/converse_like/<model> route by @krrishdholakia in #8102
feat(databricks/chat/transformation.py): add tools and 'tool_choice' param support by @krrishdholakia in #8076

Full Changelog: BerriAI/litellm@v1.59.9...v1.59.10

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.10

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	210.0	239.24647793068146	6.21745665443628	0.00334092243655899	1861	1	73.25327600000264	3903.3159660000083
Aggregated	Passed ✅	210.0	239.24647793068146	6.21745665443628	0.00334092243655899	1861	1	73.25327600000264	3903.3159660000083

`v1.59.9`

Compare Source

What's Changed

Fix custom pricing - separate provider info from model info by @krrishdholakia in #7990
Litellm dev 01 25 2025 p4 by @krrishdholakia in #8006
(UI) - Adding new models enhancement - show provider logo by @ishaan-jaff in #8033
(UI enhancement) - allow onboarding wildcard models on UI by @ishaan-jaff in #8034
add openrouter/deepseek/deepseek-r1 by @paul-gauthier in #8038
(UI) - allow assigning wildcard models to a team / key by @ishaan-jaff in #8041
Add smolagents by @aymeric-roucher in #8026
(UI) fixes to add model flow by @ishaan-jaff in #8043
github - run stale issue/pr bot by @ishaan-jaff in #8045
(doc) Add nvidia as provider by @raspawar in #8023
feat(handle_jwt.py): initial commit adding custom RBAC support on jwt… by @krrishdholakia in #8037
fix(utils.py): handle failed hf tokenizer request during calls by @krrishdholakia in #8032
Bedrock document processing fixes by @krrishdholakia in #8005
Fix bedrock model pricing + add unit test using bedrock pricing api by @krrishdholakia in #7978
Add openai metadata param preview support + new x-litellm-timeout request header by @krrishdholakia in #8047
(beta ui - spend logs view fixes & Improvements 1) by @ishaan-jaff in #8062
(fix) - proxy reliability, ensure duplicate callbacks are not added to proxy by @ishaan-jaff in #8067
(UI) Fixes for Adding model page - keep existing page as default, have 2nd tab for wildcard models by @ishaan-jaff in #8073

New Contributors

[@aymeric-roucher](htt

Configuration

📅 Schedule: Branch creation - "" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

vercel · 2025-03-20T18:57:32Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
remembear	❌ Failed (Inspect)			Aug 10, 2025 2:39pm

deepsource-io · 2025-03-20T18:57:39Z

Here's the code health analysis summary for commits 04f87b9..d798ec0. View details on DeepSource ↗.

Analysis Summary

Analyzer	Status	Summary	Link
Python	✅ Success		View Check ↗
JavaScript	✅ Success		View Check ↗

💡 If you’re a repository administrator, you can configure the quality gates from the settings.

coderabbitai · 2025-08-10T14:31:37Z

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

Review comments: Directly reply to a review comment made by CodeRabbit. Example:
- I pushed a fix in commit <commit_id>, please review it.
- Explain this complex logic.
- Open a follow-up GitHub issue for this discussion.
Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
- @coderabbitai explain this code block.
PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
- @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
- @coderabbitai read src/utils.ts and explain its main purpose.
- @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Support

Need help? Join our Discord community for assistance with any issues or questions.

CodeRabbit Commands (Invoked using PR comments)

@coderabbitai pause to pause the reviews on a PR.
@coderabbitai resume to resume the paused reviews.
@coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
@coderabbitai full review to do a full review from scratch and review all the files again.
@coderabbitai summary to regenerate the summary of the PR.
@coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
@coderabbitai resolve resolve all the CodeRabbit review comments.
@coderabbitai configuration to show the current CodeRabbit configuration for the repository.
@coderabbitai help to get help.

Other keywords and placeholders

Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (`.coderabbit.yaml`)

You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
Please see the configuration documentation for more information.
If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

Visit our Documentation for detailed information on how to use CodeRabbit.
Join our Discord Community to get help, request features, and share feedback.
Follow us on X/Twitter for updates and announcements.

vercel bot deployed to Preview March 20, 2025 18:58 View deployment

renovate bot force-pushed the renovate/pypi-litellm-vulnerability branch from 5e217b6 to 4878e30 Compare March 20, 2025 23:12

renovate bot changed the title ~~chore(deps): update dependency litellm to v1.53.1 [security]~~ chore(deps): update dependency litellm to v1.61.15 [security] Mar 20, 2025

vercel bot deployed to Preview March 20, 2025 23:13 View deployment

chore(deps): update dependency litellm to v1.61.15 [security]

d798ec0

renovate bot force-pushed the renovate/pypi-litellm-vulnerability branch from 4878e30 to d798ec0 Compare August 10, 2025 14:31

vercel bot had a problem deploying to Preview August 10, 2025 14:39 Failure

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore(deps): update dependency litellm to v1.61.15 [security]#201

chore(deps): update dependency litellm to v1.61.15 [security]#201
renovate[bot] wants to merge 1 commit intodevelopfrom
renovate/pypi-litellm-vulnerability

renovate bot commented Mar 20, 2025 •

edited

Loading

Uh oh!

vercel bot commented Mar 20, 2025 •

edited

Loading

Uh oh!

deepsource-io bot commented Mar 20, 2025 •

edited

Loading

Analysis Summary

Uh oh!

coderabbitai bot commented Aug 10, 2025

Review skipped

Chat

Support

CodeRabbit Commands (Invoked using PR comments)

Other keywords and placeholders

CodeRabbit Configuration File (`.coderabbit.yaml`)

Documentation and Community

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

0 participants

Conversation

renovate bot commented Mar 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GitHub Vulnerability Alerts

Release Notes

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Important Changes between v1.50.xx to 1.60.0

Known Issues

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Configuration

Uh oh!

vercel bot commented Mar 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

deepsource-io bot commented Mar 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Analysis Summary

Uh oh!

coderabbitai bot commented Aug 10, 2025

Review skipped

Chat

Support

CodeRabbit Commands (Invoked using PR comments)

Other keywords and placeholders

CodeRabbit Configuration File (.coderabbit.yaml)

Documentation and Community

Uh oh!

Reviewers

renovate bot commented Mar 20, 2025 •

edited

Loading

vercel bot commented Mar 20, 2025 •

edited

Loading

deepsource-io bot commented Mar 20, 2025 •

edited

Loading

CodeRabbit Configuration File (`.coderabbit.yaml`)