Skip to content

Commit bd5307e

Browse files
authored
Update vLLM version support to 0.17.0 (#5253)
1 parent 7283ebe commit bd5307e

File tree

4 files changed

+5
-5
lines changed

4 files changed

+5
-5
lines changed

docs/source/vllm_integration.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
This document will guide you through the process of using vLLM with TRL for faster generation in online methods like GRPO and Online DPO. We first summarize a tl;dr on how to use vLLM with TRL, and then we will go into the details of how it works under the hood.
44

55
> [!WARNING]
6-
> TRL currently only supports vLLM versions from `0.10.2` to `0.16.0`. Please ensure you have a version in this range installed to avoid compatibility issues.
6+
> TRL currently only supports vLLM versions from `0.10.2` to `0.17.0`. Please ensure you have a version in this range installed to avoid compatibility issues.
77
88
> [!TIP]
99
> The following trainers currently support generation with vLLM:

pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,7 @@ test = [
8383
"pytest"
8484
]
8585
vllm = [
86-
"vllm>=0.10.2,<=0.16.0",
86+
"vllm>=0.10.2,<=0.17.0",
8787
"fastapi",
8888
"pydantic",
8989
"requests",

trl/_compat.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,7 @@ def _patch_vllm_disabled_tqdm() -> None:
8989
9090
- Bug introduced in https://github.com/vllm-project/vllm/pull/52
9191
- Fixed in https://github.com/vllm-project/vllm/pull/28471 (released in v0.11.1)
92-
- Since TRL currently supports vLLM v0.10.2-0.16.0, we patch it here
92+
- Since TRL currently supports vLLM v0.10.2-0.17.0, we patch it here
9393
- This can be removed when TRL requires vLLM>=0.11.1
9494
"""
9595
if _is_package_version_below("vllm", "0.11.1"):

trl/import_utils.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -109,9 +109,9 @@ def is_uvicorn_available() -> bool:
109109
def is_vllm_available() -> bool:
110110
_vllm_available, _vllm_version = _is_package_available("vllm", return_version=True)
111111
if _vllm_available:
112-
if not (Version("0.10.2") <= Version(_vllm_version) <= Version("0.16.0")):
112+
if not (Version("0.10.2") <= Version(_vllm_version) <= Version("0.17.0")):
113113
warnings.warn(
114-
f"TRL currently supports vLLM versions from 0.10.2 to 0.16.0. You have version {_vllm_version} "
114+
f"TRL currently supports vLLM versions from 0.10.2 to 0.17.0. You have version {_vllm_version} "
115115
"installed. We recommend installing a supported version to avoid compatibility issues.",
116116
stacklevel=2,
117117
)

0 commit comments

Comments
 (0)