Skip to content

Commit 391d683

Browse files
committed
[docs] Update documentation for TRTLLMSampler deprecation
Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
1 parent d530c85 commit 391d683

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

docs/source/features/sampling.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -19,9 +19,10 @@ The PyTorch backend supports a wide variety of features, listed below:
1919
There are two sampling backends available.
2020

2121
* Torch Sampler
22-
* TRTLLM Sampler
22+
* TRTLLM Sampler (deprecated)
2323

24-
Torch Sampler currently supports a superset of features of TRTLLM Sampler, and is intended as the long-term solution. One can specify which sampler to use explicitly with:
24+
Torch Sampler is used by default and supports a superset of features of TRTLLM Sampler. TRTLLM Sampler will be removed in release 1.4.
25+
One can specify which sampler to use explicitly with:
2526

2627
```python
2728
from tensorrt_llm import LLM

0 commit comments

Comments
 (0)