Commit 686b374
Add TensorrRT-LLM Example (#2444)
* Add TensorrRT-LLM Example
Add TensorrRT-LLM Deepseek Example
Update ChatCompletionsChunk for pytorch backend
Add task to build tensorrt-llm docker image
Update Tensorrt-LLM Example
Drop model_proxy changes
Resolve Review Comments
Resolve Review Comments
Update with hf download instead of git clone
Update README.md with hf download
* [Examples] Review of the TensorRT-LLM example
* Fix serve-r1.dstack.yml in README
---------
Co-authored-by: Bihan Rana <[email protected]>
Co-authored-by: peterschmidt85 <[email protected]>1 parent a39e946 commit 686b374
File tree
9 files changed
+553
-5
lines changed- docs
- examples/deployment/trtllm
- examples/deployment/trtllm
9 files changed
+553
-5
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
17 | 26 | | |
18 | 27 | | |
19 | 28 | | |
| |||
38 | 47 | | |
39 | 48 | | |
40 | 49 | | |
41 | | - | |
| 50 | + | |
42 | 51 | | |
43 | 52 | | |
44 | | - | |
| 53 | + | |
45 | 54 | | |
46 | 55 | | |
47 | | - | |
| 56 | + | |
48 | 57 | | |
49 | 58 | | |
50 | | - | |
51 | | - | |
| 59 | + | |
| 60 | + | |
52 | 61 | | |
53 | 62 | | |
54 | 63 | | |
| |||
Whitespace-only changes.
0 commit comments