Commit 46d5570
committed
Add ray stage with 4 h100 gpus to CI and fix sampled logprobs in TRTLLM sampler
Signed-off-by: Shuyi Xiong <219646547+shuyixiong@users.noreply.github.com>1 parent fcda1a1 commit 46d5570
File tree
3 files changed
+3
-1
lines changed- jenkins
- tensorrt_llm/_torch/pyexecutor
3 files changed
+3
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
734 | 734 | | |
735 | 735 | | |
736 | 736 | | |
| 737 | + | |
737 | 738 | | |
738 | 739 | | |
739 | 740 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2938 | 2938 | | |
2939 | 2939 | | |
2940 | 2940 | | |
| 2941 | + | |
2941 | 2942 | | |
2942 | 2943 | | |
2943 | 2944 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3049 | 3049 | | |
3050 | 3050 | | |
3051 | 3051 | | |
3052 | | - | |
| 3052 | + | |
3053 | 3053 | | |
3054 | 3054 | | |
3055 | 3055 | | |
| |||
0 commit comments