Skip to content

Commit e40b5a4

Browse files
committed
[Draft][None] add flashinfer api for trtllm moe
Signed-off-by: rosong11 <[email protected]>
1 parent 7e88212 commit e40b5a4

File tree

2 files changed

+556
-179
lines changed

2 files changed

+556
-179
lines changed

requirements.txt

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,8 @@ ordered-set
5252
peft
5353
patchelf
5454
einops
55-
flashinfer-python>=0.3.0,<0.4.0
55+
# flashinfer-python>=0.3.0,<0.4.0
56+
flashinfer-python @ git+https://github.com/flashinfer-ai/flashinfer.git@25de38e50542ee45885881d11edbde67124e8960
5657
opencv-python-headless
5758
xgrammar==0.1.25
5859
llguidance==0.7.29

0 commit comments

Comments
 (0)