Skip to content

Conversation

createthis
Copy link

@createthis createthis commented Jul 6, 2025

Credit to @magikRUKKOLA for the patch. I'm just issuing a PR for it. This is for issue #1417

@qiyuxinlin
Copy link
Contributor

Sorry for the delayed response to the PR. I will work on it this weekend. Thank you for supporting this project.

@magikRUKKOLA
Copy link

Sorry for the delayed response to the PR. I will work on it this weekend. Thank you for supporting this project.

Please consider this PR invalid.
The main gist is that you are using flashinfer (old fork actually) and its unstable. I tried to apply the changes from the master and unfortunately it didn't work -- its either crashes or outputs garbage for a long context.
Meaning that neither flashinfer nor ktransformers (because its using flashinfer) is usable at the moment. That's just sad.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants