Skip to content

Add cuda graph support for MLP memcpy#119

Draft
wu-qing-157 wants to merge 4 commits intomainfrom
yi/cudagraph
Draft

Add cuda graph support for MLP memcpy#119
wu-qing-157 wants to merge 4 commits intomainfrom
yi/cudagraph

Conversation

@wu-qing-157
Copy link
Collaborator

Several lines of code are marked with "FIXME". Those are some magic constants hardcoded, which should be moved to proper argument passing before merging.

@GindaChen GindaChen self-requested a review November 18, 2025 00:44
@GindaChen
Copy link
Collaborator

GindaChen commented Dec 16, 2025

Moving most of the parts to #124. But we still have [enable cudagraph for pre-mlp-to-attn memcpy](https://github.com/GindaChen/d2/pull/119/commits/2ed558d33e5499ad7162874e80fc6f3d63738bb4) left over.

@wu-qing-157 I wrote up an issue #125 for future reference.

As such, we will sunset this PR but only keeping the last commit for future dev work. Thanks!

@GindaChen GindaChen changed the title Add cuda graph support for MLP part Add cuda graph support for MLP memcpy Dec 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants