Skip to content

[Triton] Shaoclee/355 wip mha rope kv cache #723

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: 355_wip
Choose a base branch
from
Open

[Triton] Shaoclee/355 wip mha rope kv cache #723

wants to merge 2 commits into from

Conversation

k50112113
Copy link

@k50112113 k50112113 commented Sep 29, 2025 •
edited by github-actions bot
Loading

Previously, VLLM_ROCM_USE_AITER_TRITON_FUSED_ROPE_ZEROS_KV_CACHE will be disabled if VLLM_ROCM_USE_AITER_MHA is turned on.

This PR enables VLLM_ROCM_USE_AITER_MHA and VLLM_ROCM_USE_AITER_TRITON_FUSED_ROPE_ZEROS_KV_CACHE both to be turned on

This change would affect Llama and GPT-OSS

@k50112113 k50112113 requested a review from gshtras as a code owner September 29, 2025 16:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gshtras gshtras Awaiting requested review from gshtras gshtras is a code owner

@dllehr-amd dllehr-amd Awaiting requested review from dllehr-amd

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@k50112113