Skip to content

Conversation

@A1waysBeenHere
Copy link
Contributor

@A1waysBeenHere A1waysBeenHere commented Nov 17, 2025

What does this PR do?

Auto-patch all Attention layers to ensure cu_seq_lens stays on CPU for NPU fused-attention

Add concise overview of what this PR aims to achieve or accomplish. Reference related GitHub issues and PRs that help with the review.

Checklist Before Starting

  • Search for similar PRs. Paste at least one query link here: ...
  • Format the PR title as [{modules}] {type}: {description} (This will be checked by the CI)
    • {modules} include misc, ci, config, docs, core, data, dist, omni, logging, model, optim, ckpt, release, task, `
    • If this PR involves multiple modules, separate them with , like [megatron, torch, liger-kernals,fsdp, doc]
    • {type} is in feat, fix, refactor, chore, test
    • If this PR breaks any API (CLI arguments, config, function signature, etc.), add [BREAKING] to the beginning of the title.
    • Example: [BREAKING][fsdp, torch, liger-kernals] feat: dynamic batching

Test

For changes that can not be tested by CI (e.g., algorithm implementation, new model support), validate by experiment(s) and show results like training curve plots, evaluation results, etc.

API and Usage Example

Demonstrate how the API changes if any, and provide usage example(s) if possible.

# Add code snippet or script demonstrating how to use this

Design & Code Changes

Demonstrate the high-level design if this PR is complex, and list the specific changes.

Checklist Before Submitting

Important

Please check all the following items before requesting a review, otherwise the reviewer might deprioritize this PR for review.

@A1waysBeenHere A1waysBeenHere changed the title Added related yaml for qwen3 dense model sft [fix] [model] auto-patch all Attention layers to ensure cu_seq_lens stays on CPU for NPU fused-attention. Nov 24, 2025
@Luosuu
Copy link
Collaborator

Luosuu commented Nov 24, 2025

Thank you very much for your contribution. Please take a look @wey-code @piyifan123

@onehaitao
Copy link
Contributor

label ascend

@github-actions github-actions bot added the ascend everything about Ascend support label Dec 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ascend everything about Ascend support

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants