Skip to content

Commit eeb5605

Browse files
authored
CANN: Add MROPE and IMROPE support (ggml-org#17401)
* CANN: ROPE supports both MROPE and IMROPE. 1. Optimize the caching logic of rope_cache_init. 2. Add support for mRoPE and i-mRoPE. Note that on Ascend 910B devices, it is necessary to disable FA in CLIP and disable NZ-format conversion. These two issues are still under investigation. * Resolve review comments
1 parent f3a848a commit eeb5605

File tree

3 files changed

+411
-170
lines changed

3 files changed

+411
-170
lines changed

0 commit comments

Comments
 (0)