Commit eeb5605
authored
CANN: Add MROPE and IMROPE support (ggml-org#17401)
* CANN: ROPE supports both MROPE and IMROPE.
1. Optimize the caching logic of rope_cache_init.
2. Add support for mRoPE and i-mRoPE.
Note that on Ascend 910B devices, it is necessary to disable FA
in CLIP and disable NZ-format conversion. These two issues are
still under investigation.
* Resolve review comments1 parent f3a848a commit eeb5605
3 files changed
+411
-170
lines changed
0 commit comments