CANN: Support ROPE_VISION #12
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
描述 (Description)
修改ROPE算子,添加对VISION模式的支持。
测试 (Testing)
依照如下步骤进行测试,首先,在入口处修改判断条件。采取短路设置,确保mode为VISION模式时必然能够调用算子进行计算;其他判断条件保持不变。
进行编译并测试:
最终的运行如下图所示。使用红色方框标记出了mode=24(即VISION模式)的测试用例。如下:

备注 (Notes)
此代码参考了社区最新更新的ROPE的部分函数(https://github.com/ggml-org/llama.cpp)