Skip to content

Conversation

intelgaoxiong
Copy link
Contributor

@intelgaoxiong intelgaoxiong commented Oct 9, 2025

Details:

Fixed below compilation issue on NPU when trying to compile SDPA cut model on NPU.
Try...catch does not work because the dynamic shapes trigger LLVM abort.

[ERROR] 21:06:40.798 [IE::FrontEnd::importNetwork]   Upper bounds are not specified for node 'Convert_54320' (type 'Convert'): input '0' bounds are '[1, 8, 9223372036854775807, 128]'
[ERROR] 21:06:40.799 [vpux-compiler] Got Diagnostic at loc(fused<{name = "__module.model.layers.0.self_attn/aten::cat/Concat_2", type = "Concat"}>["__module.model.layers.0.self_attn/aten::cat/Concat_2"]) : Concat with offset '0' and stride '1' doesn't fit to output dimension '-9223372036854774785'
loc(fused<{name = "__module.model.layers.0.self_attn/aten::cat/Concat_2", type = "Concat"}>["__module.model.layers.0.self_attn/aten::cat/Concat_2"]): error: Concat with offset '0' and stride '1' doesn't fit to output dimension '-9223372036854774785'
LLVM ERROR: Failed to infer result type(s).
image

Tickets:

@intelgaoxiong intelgaoxiong marked this pull request as ready for review October 9, 2025 06:33
@intelgaoxiong intelgaoxiong requested review from a team as code owners October 9, 2025 06:33
@github-actions github-actions bot added category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin labels Oct 9, 2025
@intelgaoxiong intelgaoxiong requested a review from dmatveev October 9, 2025 06:34
@dmatveev dmatveev added this to the 2025.4 milestone Oct 9, 2025
Signed-off-by: intelgaoxiong <[email protected]>

Handle compilation failure.

Signed-off-by: intelgaoxiong <[email protected]>
Copy link
Contributor

@dmatveev dmatveev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think structurally I am fine with this change, I've filed a complement issue on the compiler to deal with the error handling properly EISW-187899

@dmatveev dmatveev added this pull request to the merge queue Oct 10, 2025
Merged via the queue into openvinotoolkit:master with commit 79f9953 Oct 10, 2025
181 checks passed
@dmatveev dmatveev deleted the xiong/handle_compilation_failure branch October 10, 2025 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants