Skip to content

Conversation

@bachelor-dou
Copy link
Contributor

This PR fixes a crash that occurred when llama-bench was run on multiple cann devices(#9250).

before the fix:
image

after the fix:
image

@bachelor-dou
Copy link
Contributor Author

@hipudding

@bachelor-dou
Copy link
Contributor Author

@znzjugod
Very sorry for confirming and fixing this bug after so long, the issue (#9250) was delayed due to being busy with other projects. This PR was tested using two NPUs and your CMD commands and I believe the issue has been resolved. Please get the latest code to try after this PR is merged in, thank you very much for your feedback.

@hipudding hipudding self-requested a review September 25, 2024 03:29
@hipudding hipudding added the Ascend NPU issues specific to Ascend NPUs label Sep 25, 2024
@hipudding hipudding merged commit 904837e into ggml-org:master Sep 25, 2024
53 checks passed
@bachelor-dou bachelor-dou deleted the bug-fix branch November 25, 2024 12:46
@bachelor-dou bachelor-dou restored the bug-fix branch November 25, 2024 12:46
@bachelor-dou bachelor-dou deleted the bug-fix branch April 14, 2025 12:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Ascend NPU issues specific to Ascend NPUs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants