Skip to content

[bugfix] share buffer used out #592

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
mag1c-h merged 7 commits into from
Dec 27, 2025
Merged

[bugfix] share buffer used out #592

mag1c-h merged 7 commits into from
Dec 27, 2025

Conversation

@mag1c-h
Copy link
Contributor

@mag1c-h mag1c-h commented Dec 27, 2025 •
edited
Loading

Issue

When the reserved shared memory is exhausted, the process will loop indefinitely, waiting for other processes to release memory, impacting the performance of the transfer task.

Fix

When the reserved shared memory is exhausted, temporarily allocate host memory for the current transfer task.

Test

use local buffer

image

use share buffer

image

hit in share buffer

image

share buffer used out

image

@mag1c-h mag1c-h requested a review from ygwpz as a code owner December 27, 2025 09:24
@mag1c-h mag1c-h requested a review from qyh111 December 27, 2025 09:32
@mag1c-h mag1c-h merged commit b9bce8a into ModelEngine-Group:0.2.0-release Dec 27, 2025
3 checks passed
@mag1c-h mag1c-h deleted the dev-share-buffer-used-out-fix branch December 27, 2025 11:01
mag1c-h added a commit to mag1c-h/unified-cache-management that referenced this pull request Dec 28, 2025
@mag1c-h
[bugfix] share buffer used out (ModelEngine-Group#592)
4679a7c 
When the reserved shared memory is exhausted, temporarily allocate host memory for the current transfer task.

(cherry picked from commit b9bce8a)
@mag1c-h mag1c-h mentioned this pull request Dec 28, 2025
Merged
ygwpz pushed a commit that referenced this pull request Dec 29, 2025
@mag1c-h
[bugfix] share buffer used out (cherry-picked from #592) (#598)
ce981c4 
[bugfix] share buffer used out (#592)

When the reserved shared memory is exhausted, temporarily allocate host memory for the current transfer task.

(cherry picked from commit b9bce8a)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ygwpz ygwpz ygwpz approved these changes

@qyh111 qyh111 qyh111 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@mag1c-h @ygwpz @qyh111