Skip to content

Commit 6a451bf

Browse files
authored
fix
1 parent b23f659 commit 6a451bf

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lightllm/common/mem_manager.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -260,7 +260,7 @@ def alloc(self, need_size) -> torch.Tensor:
260260
self.shared_can_use_token_num.set_value(self.can_use_mem_size)
261261

262262
# 利用缓冲区返回,避免异步情况下的内存竞争
263-
if self._return_start + need_size >= self._mem_state_return.shape[0]:
263+
if self._return_start + need_size > self._mem_state_return.shape[0]:
264264
self._return_start = 0
265265
ans = self._mem_state_return[self._return_start : self._return_start + need_size]
266266
ans.copy_(self.mem_state[start:end])

0 commit comments

Comments
 (0)