Skip to content

Commit 704c906

Browse files
bo-nvpcastonguay
andauthored
Update tensorrt_llm/_torch/disaggregation/native/mixers/ssm/peer.py
Co-authored-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> Signed-off-by: Bo Deng <deemod@nvidia.com>
1 parent ad70588 commit 704c906

File tree

1 file changed

+1
-1
lines changed
  • tensorrt_llm/_torch/disaggregation/native/mixers/ssm

1 file changed

+1
-1
lines changed

tensorrt_llm/_torch/disaggregation/native/mixers/ssm/peer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -314,7 +314,7 @@ def _mamba_tp(ri: RankInfo) -> Tuple[int, int]:
314314
@staticmethod
315315
def _build_layer_ptrs(
316316
pool,
317-
layer_offsets: dict,
317+
layer_offsets: Dict[int,int],
318318
overlapping_layers: List[int],
319319
slot: int,
320320
) -> List[int]:

0 commit comments

Comments
 (0)