We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent c7cb0d6 commit a000ab6Copy full SHA for a000ab6
lightllm/common/basemodel/triton_kernel/sp_pad_copy.py
@@ -3,7 +3,7 @@
3
# if token_num % sp_world_size != 0, will pad
4
# token to token_num % sp_world_size == 0, this.
5
# demo: token_num = 3, sp_world_size = 4, will get
6
-# ans_tensor shape is [4, hidden_dim].
+# ans_tensor shape is [1, hidden_dim].
7
import torch
8
9
import triton
0 commit comments