Skip to content

Commit adddce3

Browse files
Update pre_layer_infer.py
1 parent 702da1b commit adddce3

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

lightllm/models/qwen_vl/layer_infer/pre_layer_infer.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,7 @@ def context_forward(self, input_ids, infer_state: LlamaInferStateInfo, layer_wei
3838
img_token_lens = []
3939
img_start_loc = 0
4040
img_start_locs = []
41+
4142
device = layer_weight.wte_weight_.device
4243
dtype = layer_weight.wte_weight_.dtype
4344
hidden_size = layer_weight.wte_weight_.shape[1]

0 commit comments

Comments
 (0)