Skip to content

Commit 3d158cd

Browse files
authored
Add default value to avoid Falcon crash (#5363) (#10347)
Signed-off-by: wchen61 <[email protected]>
1 parent 02dbf30 commit 3d158cd

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

vllm/model_executor/models/falcon.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -250,6 +250,9 @@ def __init__(
250250
self.mlp = FalconMLP(config, quant_config)
251251
self.config = config
252252

253+
if (not hasattr(config, "num_ln_in_parallel_attn")):
254+
config.num_ln_in_parallel_attn = None
255+
253256
if (config.num_ln_in_parallel_attn is None
254257
and config.new_decoder_architecture):
255258
config.num_ln_in_parallel_attn = 2

0 commit comments

Comments
 (0)