Skip to content

Commit 71b40f8

Browse files
committed
[Bugfix] Fix Dense module loading for sentence-transformers embedding models v6
Signed-off-by: FFFfff1FFFfff <[email protected]>
1 parent 5ba78c7 commit 71b40f8

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

vllm/transformers_utils/config.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,9 +38,14 @@
3838
RWConfig, SpeculatorsConfig,
3939
Step3TextConfig, Step3VLConfig,
4040
UltravoxConfig)
41+
42+
try:
43+
from vllm.transformers_utils.configs.mllama import MllamaConfig
44+
except ImportError:
45+
MllamaConfig = None
46+
4147
# yapf: enable
4248
from vllm.transformers_utils.configs.mistral import adapt_config_dict
43-
from vllm.transformers_utils.configs.mllama import MllamaConfig
4449
from vllm.transformers_utils.configs.nvlm_d import NVLM_D_Config
4550
from vllm.transformers_utils.utils import check_gguf_file
4651

0 commit comments

Comments
 (0)