Skip to content

Commit 027b204

Browse files
[Bugfix] Re-enable support for ChatGLMForConditionalGeneration (vllm-project#16187)
Signed-off-by: DarkLight1337 <[email protected]>
1 parent 55dcce9 commit 027b204

File tree

3 files changed

+5
-2
lines changed

3 files changed

+5
-2
lines changed

docs/source/models/supported_models.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -233,9 +233,9 @@ See [this page](#generative-models) for more information on how to use generativ
233233
* `facebook/bart-base`, `facebook/bart-large-cnn`, etc.
234234
*
235235
*
236-
- * `ChatGLMModel`
236+
- * `ChatGLMModel`, `ChatGLMForConditionalGeneration`
237237
* ChatGLM
238-
* `THUDM/chatglm2-6b`, `THUDM/chatglm3-6b`, etc.
238+
* `THUDM/chatglm2-6b`, `THUDM/chatglm3-6b`, `ShieldLM-6B-chatglm3`, etc.
239239
* ✅︎
240240
* ✅︎
241241
- * `CohereForCausalLM`, `Cohere2ForCausalLM`

tests/models/registry.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -124,6 +124,8 @@ def check_available_online(
124124
"BloomForCausalLM": _HfExamplesInfo("bigscience/bloomz-1b1"),
125125
"ChatGLMModel": _HfExamplesInfo("THUDM/chatglm3-6b",
126126
trust_remote_code=True),
127+
"ChatGLMForConditionalGeneration": _HfExamplesInfo("thu-coai/ShieldLM-6B-chatglm3", # noqa: E501
128+
trust_remote_code=True),
127129
"CohereForCausalLM": _HfExamplesInfo("CohereForAI/c4ai-command-r-v01",
128130
trust_remote_code=True),
129131
"Cohere2ForCausalLM": _HfExamplesInfo("CohereForAI/c4ai-command-r7b-12-2024", # noqa: E501

vllm/model_executor/models/registry.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,7 @@
4343
"BambaForCausalLM": ("bamba", "BambaForCausalLM"),
4444
"BloomForCausalLM": ("bloom", "BloomForCausalLM"),
4545
"ChatGLMModel": ("chatglm", "ChatGLMForCausalLM"),
46+
"ChatGLMForConditionalGeneration": ("chatglm", "ChatGLMForCausalLM"),
4647
"CohereForCausalLM": ("commandr", "CohereForCausalLM"),
4748
"Cohere2ForCausalLM": ("commandr", "CohereForCausalLM"),
4849
"DbrxForCausalLM": ("dbrx", "DbrxForCausalLM"),

0 commit comments

Comments
 (0)