Skip to content

Commit f8c688d

Browse files
authored
[Minor] Add Phi 2 to supported models (#2159)
1 parent c9fadda commit f8c688d

File tree

3 files changed

+5
-5
lines changed

3 files changed

+5
-5
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
6565
- Mixtral (`mistralai/Mixtral-8x7B-v0.1`, `mistralai/Mixtral-8x7B-Instruct-v0.1`, etc.)
6666
- MPT (`mosaicml/mpt-7b`, `mosaicml/mpt-30b`, etc.)
6767
- OPT (`facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
68-
- Phi-1.5 (`microsoft/phi-1_5`, etc.)
68+
- Phi (`microsoft/phi-1_5`, `microsoft/phi-2`, etc.)
6969
- Qwen (`Qwen/Qwen-7B`, `Qwen/Qwen-7B-Chat`, etc.)
7070
- Yi (`01-ai/Yi-6B`, `01-ai/Yi-34B`, etc.)
7171

docs/source/models/supported_models.rst

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -60,8 +60,8 @@ Alongside each architecture, we include some popular models that use it.
6060
- OPT, OPT-IML
6161
- :code:`facebook/opt-66b`, :code:`facebook/opt-iml-max-30b`, etc.
6262
* - :code:`PhiForCausalLM`
63-
- Phi-1.5
64-
- :code:`microsoft/phi-1_5`, etc.
63+
- Phi
64+
- :code:`microsoft/phi-1_5`, :code:`microsoft/phi-2`, etc.
6565
* - :code:`QWenLMHeadModel`
6666
- Qwen
6767
- :code:`Qwen/Qwen-7B`, :code:`Qwen/Qwen-7B-Chat`, etc.

tests/models/test_models.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,12 +15,12 @@
1515
"EleutherAI/pythia-70m",
1616
"bigscience/bloom-560m",
1717
"mosaicml/mpt-7b",
18-
"microsoft/phi-1_5",
18+
"microsoft/phi-2",
1919
]
2020

2121

2222
@pytest.mark.parametrize("model", MODELS)
23-
@pytest.mark.parametrize("dtype", ["half"])
23+
@pytest.mark.parametrize("dtype", ["float"])
2424
@pytest.mark.parametrize("max_tokens", [128])
2525
def test_models(
2626
hf_runner,

0 commit comments

Comments
 (0)