You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/models/supported_models.md
+60Lines changed: 60 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -168,6 +168,66 @@ If vLLM successfully returns text (for generative models) or hidden states (for
168
168
Otherwise, please refer to [Adding a New Model](#new-model) for instructions on how to implement your model in vLLM.
169
169
Alternatively, you can [open an issue on GitHub](https://github.com/vllm-project/vllm/issues/new/choose) to request vLLM support.
170
170
171
+
#### Download a model
172
+
173
+
If you prefer, you can use the Hugging Face CLI to [download a model](https://huggingface.co/docs/huggingface_hub/guides/cli#huggingface-cli-download) or specific files from a model repository:
Use the Hugging Face CLI to interactively [delete downloaded model](https://huggingface.co/docs/huggingface_hub/guides/manage-cache#clean-your-cache) from the cache:
204
+
205
+
```console
206
+
# The `delete-cache`command requires extra dependencies to work with the TUI.
207
+
# Please run `pip install huggingface_hub[cli]` to install them.
208
+
209
+
# Launch the interactive TUI to selectmodels to delete
210
+
$ huggingface-cli delete-cache
211
+
? Select revisions to delete: 1 revisions selected counting for 438.9M.
212
+
○ None of the following (if selected, nothing will be deleted).
213
+
Model BAAI/bge-base-en-v1.5 (438.9M, used 1 week ago)
214
+
❯ ◉ a5beb1e3: main # modified 1 week ago
215
+
216
+
Model BAAI/bge-large-en-v1.5 (1.3G, used 1 week ago)
217
+
○ d4aa6901: main # modified 1 week ago
218
+
219
+
Model BAAI/bge-reranker-base (1.1G, used 4 weeks ago)
220
+
○ 2cfc18c9: main # modified 4 weeks ago
221
+
222
+
Press <space> to select, <enter> to validate and <ctrl+c> to quit without modification.
223
+
224
+
# Need to confirm after selected
225
+
? Select revisions to delete: 1 revision(s) selected.
0 commit comments