We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 1e31d2c commit 07af4e0Copy full SHA for 07af4e0
triton/apps/llms.rst
@@ -100,16 +100,13 @@ Here is an example slurm script using the raw weights to do batch inference. For
100
Model weight conversions
101
------------------------
102
Usually models produced in research are stored as weights from PyTorch or other
103
-frameworks. When doing inference,
104
-
105
-We also have models that are already converted to different formats.
+frameworks. As for inference, we also have models that are already converted to different formats.
106
107
108
Huggingface Models
109
~~~~~~~~~~~~~~~~~~~
110
111
112
113
We have the following Huggingface models stored:
114
115
.. list-table::
0 commit comments