Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

Commit cfe1baa

Browse files
authored
Update README.md
1 parent c87e2f9 commit cfe1baa

File tree

1 file changed

+6
-3
lines changed

1 file changed

+6
-3
lines changed

src/deepsparse/transformers/README.md

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -151,9 +151,12 @@ https://sparsezoo.neuralmagic.com/?useCase=text_generation)
151151
```python
152152
from deepsparse import Pipeline
153153

154-
opt_pipeline = Pipeline.create(task="opt", model_path="zoo:opt-1.3b-opt_pretrain-quantW8A8")
154+
llama_pipeline = Pipeline.create(
155+
task="text-generation",
156+
model_path="zoo:llama2-7b-ultrachat200k_llama2_pretrain-pruned50_quantized"
157+
)
155158

156-
inference = opt_pipeline("Who is the president of the United States?")
159+
inference = llama_pipeline("Who is the president of the United States?")
157160

158161
>> 'The president of the United States is the head of the executive branch of government...'
159162
```
@@ -163,7 +166,7 @@ Spinning up:
163166
```bash
164167
deepsparse.server \
165168
--task text-generation \
166-
--model_path zoo:opt-1.3b-opt_pretrain-pruned50_quantW8A8
169+
--model_path zoo:llama2-7b-ultrachat200k_llama2_pretrain-pruned50_quantized
167170
```
168171

169172
Making a request:

0 commit comments

Comments
 (0)