Skip to content

Commit 09dc104

Browse files
committed
Update Blog “deploying-a-hugging-face-llm-in-hpe-private-cloud-ai”
1 parent bb572f8 commit 09dc104

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

content/blog/deploying-a-hugging-face-llm-in-hpe-private-cloud-ai.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -31,29 +31,29 @@ Next select "Add new model".
3131

3232
![Computer screen showing packaged AI models and a selection to add a new model.](/img/new-model.png)
3333

34-
This brings up the "add new packaged model" dialog box. Fill in the the name of the model, storage requirements and resources. We reduce the default resources as this is a small model.
34+
This brings up the "Add new packaged model" dialog box. Fill in the the name of the model, storage requirements, and resources. We have reduced the default resources, given that this is a small model.
3535

3636
![Dialog box for defining a new packaged model.](/img/define-parameters.png)
3737

38-
Once the package is setup we get a confirmation.
38+
Once the package is set up, you will receive a confirmation.
3939

4040
![Shows running packaged model.](/img/package-running.png)
4141

42-
With the new packaged model complete we need to be able to deploy it for use. Select "create new deployment" from the HPE MLIS "Deployments" tab. Select submit when all tabs are filled out as shown below.
42+
With the new packaged model complete, you will need to deploy it for use. Select "create new deployment" from the HPE MLIS "Deployments" tab. Select submit when all tabs are filled out as shown below.
4343

4444
This will create an endpoint for use in the notebook and provide an API token.
4545

4646
![New deployment for AI model](/img/new-deployment.png)
4747

48-
When the process is complete an endpoint will be provided.
48+
When the process is complete, an endpoint will be provided.
4949

5050
![Endpoint provided by MLIS system](/img/endpoint.png)
5151

5252
Next up, let's take the now deployed model that's ready for inference and connect to it and interact with it from a Jupyter Notebook.
5353

5454
### Building the Jupyter Notebook
5555

56-
First install `openai` if you do not already have it and import.
56+
First, install `openai` if you do not already have it and import.
5757

5858
```python
5959
# vLLM Chat OpenAI

0 commit comments

Comments
 (0)