You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/blog/deploying-a-hugging-face-llm-in-hpe-private-cloud-ai.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,29 +31,29 @@ Next select "Add new model".
31
31
32
32

33
33
34
-
This brings up the "add new packaged model" dialog box. Fill in the the name of the model, storage requirements and resources. We reduce the default resources as this is a small model.
34
+
This brings up the "Add new packaged model" dialog box. Fill in the the name of the model, storage requirements, and resources. We have reduced the default resources, given that this is a small model.
35
35
36
36

37
37
38
-
Once the package is setup we get a confirmation.
38
+
Once the package is set up, you will receive a confirmation.
With the new packaged model complete we need to be able to deploy it for use. Select "create new deployment" from the HPE MLIS "Deployments" tab. Select submit when all tabs are filled out as shown below.
42
+
With the new packaged model complete, you will need to deploy it for use. Select "create new deployment" from the HPE MLIS "Deployments" tab. Select submit when all tabs are filled out as shown below.
43
43
44
44
This will create an endpoint for use in the notebook and provide an API token.
45
45
46
46

47
47
48
-
When the process is complete an endpoint will be provided.
48
+
When the process is complete, an endpoint will be provided.
49
49
50
50

51
51
52
52
Next up, let's take the now deployed model that's ready for inference and connect to it and interact with it from a Jupyter Notebook.
53
53
54
54
### Building the Jupyter Notebook
55
55
56
-
First install `openai` if you do not already have it and import.
56
+
First, install `openai` if you do not already have it and import.
0 commit comments