Skip to content

Commit ab4bdd8

Browse files
committed
Update Blog “deploying-a-hugging-face-llm-in-hpe-private-cloud-ai”
1 parent 09dc104 commit ab4bdd8

File tree

1 file changed

+6
-6
lines changed

1 file changed

+6
-6
lines changed

content/blog/deploying-a-hugging-face-llm-in-hpe-private-cloud-ai.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ First, install `openai` if you do not already have it and import.
6161
from openai import OpenAI
6262
```
6363

64-
Then using the endpoint and key generated by HPE MLIS enter them into your Jupyter Notebook. Be sure to append /v1 to the URL.
64+
Then, using the endpoint and key generated by HPE MLIS, enter them into your Jupyter Notebook. Be sure to append /v1 to the URL.
6565

6666
```python
6767
# Grab endpoint URL and API key from MLIS, remember to include "/v1" for latest version of the OpenAI-compatible API
@@ -70,7 +70,7 @@ openai_api_base = "https://smollm2-1-7b-vllm-predictor-dave-wright-hpe-1073f7cd.
7070
openai_api_key = "eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpYXQiOjE3Mzk5MzgzMzAsImlzcyI6ImFpb2xpQGhwZS5jb20iLCJzdWIiOiI5MjNhM2JhOC1mMGU4LTQxOTQtODNkMS05ZWY4NzNjZGYxOWYiLCJ1c2VyIjoiZGF2ZS53cmlnaHQtaHBlLmNvbSJ9.YwH9gGPxTWxy4RSdjnQA9-U3_u7P0OIcarqw25DV8bOiftU1L4IvvyERHspj2lMGtZWbff1F3uh84wjAePHaHDcDTLoGtq6gJYwo_qRU03xV8Q2lwBetCCLUE4OHqS608gjJ-j1SLyqwxFxlXkqMOtnBY5_nswlAwCzHV28P8u8XxxfWuXFmoJpSA1egCWVVfEoTuK8CTz9kUJJ5opSp6m8qdqJmC2qxH0igcpKmL2H_MZ-62UHfEf240VRtc0DRNlOjeCoDM79aVPs3SjCtGeVkeEHimJwJbfGFIcu3LibX3QjbABUzWb5BPPZjzyEYUVM5ak12_sJ8j1mUW-r0sA"
7171
```
7272

73-
Now, we need an OpenAI client interface.
73+
You will now need to create an OpenAI client interface.
7474

7575
```python
7676
# create OpenAI client interface
@@ -80,7 +80,7 @@ client = OpenAI(
8080
)
8181
```
8282

83-
In order to interact with the model we need to create a chat function, but let's give it a history feature as well as basic chat.
83+
In order to interact with the model, you will need to create a chat function. For the purposes of our example, let's give it a history feature as well as basic chat.
8484

8585
```python
8686
# Interactive chat function with message history.
@@ -124,12 +124,12 @@ def chat():
124124

125125
![Jupyter Notebook showing imported model endpoint and API key.](/img/jupyter.png)
126126

127-
Then, interacting with the model is done through a simple chat.
127+
Once this is done, you can interact with the model through a simple chat.
128128

129129
![Interaction with the SmolLM2 Small Language Model in a Jupyter Notebook](/img/chat-interface.png)
130130

131-
For a recorded demonstration that shows the process real time see this screen recording. <https://www.youtube.com/watch?v=oqjc-2c1Vtk>
131+
You can access [this link](https://www.youtube.com/watch?v=oqjc-2c1Vtk) to see a recorded demonstration that shows this process in real time. [](https://www.youtube.com/watch?v=oqjc-2c1Vtk)
132132

133133
### Summary
134134

135-
With HPE Private Cloud AI loading new models into the system and providing endpoints is just a few simple clicks and easily integrates with popular tools like Jupyter Notebooks. To learn more about HPE Private Cloud AI please visit: <https://www.hpe.com/us/en/private-cloud-ai.html>
135+
With HPE Private Cloud AI, loading new models into the system and providing endpoints is just a few simple clicks and easily integrates with popular tools like Jupyter Notebooks. To learn more about HPE Private Cloud AI, please visit: <https://www.hpe.com/us/en/private-cloud-ai.html>

0 commit comments

Comments
 (0)