Skip to content

Commit 488ef17

Browse files
authored
Update rtp-llm-server.md
1 parent 94f03fa commit 488ef17

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

content/learning-paths/servers-and-cloud-computing/rtp-llm/rtp-llm-server.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ One additional software package is required for this section. Install `jq` on yo
1515
sudo apt install jq -y
1616
```
1717

18-
# Server
18+
# Running the Server
1919
## Install Hugging Face Hub
2020

2121
There are a few different ways you can download the Qwen2 0.5B model. In this Learning Path, you download the model from Hugging Face.
@@ -72,7 +72,7 @@ MODEL_TYPE=qwen_2 FT_SERVER_TEST=1 python3 -m maga_transformer.start_server
7272

7373
You can access the API using the `curl` command.
7474

75-
In another terminal, use a text editor to create a file named `curl-test.sh` with the commands below:
75+
In another terminal, use a text editor to create a file named `curl-test.sh` with the content below:
7676

7777
```bash
7878
curl http://localhost:8088/v1/chat/completions -H "Content-Type: application/json" -d '{
@@ -183,8 +183,8 @@ int main() {
183183
std::cout << "Hello, World!" << std::endl;
184184
return 0;
185185
}
186-
186+
```
187187
This program includes the `iostream` library, which is used for input/output operations. The `main` function is the entry point of the program, and it calls the `cout` object to print the message "Hello, World!" to the console.
188188
```
189189
190-
You can continue to experiment with different large language models and write scripts to try them.
190+
You can continue to experiment with different large language models and write scripts to access them.

0 commit comments

Comments
 (0)