Skip to content

Commit a187578

Browse files
committed
update server example
1 parent f40f1cf commit a187578

File tree

1 file changed

+15
-1
lines changed

1 file changed

+15
-1
lines changed

MyApp/_posts/2025-09-25_llms-py.md

Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -100,8 +100,22 @@ llms --chat audio-request.json --audio talk.mp3 "Transcribe this audio file"
100100
llms --default grok-4-fast
101101

102102
# Run an Open AI Chat compatible server
103-
llms --server --port 8080
103+
llms --serve 8000
104104
```
105+
106+
Example client usage:
107+
108+
```bash
109+
curl -X POST http://localhost:8000/v1/chat/completions \
110+
-H "Content-Type: application/json" \
111+
-d '{
112+
"model": "kimi-k2",
113+
"messages": [
114+
{"role": "user", "content": "Hello!"}
115+
]
116+
}'
117+
```
118+
105119
### 🌐 Configurable Multi-Provider Gateway
106120

107121
Acts as an intelligent gateway that can route requests for 160+ models across:

0 commit comments

Comments
 (0)