Skip to content

Commit 97768d2

Browse files
committed
in README-ollama.md: the httpie recipes to reach both servers
1 parent 0844a68 commit 97768d2

File tree

1 file changed

+19
-0
lines changed

1 file changed

+19
-0
lines changed

notebooks/tps/chatbot/.teacher/README-ollama.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,3 +20,22 @@ ollama pull gemma2:2b
2020
ollama pull mistral:7b
2121
ollama pull deepseek-r1:7b
2222
```
23+
24+
## testing
25+
26+
Using `http` (from `pip install httpie`) you can reach both instances from the command line like so:
27+
28+
```bash
29+
30+
# the CPU
31+
http http://ollama.pl.sophia.inria.fr:8080/api/generate model=mistral:7b prompt="Hey"
32+
33+
# the GPU
34+
http https://Bob:[email protected]/api/generate model=mistral:7b prompt="Hey"
35+
36+
# in streaming mode: CPU
37+
http -S http://ollama.pl.sophia.inria.fr:8080/api/generate model=mistral:7b prompt="Hey" stream:=true
38+
39+
# in streaming mode: GPU
40+
http -S https://Bob:[email protected]/api/generate model=mistral:7b prompt="Hey" stream:=true
41+
```

0 commit comments

Comments
 (0)