File tree Expand file tree Collapse file tree 1 file changed +5
-1
lines changed
Expand file tree Collapse file tree 1 file changed +5
-1
lines changed Original file line number Diff line number Diff line change @@ -18,11 +18,13 @@ This project creates a Docker Compose setup with two main services:
1818### Requirements:
1919- podman-compose v1.5.0+
2020
21- ### OLLAMA running locally
21+ ### OLLAMA ( running locally)
2222```
2323export VLLM_URL="http://host.containers.internal:11434/v1"
2424```
2525
26+ More info: https://llama-stack.readthedocs.io/en/latest/providers/inference/remote_vllm.html
27+
2628### Vertex AI running in GCP
2729```
2830# create ~/.config/gcloud/application_default_credentials.json:
@@ -35,6 +37,8 @@ gcloud auth list
3537export VERTEXAI_PROJECT="myproject"
3638```
3739
40+ More info: https://llama-stack.readthedocs.io/en/latest/providers/inference/remote_vertexai.html
41+
3842### Using podman-compose
3943
4044``` bash
You can’t perform that action at this time.
0 commit comments