Skip to content

Commit 8a13868

Browse files
mareklibraeloycoto
authored andcommitted
How to run on GCP
Signed-off-by: Marek Libra <marek.libra@gmail.com>
1 parent 609e5f9 commit 8a13868

File tree

1 file changed

+12
-6
lines changed

1 file changed

+12
-6
lines changed

README.md

Lines changed: 12 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -15,18 +15,24 @@ This project creates a Docker Compose setup with two main services:
1515

1616
## How to Start Services
1717

18-
### Before starting env variables:
19-
18+
### Requirements:
19+
- podman-compose v1.5.0+
2020

21+
### OLLAMA running locally
2122
```
22-
export VLLM_URL="http://SERVER_IP:11434/v1"
23-
export VERTEXAI_PROJECT="myproject"
23+
export VLLM_URL="http://host.containers.internal:11434/v1"
2424
```
2525

26-
If using google, check that your google cloud account is running correctly:
27-
26+
### Vertex AI running in GCP
2827
```
28+
# create ~/.config/gcloud/application_default_credentials.json:
29+
gcloud auth application-default login
30+
31+
# Verify login:
2932
gcloud auth list
33+
34+
# From https://console.cloud.google.com/home/dashboard
35+
export VERTEXAI_PROJECT="myproject"
3036
```
3137

3238
### Using podman-compose

0 commit comments

Comments
 (0)