Skip to content

Commit 43637ea

Browse files
committed
change model name to default
1 parent 011266d commit 43637ea

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

samples/managed-llm-provider/compose.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ services:
88
restart: always
99
environment:
1010
- ENDPOINT_URL=http://llm/api/v1/chat/completions # endpoint to the Provider Service
11-
- MODEL=us.amazon.nova-micro-v1:0 # LLM model ID used in the Provider Service
11+
- MODEL=default # LLM model ID used in the Provider Service
1212
# For other models, see https://docs.defang.io/docs/concepts/managed-llms/openai-access-gateway#model-mapping
1313
healthcheck:
1414
test: ["CMD", "python3", "-c", "import sys, urllib.request; urllib.request.urlopen(sys.argv[1]).read()", "http://localhost:8000/"]

samples/managed-llm/compose.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ services:
88
restart: always
99
environment:
1010
- ENDPOINT_URL=http://llm/api/v1/chat/completions # endpoint to the gateway service
11-
- MODEL=us.amazon.nova-micro-v1:0 # LLM model ID used for the gateway.
11+
- MODEL=default # LLM model ID used for the gateway.
1212
# For other models, see https://docs.defang.io/docs/concepts/managed-llms/openai-access-gateway#model-mapping
1313
- OPENAI_API_KEY=FAKE_TOKEN # the actual value will be ignored when using the gateway, but it should match the one in the llm service
1414
healthcheck:

0 commit comments

Comments
 (0)