Skip to content

Commit 9c86076

Browse files
fix env var names
1 parent 3de7f9e commit 9c86076

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

samples/managed-llm/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,8 +11,8 @@ Using the [Defang OpenAI Access Gateway](#defang-openai-access-gateway), the fea
1111

1212
This allows switching from OpenAI to the Managed LLMs on supported cloud platforms without modifying your application code.
1313

14-
You can configure the `MODEL` and `LLM_URL` for the LLM separately for local development and production environments.
15-
* The `MODEL` is the LLM Model ID you are using.
14+
You can configure the `LLM_MODEL` and `LLM_URL` for the LLM separately for local development and production environments.
15+
* The `LLM_MODEL` is the LLM Model ID you are using.
1616
* The `LLM_URL` is the bridge that provides authenticated access to the LLM model.
1717

1818
Ensure you have enabled model access for the model you intend to use. To do this, you can check your [AWS Bedrock model access](https://docs.aws.amazon.com/bedrock/latest/userguide/model-access-modify.html) or [GCP Vertex AI model access](https://cloud.google.com/vertex-ai/generative-ai/docs/control-model-access).

samples/managed-llm/compose.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ services:
88
restart: always
99
environment:
1010
- LLM_URL=http://llm/api/v1/ # endpoint to the gateway service
11-
- MODEL=default # LLM model ID used for the gateway.
11+
- LLM_MODEL=default # LLM model ID used for the gateway.
1212
# For other models, see https://docs.defang.io/docs/concepts/managed-llms/openai-access-gateway#model-mapping
1313
- OPENAI_API_KEY=FAKE_TOKEN # the actual value will be ignored when using the gateway, but it should match the one in the llm service
1414
healthcheck:

0 commit comments

Comments
 (0)