Skip to content

Commit dbe4ab4

Browse files
update docs to refer to LLM_URL instead of ENDPOINT_URL
1 parent bd2b041 commit dbe4ab4

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

samples/managed-llm/README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -11,19 +11,19 @@ Using the [Defang OpenAI Access Gateway](#defang-openai-access-gateway), the fea
1111

1212
This allows switching from OpenAI to the Managed LLMs on supported cloud platforms without modifying your application code.
1313

14-
You can configure the `MODEL` and `ENDPOINT_URL` for the LLM separately for local development and production environments.
14+
You can configure the `MODEL` and `LLM_URL` for the LLM separately for local development and production environments.
1515
* The `MODEL` is the LLM Model ID you are using.
16-
* The `ENDPOINT_URL` is the bridge that provides authenticated access to the LLM model.
16+
* The `LLM_URL` is the bridge that provides authenticated access to the LLM model.
1717

1818
Ensure you have enabled model access for the model you intend to use. To do this, you can check your [AWS Bedrock model access](https://docs.aws.amazon.com/bedrock/latest/userguide/model-access-modify.html) or [GCP Vertex AI model access](https://cloud.google.com/vertex-ai/generative-ai/docs/control-model-access).
1919

20-
To learn about available LLM models in Defang, please see our [Model Mapping documentation](https://docs.defang.io/docs/concepts/managed-llms/openai-access-gateway#model-mapping).
20+
To learn about available LLM models in Defang, please see our [Model Mapping documentation](https://docs.defang.io/docs/concepts/managed-llms/openai-access-gateway#model-mapping).
2121

2222
For more about Managed LLMs in Defang, please see our [Managed LLMs documentation](https://docs.defang.io/docs/concepts/managed-llms/managed-language-models).
2323

2424
### Defang OpenAI Access Gateway
2525

26-
In the `compose.yaml` file, the `llm` service is used to route requests to the LLM API model. This is known as the [Defang OpenAI Access Gateway](https://docs.defang.io/docs/concepts/managed-llms/openai-access-gateway).
26+
In the `compose.yaml` file, the `llm` service is used to route requests to the LLM API model. This is known as the [Defang OpenAI Access Gateway](https://docs.defang.io/docs/concepts/managed-llms/openai-access-gateway).
2727

2828
The `x-defang-llm` property on the `llm` service must be set to `true` in order to use the OpenAI Access Gateway when deploying with Defang.
2929

0 commit comments

Comments
 (0)