Skip to content

Commit ce9f7e6

Browse files
committed
add link to llm concepts
1 parent 7997f63 commit ce9f7e6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

samples/managed-llm/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ This sample application demonstrates the use of OpenAI-compatible Managed LLMs (
77

88
> Note: Using Docker Model Provider? See our [*Managed LLM with Docker Model Provider*](https://github.com/DefangLabs/samples/tree/main/samples/managed-llm-provider) sample.
99
10-
Using the Defang OpenAI Access Gateway, the Managed LLM feature `x-defang-llm: true` allows users to use AWS Bedrock or Google Cloud Vertex AI models with an OpenAI-compatible SDK. This enables switching from OpenAI to one of these cloud-native platforms without modifying your application code. This feature is available in the Defang Playground and Defang BYOC.
10+
Using the Defang OpenAI Access Gateway, the [Managed LLM](https://docs.defang.io/docs/concepts/managed-llms/managed-language-models) feature `x-defang-llm: true` allows users to use AWS Bedrock or Google Cloud Vertex AI models with an OpenAI-compatible SDK. This enables switching from OpenAI to one of these cloud-native platforms without modifying your application code. This feature is available in the Defang Playground and Defang BYOC.
1111

1212
You can configure the `MODEL` and `ENDPOINT_URL` for the LLM separately for local development and production environments.
1313
* The `MODEL` is the LLM Model ID you are using.

0 commit comments

Comments
 (0)