From 63ac440c8fa4da91cd818bb4c537dcc81a28bd0c Mon Sep 17 00:00:00 2001 From: commit111 Date: Sat, 17 May 2025 21:56:16 -0700 Subject: [PATCH] add link to docker model catalog --- docs/concepts/managed-llms/openai-access-gateway.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/concepts/managed-llms/openai-access-gateway.md b/docs/concepts/managed-llms/openai-access-gateway.md index 093243df6..e3bab0f1e 100644 --- a/docs/concepts/managed-llms/openai-access-gateway.md +++ b/docs/concepts/managed-llms/openai-access-gateway.md @@ -37,7 +37,7 @@ The `x-defang-llm` extension is used to configure the appropriate roles and perm ## Model Mapping -Defang supports model mapping through the [openai-access-gateway](https://github.com/DefangLabs/openai-access-gateway) on AWS and GCP. This takes a model with a Docker naming convention (e.g. `ai/llama3.3`) and maps it to the closest matching model name on the target platform. If no such match can be found, it can fallback onto a known existing model (e.g. `ai/mistral`). +Defang supports model mapping through the [openai-access-gateway](https://github.com/DefangLabs/openai-access-gateway) on AWS and GCP. This takes a model with a [Docker naming convention](https://hub.docker.com/catalogs/models) (e.g. `ai/llama3.3`) and maps it to the closest matching model name on the target platform. If no such match can be found, it can fallback onto a known existing model (e.g. `ai/mistral`). This can be configured through the following environment variables: * `USE_MODEL_MAPPING` (default to true) - configures whether or not model mapping should be enabled.