Skip to content

Commit 786b4ef

Browse files
Merge pull request #233 from DefangLabs/linda-docker-models
Add link to docker model catalog
2 parents 0746e52 + 63ac440 commit 786b4ef

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/concepts/managed-llms/openai-access-gateway.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ The `x-defang-llm` extension is used to configure the appropriate roles and perm
3737

3838
## Model Mapping
3939

40-
Defang supports model mapping through the [openai-access-gateway](https://github.com/DefangLabs/openai-access-gateway) on AWS and GCP. This takes a model with a Docker naming convention (e.g. `ai/llama3.3`) and maps it to the closest matching model name on the target platform. If no such match can be found, it can fallback onto a known existing model (e.g. `ai/mistral`).
40+
Defang supports model mapping through the [openai-access-gateway](https://github.com/DefangLabs/openai-access-gateway) on AWS and GCP. This takes a model with a [Docker naming convention](https://hub.docker.com/catalogs/models) (e.g. `ai/llama3.3`) and maps it to the closest matching model name on the target platform. If no such match can be found, it can fallback onto a known existing model (e.g. `ai/mistral`).
4141

4242
This can be configured through the following environment variables:
4343
* `USE_MODEL_MAPPING` (default to true) - configures whether or not model mapping should be enabled.

0 commit comments

Comments
 (0)