Skip to content

Commit eef075e

Browse files
committed
change llm model to nova micro
1 parent 61a4a2a commit eef075e

File tree

4 files changed

+4
-4
lines changed

4 files changed

+4
-4
lines changed

samples/managed-llm-provider/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ For this sample, you will need to provide the following [configuration](https://
4343
> Note that if you are using the 1-click deploy option, you can set these values as secrets in your GitHub repository and the action will automatically deploy them for you.
4444
4545
### `MODEL`
46-
The Model ID of the LLM you are using for your application. For example, `ai/claude3-haiku`.
46+
The Model ID of the LLM you are using for your application. For example, `ai/nova-micro`.
4747
```bash
4848
defang config set MODEL
4949
```

samples/managed-llm-provider/compose.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ services:
88
restart: always
99
environment:
1010
- ENDPOINT_URL=http://llm/api/v1/chat/completions # endpoint to the Provider Service
11-
- MODEL=ai/claude3-haiku # LLM model ID used in the Provider Service
11+
- MODEL=ai/nova-micro # LLM model ID used in the Provider Service
1212
healthcheck:
1313
test: ["CMD", "python3", "-c", "import sys, urllib.request; urllib.request.urlopen(sys.argv[1]).read()", "http://localhost:8000/"]
1414
interval: 30s

samples/managed-llm/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ For this sample, you will need to provide the following [configuration](https://
4646
> Note that if you are using the 1-click deploy option, you can set these values as secrets in your GitHub repository and the action will automatically deploy them for you.
4747
4848
### `MODEL`
49-
The Model ID of the LLM you are using for your application. For example, `ai/claude3-haiku`.
49+
The Model ID of the LLM you are using for your application. For example, `ai/nova-micro`.
5050
```bash
5151
defang config set MODEL
5252
```

samples/managed-llm/compose.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ services:
88
restart: always
99
environment:
1010
- ENDPOINT_URL=http://llm/api/v1/chat/completions # endpoint to the gateway service
11-
- MODEL=ai/claude3-haiku # LLM model ID used for the gateway
11+
- MODEL=ai/nova-micro # LLM model ID used for the gateway
1212
- OPENAI_API_KEY=FAKE_TOKEN # the actual value will be ignored when using the gateway, but it should match the one in the llm service
1313
healthcheck:
1414
test: ["CMD", "python3", "-c", "import sys, urllib.request; urllib.request.urlopen(sys.argv[1]).read()", "http://localhost:8000/"]

0 commit comments

Comments
 (0)