You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/language-service/conversational-language-understanding/how-to/use-containers.md
+24-27Lines changed: 24 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,12 +5,9 @@ description: Use Docker containers for the conversational language understanding
5
5
author: laujan
6
6
manager: nitinme
7
7
ms.service: azure-ai-language
8
-
ms.custom:
9
-
- ignite-2024
10
8
ms.topic: how-to
11
-
ms.date: 04/29/2025
9
+
ms.date: 07/17/2025
12
10
ms.author: lajanuar
13
-
keywords: on-premises, Docker, container
14
11
---
15
12
16
13
# Install and run Conversational Language Understanding (CLU) containers
@@ -26,7 +23,7 @@ If you don't have an Azure subscription, create a [free account](https://azure.m
26
23
27
24
You must meet the following prerequisites before using CLU containers.
28
25
29
-
* If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/cognitive-services/).
26
+
*An active Azure subscription. If you don't have one, create a [free account](https://azure.microsoft.com/free/cognitive-services/).
30
27
*[Docker](https://docs.docker.com/) installed on a host computer. Docker must be configured to allow the containers to connect with and send billing data to Azure.
31
28
* On Windows, Docker must also be configured to support Linux containers.
32
29
* You should have a basic understanding of [Docker concepts](https://docs.docker.com/get-started/overview/).
@@ -40,17 +37,17 @@ You must meet the following prerequisites before using CLU containers.
40
37
41
38
The following table describes the minimum and recommended specifications for the available container. Each CPU core must be at least 2.6 gigahertz (GHz) or faster.
42
39
43
-
It's recommended to have a CPU with AVX-512 instruction set, for the best experience (performance and accuracy).
40
+
We recommended that you have a CPU with AVX-512 instruction set, for the best experience (performance and accuracy).
CPU core and memory correspond to the `--cpus` and `--memory` settings, which are used as part of the `docker run` command.
50
47
51
48
## Export your Conversational Language Understanding model
52
49
53
-
Before you proceed with running the docker image, you need to export your own trained model to expose it to your container. Use the following command to extract your model and replace the placeholders below with your own values:
50
+
Before you proceed with running the docker image, you need to export your own trained model to expose it to your container. Use the following command to extract your model and replace the placeholders with your own values:
54
51
55
52
|Placeholder |Value|Format or example|
56
53
|------------|-----|-----------------|
@@ -75,7 +72,7 @@ The CLU container image can be found on the `mcr.microsoft.com` container regist
75
72
76
73
To use the latest version of the container, you can use the `latest` tag, which is for English. You can also find a full list of containers for supported languages using the [tags on the MCR](https://mcr.microsoft.com/product/azure-cognitive-services/language/clu/tags).
77
74
78
-
The latest CLU container is available in several languages. To download the container for the English container, use the command below.
75
+
The latest CLU container is available in several languages. To download the container for the English container, use the following command:
After creating the exported model in the section above, users have to run the container in order to download the deployment package that was created specifically for their exported models.
85
+
After the exported model is created, users have to run the container to download the deployment package that was created specifically for their exported models.
89
86
90
-
| Placeholder| Value|Format or example |
87
+
| Placeholder| Value|Format or example |
91
88
|---|---|---|
92
-
| **{API_KEY}**| The key for your Language resource. You can find it on your resource's **Key and endpoint** page, on the Azure portal. | xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx |
93
-
|**{ENDPOINT_URI}**| The endpoint for accessing the API. You can find it on your resource's **Key and endpoint** page, on the Azure portal. |`https://<your-custom-subdomain>.cognitiveservices.azure.com`|
94
-
|**{IMAGE_TAG}**| The image tag representing the language of the container you want to run. Make sure this matches the `docker pull` command you used. | latest|
95
-
|**{LOCAL_CLU_PORT}**| Port number assigned for the container in local machine.| 5000 |
89
+
|**{API_KEY}**| The key for your Language resource. You can find it on your resource's **Key and endpoint** page, on the Azure portal. |See Azure portal |
90
+
|**{ENDPOINT_URI}**| The endpoint for accessing the API. You can find it on your resource's **Key and endpoint** page, on the Azure portal. |`https://<your-custom-subdomain>.cognitiveservices.azure.com`|
91
+
|**{IMAGE_TAG}**| The image tag representing the language of the container you want to run. Make sure the tag matches the `docker pull` command you used. | latest|
92
+
|**{LOCAL_CLU_PORT}**| Port number assigned for the container in local machine.| 5000 |
96
93
|**{LOCAL_MODEL_DIRECTORY}**| Absolute directory in host machine where exported models are saved in. |`C:\usr\local\myDeploymentPackage`|
97
94
|**{PROJECT_NAME}**| Name of the project that the exported model belongs to | myProject |
98
95
|**{EXPORTED_MODEL_NAME}**| Exported model to be downloaded | myExportedModel |
DO NOT alter the downloaded files. Even altering the name or folder structure can affect the integrity of the container and might break it.
112
109
113
-
Repeat those steps to download as many models as you'd like to test. They can belong to different projects and have different exported model names.
110
+
Repeat those steps to download as many models as you'd like to test. Your models can belong to different projects and have different (exported) model names.
114
111
115
112
## Run the container with `docker run`
116
113
117
-
Once the container is on the host computer, use the [docker run](https://docs.docker.com/engine/reference/commandline/run/) command to run the containers. The container continues to run until you stop it. Replace the placeholders below with your own values:
114
+
Once the container is on the host computer, use the [docker run](https://docs.docker.com/engine/reference/commandline/run/) command to run the containers. The container continues to run until you stop it. Replace the placeholders with your own values:
118
115
119
116
120
117
> [!IMPORTANT]
121
-
> * The docker commands in the following sections use the back slash, `\`, as a line continuation character. Replace or remove this based on your host operating system's requirements.
122
-
> * The `Eula`, `Billing`, and `ApiKey` options must be specified to run the container; otherwise, the container won't start. For more information, see [Billing](#billing).
118
+
> * The docker commands in the following sections use the back slash, `\`, as a line continuation character. Replace or remove the back slash based on your host operating system's requirements.
119
+
> * The `Eula`, `Billing`, and `ApiKey` options must be specified to run the container; otherwise, the container doesn't start. For more information, see [Billing](#billing).
123
120
124
-
To run the CLU container, execute the following `docker run` command. Replace the placeholders below with your own values:
121
+
To run the CLU container, execute the following `docker run` command. Replace the placeholders with your own values:
125
122
126
123
| Placeholder | Value | Format or example |
127
124
|-------------|-------|---|
128
125
|**{API_KEY}**| The key for your Language resource. You can find it on your resource's **Key and endpoint** page, on the Azure portal. |`xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx`|
129
126
|**{ENDPOINT_URI}**| The endpoint for accessing the API. You can find it on your resource's **Key and endpoint** page, on the Azure portal. |`https://<your-custom-subdomain>.cognitiveservices.azure.com`|
130
-
|**{IMAGE_TAG}**| The image tag representing the language of the container you want to run. Make sure this matches the `docker pull` command you used. |`latest`|
127
+
|**{IMAGE_TAG}**| The image tag representing the language of the container you want to run. Make sure the tag matches the `docker pull` command you used. |`latest`|
131
128
|**{LOCAL_CLU_PORT}**|Port number assigned for the container in local machine. |5000 |
132
-
|**{LOCAL_NER_PORT}**|Port number of the NER container. See Run NER Container section below. |5001 (Has to be different that the above port number) |
129
+
|**{LOCAL_NER_PORT}**|Port number of the `NER` container. See Run `NER` Container section. |5001 (Has to be different than the port number) |
133
130
|**{LOCAL_LOGGING_DIRECTORY}**|Absolute directory in host machine where that logs are saved in. |`C:\usr\local\mylogs`|
134
131
|**{LOCAL_MODEL_DIRECTORY}**|Absolute directory in host machine where exported models are saved in. |`C:\usr\local\myDeploymentPackage`|
135
132
@@ -145,13 +142,13 @@ This command:
145
142
146
143
* Runs a *CLU* container from the container image
147
144
* Allocates one CPU core and 8 gigabytes (GB) of memory
148
-
* Exposes TCP port 5000 and allocates a pseudo-TTY for the container
145
+
* Exposes `TCP` port 5000 and allocates a pseudo-TTY for the container
149
146
* Automatically removes the container after it exits. The container image is still available on the host computer.
150
147
151
148
[!INCLUDE [Running multiple containers on the same host](../../../includes/cognitive-services-containers-run-multiple-same-host.md)]
152
149
153
-
## Running NER Container
154
-
CLU relies on NER to handle prebuilt entities. The CLU container works properly without NER if users decide not to integrate it. NER billing is disabled when it's used through CLU, no extra charges are generated unless a call is made directly to NER's container.
150
+
## Running named entity recognition (NER) Container
151
+
CLU relies on NER to handle prebuilt entities. The CLU container works properly without NER if users decide not to integrate it. NER billing is turned off when accessed via CLU, so there are no added charges unless you make a direct call to the NER container.
155
152
156
153
To set up NER in CLU container
157
154
- Follow the [NER container documentation](../../named-entity-recognition/how-to/use-containers.md).
@@ -179,7 +176,7 @@ For information on how to call CLU see [our guide](call-api.md).
179
176
180
177
## Troubleshooting
181
178
182
-
If you run the container with an output [mount](../../concepts/configure-containers.md#mount-settings) and logging enabled, the container generates log files that are helpful to troubleshoot issues that happen while starting or running the container.
179
+
If you run the container with both an output [mount](../../concepts/configure-containers.md#mount-settings) and logging enabled, the container generates log files. The log files can help you troubleshoot any issues that occur during startup or while the container is running.
183
180
184
181
[!INCLUDE [Azure AI services FAQ note](../../../containers/includes/cognitive-services-faq-note.md)]
185
182
@@ -201,7 +198,7 @@ In this article, you learned concepts and workflow for downloading, installing,
201
198
* You must specify billing information when instantiating a container.
202
199
203
200
> [!IMPORTANT]
204
-
> Azure AI containers aren't licensed to run without being connected to Azure for metering. Customers need to enable the containers to communicate billing information with the metering service at all times. Azure AI containers don't send customer data (for example, text that is being analyzed) to Microsoft.
201
+
> Azure AI containers aren't licensed to run without being connected to Azure for metering. Customers must enable containers to always communicate billing information to the metering service. Azure AI containers don't send customer data (for example, text that is being analyzed) to Microsoft.
0 commit comments