Skip to content

Commit 82ca16b

Browse files
authored
Merge branch 'MicrosoftDocs:main' into dynamics-tables
2 parents 76858f5 + 0a8f8ee commit 82ca16b

File tree

216 files changed

+2146
-1979
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

216 files changed

+2146
-1979
lines changed

.openpublishing.redirection.defender-for-cloud.json

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -920,6 +920,11 @@
920920
"redirect_url": "/azure/defender-for-cloud/multicloud",
921921
"redirect_document_id": false
922922
},
923+
{
924+
"source_path_from_root": "/articles/defender-for-cloud/defender-for-containers-vulnerability-assessment-elastic.md",
925+
"redirect_url": "/azure/defender-for-cloud/agentless-vulnerability-assessment-aws",
926+
"redirect_document_id": true
927+
},
923928
{
924929
"source_path_from_root": "/articles/defender-for-cloud/how-to-migrate-to-built-in.md",
925930
"redirect_url": "/azure/defender-for-cloud/how-to-transition-to-built-in",

articles/ai-services/content-safety/includes/quickstarts/csharp-quickstart-image.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ ms.date: 07/04/2023
1111
ms.author: pafarley
1212
---
1313

14-
[Reference documentation](/dotnet/api/overview/azure/ai.contentsafety-readme?view=azure-dotnet) | [Library source code](https://github.com/Azure/azure-sdk-for-net/tree/main/sdk/contentsafety/Azure.AI.ContentSafety) | [Package (NuGet)](https://www.nuget.org/packages/Azure.AI.ContentSafety) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/dotnet/1.0.0)
14+
[Reference documentation](/dotnet/api/overview/azure/ai.contentsafety-readme) | [Library source code](https://github.com/Azure/azure-sdk-for-net/tree/main/sdk/contentsafety/Azure.AI.ContentSafety) | [Package (NuGet)](https://www.nuget.org/packages/Azure.AI.ContentSafety) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/dotnet/1.0.0)
1515

1616
## Prerequisites
1717

articles/ai-services/content-safety/includes/quickstarts/csharp-quickstart-text.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ ms.date: 07/04/2023
1111
ms.author: pafarley
1212
---
1313

14-
[Reference documentation](/dotnet/api/overview/azure/ai.contentsafety-readme?view=azure-dotnet) | [Library source code](https://github.com/Azure/azure-sdk-for-net/tree/main/sdk/contentsafety/Azure.AI.ContentSafety) | [Package (NuGet)](https://www.nuget.org/packages/Azure.AI.ContentSafety) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/dotnet/1.0.0)
14+
[Reference documentation](/dotnet/api/overview/azure/ai.contentsafety-readme) | [Library source code](https://github.com/Azure/azure-sdk-for-net/tree/main/sdk/contentsafety/Azure.AI.ContentSafety) | [Package (NuGet)](https://www.nuget.org/packages/Azure.AI.ContentSafety) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/dotnet/1.0.0)
1515

1616
## Prerequisites
1717

articles/ai-services/content-safety/includes/quickstarts/python-quickstart-image.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ ms.author: pafarley
1919
* An Azure subscription - [Create one for free](https://azure.microsoft.com/free/cognitive-services/)
2020
* Once you have your Azure subscription, <a href="https://aka.ms/acs-create" title="Create a Content Safety resource" target="_blank">create a Content Safety resource </a> in the Azure portal to get your key and endpoint. Enter a unique name for your resource, select the subscription you entered on the application form, select a resource group, supported region, and supported pricing tier. Then select **Create**.
2121
* The resource takes a few minutes to deploy. After it finishes, Select **go to resource**. In the left pane, under **Resource Management**, select **Subscription Key and Endpoint**. The endpoint and either of the keys are used to call APIs.
22-
* [Python 3.7 or later](https://www.python.org/)
22+
* [Python 3.8 or later](https://www.python.org/)
2323
* Your Python installation should include [pip](https://pip.pypa.io/en/stable/). You can check if you have pip installed by running `pip --version` on the command line. Get pip by installing the latest version of Python.
2424

2525
[!INCLUDE [Create environment variables](../env-vars.md)]

articles/ai-services/content-safety/whats-new.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -22,9 +22,9 @@ Learn what's new in the service. These items might be release notes, videos, blo
2222

2323
The Azure AI Content Safety service is now generally available through the following client library SDKs:
2424

25-
- **C#**: [Package](https://www.nuget.org/packages/Azure.AI.ContentSafety) | [API reference](/dotnet/api/overview/azure/ai.contentsafety-readme?view=azure-dotnet) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/dotnet/1.0.0) | Quickstarts: [Text](./quickstart-text.md), [Image](./quickstart-image.md)
26-
- **Python**: [Package](https://pypi.org/project/azure-ai-contentsafety/) | [API reference](/python/api/overview/azure/ai-contentsafety-readme?view=azure-python) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/python/1.0.0) | Quickstarts: [Text](./quickstart-text.md), [Image](./quickstart-image.md)
27-
- **Java**: [Package](https://oss.sonatype.org/#nexus-search;quick~contentsafety) | [API reference](/java/api/overview/azure/ai-contentsafety-readme?view=azure-java-stable) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/java/1.0.0) | Quickstarts: [Text](./quickstart-text.md), [Image](./quickstart-image.md)
25+
- **C#**: [Package](https://www.nuget.org/packages/Azure.AI.ContentSafety) | [API reference](/dotnet/api/overview/azure/ai.contentsafety-readme) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/dotnet/1.0.0) | Quickstarts: [Text](./quickstart-text.md), [Image](./quickstart-image.md)
26+
- **Python**: [Package](https://pypi.org/project/azure-ai-contentsafety/) | [API reference](/python/api/overview/azure/ai-contentsafety-readme) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/python/1.0.0) | Quickstarts: [Text](./quickstart-text.md), [Image](./quickstart-image.md)
27+
- **Java**: [Package](https://oss.sonatype.org/#nexus-search;quick~contentsafety) | [API reference](/java/api/overview/azure/ai-contentsafety-readme) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/java/1.0.0) | Quickstarts: [Text](./quickstart-text.md), [Image](./quickstart-image.md)
2828
- **JavaScript**: [Package](https://www.npmjs.com/package/@azure-rest/ai-content-safety?activeTab=readme) | [API reference](https://www.npmjs.com/package/@azure-rest/ai-content-safety/v/1.0.0) | [Samples](https://github.com/Azure-Samples/AzureAIContentSafety/tree/main/js/1.0.0) | Quickstarts: [Text](./quickstart-text.md), [Image](./quickstart-image.md)
2929

3030
> [!IMPORTANT]

articles/ai-services/language-service/language-detection/how-to/call-api.md

Lines changed: 108 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ author: jboback
77
manager: nitinme
88
ms.service: azure-ai-language
99
ms.topic: how-to
10-
ms.date: 12/19/2023
10+
ms.date: 01/16/2024
1111
ms.author: jboback
1212
ms.custom: language-service-language-detection
1313
---
@@ -50,14 +50,19 @@ Analysis is performed upon receipt of the request. Using the language detection
5050

5151
When you get results from language detection, you can stream the results to an application or save the output to a file on the local system.
5252

53-
Language detection will return one predominant language for each document you submit, along with it's [ISO 639-1](https://www.iso.org/standard/22109.html) name, a human-readable name, and a confidence score. A positive score of 1 indicates the highest possible confidence level of the analysis.
53+
Language detection will return one predominant language for each document you submit, along with it's [ISO 639-1](https://www.iso.org/standard/22109.html) name, a human-readable name, a confidence score, script name and script code according to the [ISO 15924 standard](https://wikipedia.org/wiki/ISO_15924). A positive score of 1 indicates the highest possible confidence level of the analysis.
54+
5455

5556
### Ambiguous content
5657

5758
In some cases it may be hard to disambiguate languages based on the input. You can use the `countryHint` parameter to specify an [ISO 3166-1 alpha-2](https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2) country/region code. By default the API uses "US" as the default country hint. To remove this behavior, you can reset this parameter by setting this value to empty string `countryHint = ""` .
5859

5960
For example, "communication" is common to both English and French and if given with limited context the response will be based on the "US" country/region hint. If the origin of the text is known to be coming from France that can be given as a hint.
6061

62+
> [!NOTE]
63+
> Ambiguous content can cause confidence scores to be lower.
64+
> The `countryHint` in the response is only applicable if the confidence score is less than 0.8.
65+
6166
**Input**
6267

6368
```json
@@ -76,7 +81,8 @@ For example, "communication" is common to both English and French and if given w
7681
}
7782
```
7883

79-
The language detection model now has additional context to make a better judgment:
84+
With the second document, the language detection model has additional context to make a better judgment because it contains the `countryHint` property in the input above. This will return the following output.
85+
8086

8187
**Output**
8288

@@ -129,7 +135,7 @@ If the analyzer can't parse the input, it returns `(Unknown)`. An example is if
129135
}
130136
],
131137
"errors": [],
132-
"modelVersion": "2021-01-05"
138+
"modelVersion": "2023-12-01"
133139
}
134140
```
135141

@@ -156,22 +162,107 @@ The resulting output consists of the predominant language, with a score of less
156162

157163
```json
158164
{
159-
"documents": [
160-
{
161-
"id": "1",
162-
"detectedLanguage": {
163-
"name": "Spanish",
164-
"iso6391Name": "es",
165-
"confidenceScore": 0.88
166-
},
167-
"warnings": []
168-
}
169-
],
170-
"errors": [],
171-
"modelVersion": "2021-01-05"
165+
"kind": "LanguageDetectionResults",
166+
"results": {
167+
"documents": [
168+
{
169+
"id": "1",
170+
"detectedLanguage": {
171+
"name": "Spanish",
172+
"iso6391Name": "es",
173+
"confidenceScore": 0.97,
174+
"script": "Latin",
175+
"scriptCode": "Latn"
176+
},
177+
"warnings": []
178+
}
179+
],
180+
"errors": [],
181+
"modelVersion": "2023-12-01"
182+
}
183+
}
184+
```
185+
186+
## Script name and script code
187+
188+
> [!NOTE]
189+
> * Script detection is currently limited to [select languages](../language-support.md#script-detection).
190+
> * The script detection is only available for textual input which is greater than 12 characters in length.
191+
192+
Language detection offers the ability to detect more than one script per language according to the [ISO 15924 standard](https://wikipedia.org/wiki/ISO_15924). Specifically, Language Detection returns two script-related properties:
193+
194+
* `script`: The human-readable name of the identified script
195+
* `scriptCode`: The ISO 15924 code for the identified script
196+
197+
The output of the API includes the value of the `scriptCode` property for documents that are at least 12 characters or greater in length and matches the list of supported languages and scripts. Script detection is designed to benefit users whose language can be transliterated or written in more than one script, such as Kazakh or Hindi language.
198+
199+
Previously, language detection was designed to detect the language of documents in a wide variety of languages, dialects, and regional variants, but was limited by "Romanization". Romanization refers to conversion of text from one writing system to the Roman (Latin) script, and is necessary to detect many Indo-European languages. However, there are other languages which are written in multiple scripts, such as Kazakh, which can be written in Cyrillic, Perso-Arabic, and Latin scripts. There are also other cases in which users may either choose or are required to transliterate their language in more than one script, such as Hindi transliterated in Latin script, due to the limited availability of keyboards which support its Devanagari script.
200+
201+
Consequently, language detection's expanded support for script detection behaves as follows:
202+
203+
**Input**
204+
205+
```json
206+
{
207+
    "kind": "LanguageDetection",
208+
    "parameters": {
209+
        "modelVersion": "latest"
210+
    },
211+
    "analysisInput": {
212+
        "documents": [
213+
            {
214+
                "id": "1",
215+
                "text": "आप कहाँ जा रहे हैं?"
216+
            },
217+
            {
218+
                "id": "2",
219+
                "text": "Туған жерім менің - Қазақстаным"
220+
            }
221+
        ]
222+
    }
223+
}
224+
```
225+
226+
**Output**
227+
228+
The resulting output consists of the predominant language, along with a script name, script code, and confidence score.
229+
230+
```json
231+
{
232+
    "kind": "LanguageDetectionResults",
233+
    "results": {
234+
        "documents": [
235+
            {
236+
                "id": "1",
237+
                "detectedLanguage": {
238+
                    "name": "Hindi",
239+
                    "iso6391Name": "hi",
240+
                    "confidenceScore": 1.0,
241+
                    "script": "Devanagari",
242+
                    "scriptCode": "Deva"
243+
                },
244+
                "warnings": []
245+
            },
246+
            {
247+
                "id": "2",
248+
                "detectedLanguage": {
249+
                    "name": "Kazakh",
250+
                    "iso6391Name": "kk",
251+
                    "confidenceScore": 1.0,
252+
                    "script": "Cyrillic",
253+
  "scriptCode": "Cyrl"
254+
                },
255+
                "warnings": []
256+
            }
257+
        ],
258+
        "errors": [],
259+
        "modelVersion": "2023-12-01"
260+
    }
172261
}
173262
```
174263

264+
265+
175266
## Service and data limits
176267

177268
[!INCLUDE [service limits article](../../includes/service-limits-link.md)]

articles/ai-services/language-service/language-detection/how-to/use-containers.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ author: jboback
77
manager: nitinme
88
ms.service: azure-ai-language
99
ms.topic: how-to
10-
ms.date: 12/19/2023
10+
ms.date: 02/12/2024
1111
ms.author: jboback
1212
ms.custom: language-service-language-detection
1313
keywords: on-premises, Docker, container
@@ -35,7 +35,7 @@ The following table describes the minimum and recommended specifications for the
3535

3636
| | Minimum host specs | Recommended host specs | Minimum TPS | Maximum TPS|
3737
|---|---------|-------------|--|--|
38-
| **Language detection** | 1 core, 2GB memory | 1 core, 4GB memory |15 | 30|
38+
| **Language detection** | 1 core, 5GB memory | 1 core, 8GB memory |15 | 30|
3939

4040
CPU core and memory correspond to the `--cpus` and `--memory` settings, which are used as part of the `docker run` command.
4141

articles/ai-services/language-service/language-detection/includes/quickstarts/rest-api.md

Lines changed: 21 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.author: jboback
1010

1111
[Reference documentation](https://go.microsoft.com/fwlink/?linkid=2239169)
1212

13-
Use this quickstart to send language detection requests using the REST API. In the following example, you will use cURL to identify the language that a text sample was written in.
13+
Use this quickstart to send language detection requests using the REST API. In the following example, you'll use cURL to identify the language that a text sample was written in.
1414

1515
[!INCLUDE [Use Language Studio](../../../includes/use-language-studio.md)]
1616

@@ -20,7 +20,7 @@ Use this quickstart to send language detection requests using the REST API. In t
2020
* Azure subscription - [Create one for free](https://azure.microsoft.com/free/cognitive-services)
2121
* The current version of [cURL](https://curl.haxx.se/).
2222
* Once you have your Azure subscription, <a href="https://portal.azure.com/#create/Microsoft.CognitiveServicesTextAnalytics" title="Create a Language resource" target="_blank">create a Language resource </a> in the Azure portal to get your key and endpoint. After it deploys, select **Go to resource**.
23-
* You will need the key and endpoint from the resource you create to connect your application to the API. You'll paste your key and endpoint into the code below later in the quickstart.
23+
* You'll need the key and endpoint from the resource you create to connect your application to the API. You'll paste your key and endpoint into the code below later in the quickstart.
2424
* You can use the free pricing tier (`Free F0`) to try the service, and upgrade later to a paid tier for production.
2525

2626
> [!NOTE]
@@ -47,7 +47,7 @@ The following cURL commands are executed from a BASH shell. Edit these commands
4747
[!INCLUDE [REST API quickstart instructions](../../../includes/rest-api-instructions.md)]
4848

4949
```bash
50-
curl -i -X POST https://<your-language-resource-endpoint>/language/:analyze-text?api-version=2022-05-01 \
50+
curl -i -X POST https://<your-language-resource-endpoint>/language/:analyze-text?api-version=2023-11-15-preview \
5151
-H "Content-Type: application/json" \
5252
-H "Ocp-Apim-Subscription-Key:<your-language-resource-key>" \
5353
-d \
@@ -76,19 +76,23 @@ curl -i -X POST https://<your-language-resource-endpoint>/language/:analyze-text
7676

7777
```json
7878
{
79-
"kind": "LanguageDetectionResults",
80-
"results": {
81-
"documents": [{
82-
"id": "1",
83-
"detectedLanguage": {
84-
"name": "English",
85-
"iso6391Name": "en",
86-
"confidenceScore": 1.0
87-
},
88-
"warnings": []
89-
}],
90-
"errors": [],
91-
"modelVersion": "2022-10-01"
92-
}
79+
"kind": "LanguageDetectionResults",
80+
"results": {
81+
"documents": [
82+
{
83+
"id": "1",
84+
"detectedLanguage": {
85+
"name": "English",
86+
"iso6391Name": "en",
87+
"confidenceScore": 1.0,
88+
"script": "Latin",
89+
"scriptCode": "Latn"
90+
},
91+
"warnings": []
92+
}
93+
],
94+
"errors": [],
95+
"modelVersion": "2023-12-01"
96+
}
9397
}
9498
```

articles/ai-services/language-service/language-detection/language-support.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -162,6 +162,26 @@ If you have content expressed in a less frequently used language, you can try La
162162
| Telugu | `te` |
163163
| Urdu | `ur` |
164164

165+
## Script detection
166+
167+
| Language |Script code | Scripts |
168+
| --- | --- | --- |
169+
| Bengali (Bengali-Assamese) | `as` | `Latn`, `Beng` |
170+
| Bengali (Bangla) | `bn` | `Latn`, `Beng` |
171+
| Gujarati | `gu` | `Latn`, `Gujr` |
172+
| Hindi | `hi` | `Latn`, `Deva` |
173+
| Kannada | `kn` | `Latn`, `Knda` |
174+
| Malayalam | `ml` | `Latn`, `Mlym` |
175+
| Marathi | `mr` | `Latn`, `Deva` |
176+
| Oriya | `or` | `Latn`, `Orya` |
177+
| Gurmukhi | `pa` | `Latn`, `Guru` |
178+
| Tamil | `ta` | `Latn`, `Taml` |
179+
| Telugu | `te` | `Latn`, `Telu` |
180+
| Arabic | `ur` | `Latn`, `Arab` |
181+
| Cyrillic | `tt` | `Latn`, `Cyrl` |
182+
| Serbian `sr` | `Latn`, `Cyrl` |
183+
| Unified Canadian Aboriginal Syllabics | `iu` | `Latn`, `Cans` |
184+
165185
## Next steps
166186

167187
[Language detection overview](overview.md)

0 commit comments

Comments
 (0)