Skip to content

Commit 2dd4792

Browse files
aahillaahill
committed
updating language page
1 parent 3922037 commit 2dd4792

File tree

2 files changed

+74
-135
lines changed

2 files changed

+74
-135
lines changed

‎articles/cognitive-services/text-analytics/language-support.md

Lines changed: 73 additions & 42 deletions
Original file line numberDiff line numberDiff line change
@@ -20,61 +20,92 @@ ms.author: aahi
2020

2121
#### [Sentiment Analysis](#tab/sentiment-analysis)
2222

23-
| Language | Language code | Available starting with v3 model version: | Notes |
24-
|:----------------------|:-------------:|:------------------------------------:|-------------------:|
25-
| Chinese-Simplified | `zh-hans` | 10-01-2019 | `zh` also accepted |
26-
| Chinese-Traditional | `zh-hant` | 10-01-2019 | |
27-
| English | `en` | 10-01-2019 | |
28-
| French | `fr` | 10-01-2019 | |
29-
| German | `de` | 10-01-2019 | |
30-
| Italian | `it` | 10-01-2019 | |
31-
| Japanese | `ja` | 10-01-2019 | |
32-
| Korean | `ko` | 10-01-2019 | |
33-
| Portuguese (Portugal) | `pt-PT` | 10-01-2019 | `pt` also accepted |
34-
| Spanish | `es` | 10-01-2019 | |
35-
36-
### Opinion mining (preview)
37-
38-
| Language | Language code | Available starting with v3 model version: | Notes |
23+
| Language | Language code | v2 support | v3 support | Starting v3 model version: | Notes |
24+
|:----------------------|:-------------:|:----------:|:----------:|:--------------------------:|-------------------:|
25+
| Chinese-Simplified | `zh-hans` | ✓ | ✓ | 10-01-2019 | `zh` also accepted |
26+
| Chinese-Traditional | `zh-hant` | | ✓ | 10-01-2019 | |
27+
| Danish* | `da` | ✓ | | | |
28+
| Dutch | `nl` | ✓ | | | |
29+
| English | `en` | ✓ | ✓ | 10-01-2019 | |
30+
| Finnish | `fi` | ✓ | | | |
31+
| French | `fr` | ✓ | ✓ | 10-01-2019 | |
32+
| German | `de` | ✓ | ✓ | 10-01-2019 | |
33+
| Greek | `el` | ✓ | | | |
34+
| Italian | `it` | ✓ | ✓ | 10-01-2019 | |
35+
| Japanese | `ja` | ✓ | ✓ | 10-01-2019 | |
36+
| Korean | `ko` | | ✓ | 10-01-2019 | |
37+
| Norwegian (Bokmål) | `no` | ✓ | | | |
38+
| Polish | `pl` | ✓ | | | |
39+
| Portuguese (Portugal) | `pt-PT` | ✓ | ✓ | 10-01-2019 | `pt` also accepted |
40+
| Russian | `ru` | ✓ | | | |
41+
| Spanish | `es` | ✓ | ✓ | 10-01-2019 | |
42+
| Swedish | `sv` | ✓ | | | |
43+
| Turkish | `tr` | ✓ | | | |
44+
45+
### Opinion mining (v3.1-preview only)
46+
47+
| Language | Language code | Starting with v3 model version: | Notes |
3948
|:----------------------|:-------------:|:------------------------------------:|-------------------:|
4049
| English | `en` | 04-01-2020 | |
4150

4251

4352
#### [Named Entity Recognition (NER)](#tab/named-entity-recognition)
4453

4554
> [!NOTE]
46-
> Currently, [v3 entity categories](named-entity-types.md) are only returned on English text. The API returns [version 2.1](migration-guide.md?tabs=named-entity-recognition#ner-v21-entity-categories) results for requests in other languages, provided they are supported in version 2.1.
47-
48-
| Language | Language code | Available starting with v3 model version: | Notes |
49-
|:----------------------|:-------------:|:---------------------------------------:|:------------------:|
50-
| English | `en` | 10-01-2019 | |
55+
> Currently, [v3 entity categories](named-entity-types.md) are only returned on English text. If you call the NER v3 with a different langauge, The API will return [version 2.1](migration-guide.md?tabs=named-entity-recognition#ner-v21-entity-categories) results, provided the language is supported in version 2.1.
56+
57+
| Language | Language code | v2 support | v3 support | Starting with v3 model version: | Notes |
58+
|:-----------------------|:-------------:|:----------:|:----------:|:-------------------------------:|:------------------:|
59+
| Arabic* | `ar` | ✓ | | | |
60+
| Czech* | `cs` | ✓ | | | |
61+
| Chinese-Simplified | `zh-hans` | ✓ | | | `zh` also accepted |
62+
| Chinese-Traditional* | `zh-hant` | ✓ | | | |
63+
| Danish* | `da` | ✓ | | | |
64+
| Dutch* | `nl` | ✓ | | | |
65+
| English | `en` | ✓ | ✓ | 10-01-2019 | |
66+
| Finnish* | `fi` | ✓ | | | |
67+
| French | `fr` | ✓ | | | |
68+
| German | `de` | ✓ | | | |
69+
| Hebrew* | `he` | ✓ | | | |
70+
| Hungarian* | `hu` | ✓ | | | |
71+
| Italian* | `it` | ✓ | | | |
72+
| Japanese* | `ja` | ✓ | | | |
73+
| Korean* | `ko` | ✓ | | | |
74+
| Norwegian (Bokmål)* | `no` | ✓ | | | `nb` also accepted |
75+
| Polish* | `pl` | ✓ | | | |
76+
| Portuguese (Portugal)* | `pt-PT` | ✓ | | | `pt` also accepted |
77+
| Portuguese (Brazil)* | `pt-BR` | ✓ | | | |
78+
| Russian* | `ru` | ✓ | | | |
79+
| Spanish* | `es` | ✓ | | | |
80+
| Swedish* | `sv` | ✓ | | | |
81+
| Turkish* | `tr` | ✓ | | | |
5182

5283
#### [Key phrase extraction](#tab/key-phrase-extraction)
5384

54-
| Language | Language code | Available starting with v3 model version: | Notes |
55-
|:----------------------|:-------------:|:-----------------------------------------:|:------------------:|
56-
| Dutch | `nl` | 10-01-2019 | |
57-
| English | `en` | 10-01-2019 | |
58-
| Finnish | `fi` | 10-01-2019 | |
59-
| French | `fr` | 10-01-2019 | |
60-
| German | `de` | 10-01-2019 | |
61-
| Italian | `it` | 10-01-2019 | |
62-
| Japanese | `ja` | 10-01-2019 | |
63-
| Korean | `ko` | 10-01-2019 | |
64-
| Norwegian (Bokmål) | `no` | 10-01-2019 | `nb` also accepted |
65-
| Polish | `pl` | 10-01-2019 | |
66-
| Portuguese (Portugal) | `pt-PT` | 10-01-2019 | `pt` also accepted |
67-
| Portuguese (Brazil) | `pt-BR` | 10-01-2019 | |
68-
| Russian | `ru` | 10-01-2019 | |
69-
| Spanish | `es` | 10-01-2019 | |
70-
| Swedish | `sv` | 10-01-2019 | |
85+
| Language | Language code | v2 support | v3 support | Available starting with v3 model version: | Notes |
86+
|:----------------------|:-------------:|:----------:|:----------:|:-----------------------------------------:|:------------------:|
87+
| Dutch | `nl` | ✓ | ✓ | 10-01-2019 | |
88+
| English | `en` | ✓ | ✓ | 10-01-2019 | |
89+
| Finnish | `fi` | ✓ | ✓ | 10-01-2019 | |
90+
| French | `fr` | ✓ | ✓ | 10-01-2019 | |
91+
| German | `de` | ✓ | ✓ | 10-01-2019 | |
92+
| Italian | `it` | ✓ | ✓ | 10-01-2019 | |
93+
| Japanese | `ja` | ✓ | ✓ | 10-01-2019 | |
94+
| Korean | `ko` | ✓ | ✓ | 10-01-2019 | |
95+
| Norwegian (Bokmål) | `no` | ✓ | ✓ | 10-01-2019 | `nb` also accepted |
96+
| Polish | `pl` | ✓ | ✓ | 10-01-2019 | |
97+
| Portuguese (Portugal) | `pt-PT` | ✓ | ✓ | 10-01-2019 | `pt` also accepted |
98+
| Portuguese (Brazil) | `pt-BR` | ✓ | ✓ | 10-01-2019 | |
99+
| Russian | `ru` | ✓ | ✓ | 10-01-2019 | |
100+
| Spanish | `es` | ✓ | ✓ | 10-01-2019 | |
101+
| Swedish | `sv` | ✓ | ✓ | 10-01-2019 | |
71102

72103
#### [Entity linking](#tab/entity-linking)
73104

74-
| Language | Language code | Available starting with v3 model version: | Notes |
75-
|:----------------------|:-------------:|:-----------------------------------------:|:------------------:|
76-
| English | `en` | 10-01-2019 | |
77-
| Spanish | `es` | 10-01-2019 | |
105+
| Language | Language code | v2 support | v3 support | Available starting with v3 model version: | Notes |
106+
|:---------|:-------------:|:----------:|:----------:|:-----------------------------------------:|:-----:|
107+
| English | `en` | ✓ | ✓ | 10-01-2019 | |
108+
| Spanish | `es` | ✓ | ✓ | 10-01-2019 | |
78109

79110
#### [Language Detection](#tab/language-detection)
80111

‎articles/cognitive-services/text-analytics/migration-guide.md

Lines changed: 1 addition & 93 deletions
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ If your application uses the REST API, update its request endpoint to the v3 end
4343
> [!NOTE]
4444
> Currently, [v3 entity categories](named-entity-types.md) are only returned on English text. The API returns version 2.1 results for requests in other languages, provided they are supported in version 2.1.
4545
46-
In version 2.1, the Text Analytics API uses one endpoint for Named Entity Recognition (NER) and entity linking. Version 3 provides expanded named entity detection, and uses a separate endpoints for NER and entity linking requests. Starting in v3.1-preview.1, NER can additionally detect personal `pii` and health `phi` information.
46+
In version 2.1, the Text Analytics API uses one endpoint for Named Entity Recognition (NER) and entity linking. Version 3 provides expanded named entity detection, and uses separate endpoints for NER and entity linking requests. Starting in v3.1-preview.1, NER can additionally detect personal `pii` and health `phi` information.
4747

4848
## Steps to migrate
4949

@@ -133,98 +133,6 @@ If your application uses the REST API, update its request endpoint to the v3 end
133133

134134
---
135135

136-
## Version 2.1 language support
137-
138-
#### [Sentiment analysis](#tab/sentiment-analysis)
139-
140-
| Language | Language code | Notes |
141-
|:----------------------|:-------------:|:-------------------:|
142-
| Chinese-Simplified* | `zh-hans` | `zh` also accepted |
143-
| Danish* | `da` | |
144-
| Dutch | `nl` | |
145-
| English | `en` | |
146-
| Finnish* | `fi` | |
147-
| French* | `fr` | |
148-
| German* | `de` | |
149-
| Greek* | `el` | |
150-
| Italian* | `it` | |
151-
| Japanese* | `ja` | |
152-
| Norwegian (Bokmål)* | `no` | `nb` also accepted |
153-
| Polish* | `pl` | |
154-
| Portuguese (Portugal)* | `pt-PT` | `pt` also accepted |
155-
| Russian* | `ru` | |
156-
| Spanish* | `es` | |
157-
| Swedish* | `sv` | |
158-
| Turkish* | `tr` | |
159-
160-
\* Language is available in v2 as a public preview.
161-
162-
#### [NER and entity linking](#tab/named-entity-recognition)
163-
164-
| Language | Language code | Notes |
165-
|:----------------------|:-------------:|:------------------:|
166-
| Arabic* | `ar` | |
167-
| Czech* | `cs` | |
168-
| Chinese-Simplified | `zh-hans` | `zh` also accepted |
169-
| Chinese-Traditional* | `zh-hant` | |
170-
| Danish* | `da` | |
171-
| Dutch* | `nl` | |
172-
| English | `en` | |
173-
| Finnish* | `fi` | |
174-
| French | `fr` | |
175-
| German | `de` | |
176-
| Hebrew* | `he` | |
177-
| Hungarian* | `hu` | |
178-
| Italian* | `it` | |
179-
| Japanese* | `ja` | |
180-
| Korean* | `ko` | |
181-
| Norwegian (Bokmål)* | `no` | `nb` also accepted |
182-
| Polish* | `pl` | |
183-
| Portuguese (Portugal)* | `pt-PT` | `pt` also accepted |
184-
| Portuguese (Brazil)* | `pt-BR` | |
185-
| Russian* | `ru` | |
186-
| Spanish* | `es` | |
187-
| Swedish* | `sv` | |
188-
| Turkish* | `tr` | |
189-
190-
\* Language is available in v2 as a public preview.
191-
192-
### Entity linking v2 language support
193-
194-
| Language | Language code | Notes |
195-
|:----------------------|:-------------:|:------------------:|
196-
| English | `en` | |
197-
| Spanish | `es` | |
198-
199-
#### [Language detection](#tab/language-detection)
200-
201-
The Text Analytics API can detect a wide range of languages, variants, dialects, and some regional/cultural languages. Language Detection returns the "script" of a language. For instance, for the phrase "I have a dog" it will return `en` instead of `en-US`. The only special case is Chinese, where the language detection capability will return `zh_CHS` or `zh_CHT` if it can determine the script given the text provided. In situations where a specific script cannot be identified for a Chinese document, it will return simply `zh`.
202-
203-
We don't publish the exact list of languages for this feature, but it can detect a wide range of languages, variants, dialects, and some regional/cultural languages.
204-
205-
If you have content expressed in a less frequently used language, you can try Language Detection to see if it returns a code. The response for languages that cannot be detected is "unknown".
206-
207-
#### [Key phrase extraction](#tab/key-phrase-extraction)
208-
209-
| Language | Language code | Notes |
210-
|:----------------------|:-------------:|:------------------:|
211-
| Dutch | `nl` | |
212-
| English | `en` | |
213-
| Finnish | `fi` | |
214-
| French | `fr` | |
215-
| German | `de` | |
216-
| Italian | `it` | |
217-
| Japanese | `ja` | |
218-
| Korean | `ko` | |
219-
| Norwegian (Bokmål) | `no` | `nb` also accepted |
220-
| Polish | `pl` | |
221-
| Portuguese (Portugal) | `pt-PT` | `pt` also accepted |
222-
| Portuguese (Brazil) | `pt-BR` | |
223-
| Russian | `ru` | |
224-
| Spanish | `es` | |
225-
| Swedish | `sv` | |
226-
227-
---
228136

229137
## See also
230138

0 commit comments

Comments
 (0)