Skip to content

Commit 92dc866

Browse files
denreadenrea
authored
Merge pull request #191602 from aahill/ct-lang
Language table updates
2 parents c44e409 + c7e2f87 commit 92dc866

File tree

3 files changed

+289
-38
lines changed

3 files changed

+289
-38
lines changed

‎articles/cognitive-services/language-service/conversational-language-understanding/language-support.md

Lines changed: 97 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ manager: nitinme
88
ms.service: cognitive-services
99
ms.subservice: language-service
1010
ms.topic: conceptual
11-
ms.date: 11/02/2021
11+
ms.date: 03/14/2022
1212
ms.author: aahi
1313
ms.custom: language-service-clu, ignite-fall-2021
1414
---
@@ -23,24 +23,103 @@ When creating a conversation project in CLU, you can specify the primary languag
2323

2424
The supported languages for conversation projects are:
2525

26-
| **Language** | **Language Code** |
26+
| Language | Language code |
2727
| --- | --- |
28-
| Brazilian Portuguese | `pt-br` |
29-
| Chinese | `zh-cn` |
30-
| Dutch | `nl-nl` |
31-
| English | `en-us` |
32-
| French | `fr-fr` |
33-
| German | `de-de` |
34-
| Gujarati | `gu-in` |
35-
| Hindi | `hi-in` |
36-
| Italian | `it-it` |
37-
| Japanese | `ja-jp` |
38-
| Korean | `ko-kr` |
39-
| Marathi | `mr-in` |
40-
| Spanish | `es-es` |
41-
| Tamil | `ta-in` |
42-
| Telugu | `te-in` |
43-
| Turkish | `tr-tr` |
28+
| Afrikaans | `af` |
29+
| Amharic | `am` |
30+
| Arabic | `ar` |
31+
| Assamese | `as` |
32+
| Azerbaijani | `az` |
33+
| Belarusian | `be` |
34+
| Bulgarian | `bg` |
35+
| Bengali | `bn` |
36+
| Breton | `br` |
37+
| Bosnian | `bs` |
38+
| Catalan | `ca` |
39+
| Czech | `cs` |
40+
| Welsh | `cy` |
41+
| Danish | `da` |
42+
| German | `de`
43+
| Greek | `el` |
44+
| English (US) | `en-us` |
45+
| English (Uk) | `en-gb` |
46+
| Esperanto | `eo` |
47+
| Spanish | `es` |
48+
| Estonian | `et` |
49+
| Basque | `eu` |
50+
| Persian (Farsi) | `fa` |
51+
| Finnish | `fi` |
52+
| French | `fr` |
53+
| Western Frisian | `fy` |
54+
| Irish | `ga` |
55+
| Scottish Gaelic | `gd` |
56+
| Galician | `gl` |
57+
| Gujarati | `gu` |
58+
| Hausa | `ha` |
59+
| Hebrew | `he` |
60+
| Hindi | `hi` |
61+
| Croatian | `hr` |
62+
| Hungarian | `hu` |
63+
| Armenian | `hy` |
64+
| Indonesian | `id` |
65+
| Italian | `it` |
66+
| Japanese | `ja` |
67+
| Javanese | `jv` |
68+
| Georgian | `ka` |
69+
| Kazakh | `kk` |
70+
| Khmer | `km` |
71+
| Kannada | `kn` |
72+
| Korean | `ko` |
73+
| Kurdish (Kurmanji) | `ku` |
74+
| Kyrgyz | `ky` |
75+
| Latin | `la` |
76+
| Lao | `lo` |
77+
| Lithuanian | `lt` |
78+
| Latvian | `lv` |
79+
| Malagasy | `mg` |
80+
| Macedonian | `mk` |
81+
| Malayalam | `ml` |
82+
| Mongolian | `mn` |
83+
| Marathi | `mr` |
84+
| Malay | `ms` |
85+
| Burmese | `my` |
86+
| Nepali | `ne` |
87+
| Dutch | `nl` |
88+
| Norwegian (Bokmal) | `nb` |
89+
| Oriya | `or` |
90+
| Punjabi | `pa` |
91+
| Polish | `pl` |
92+
| Pashto | `ps` |
93+
| Portuguese (Brazil) | `pt-br` |
94+
| Portuguese (Portugal) | `pt-pt` |
95+
| Romanian | `ro` |
96+
| Russian | `ru` |
97+
| Sanskrit | `sa` |
98+
| Sindhi | `sd` |
99+
| Sinhala | `si` |
100+
| Slovak | `sk` |
101+
| Slovenian | `sl` |
102+
| Somali | `so` |
103+
| Albanian | `sq` |
104+
| Serbian | `sr` |
105+
| Sundanese | `su` |
106+
| Swedish | `sv` |
107+
| Swahili | `sw` |
108+
| Tamil | `ta` |
109+
| Telugu | `te` |
110+
| Thai | `th` |
111+
| Filipino | `tl` |
112+
| Turkish | `tr` |
113+
| Uyghur | `ug` |
114+
| Ukrainian | `uk` |
115+
| Urdu | `ur` |
116+
| Uzbek | `uz` |
117+
| Vietnamese | `vi` |
118+
| Xhosa | `xh` |
119+
| Yiddish | `yi` |
120+
| Chinese (Simplified) | `zh-hans` |
121+
| Chinese (Traditional) | `zh-hant` |
122+
| Zulu | `zu` |
44123

45124
#### Multilingual conversation projects
46125

‎articles/cognitive-services/language-service/custom-classification/language-support.md

Lines changed: 96 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ manager: nitinme
88
ms.service: cognitive-services
99
ms.subservice: language-service
1010
ms.topic: overview
11-
ms.date: 11/02/2021
11+
ms.date: 03/14/2022
1212
ms.author: aahi
1313
ms.custom: language-service-custom-classification, ignite-fall-2021
1414
---
@@ -28,15 +28,101 @@ With custom text classification, you can train a model in one language and test
2828

2929
Custom text classification supports `.txt` files in the following languages:
3030

31-
| Language | Locale |
32-
|--|--|
33-
| English (United States) |`en-US` |
34-
| French (France) |`fr-FR` |
35-
| German |`de-DE` |
36-
| Italian |`it-IT` |
37-
| Spanish (Spain) |`es-ES` |
38-
| Portuguese (Portugal) | `pt-PT` |
39-
| Portuguese (Brazil) | `pt-BR` |
31+
| Language | Language Code |
32+
| --- | --- |
33+
| Afrikaans | `af` |
34+
| Amharic | `am` |
35+
| Arabic | `ar` |
36+
| Assamese | `as` |
37+
| Azerbaijani | `az` |
38+
| Belarusian | `be` |
39+
| Bulgarian | `bg` |
40+
| Bengali | `bn` |
41+
| Breton | `br` |
42+
| Bosnian | `bs` |
43+
| Catalan | `ca` |
44+
| Czech | `cs` |
45+
| Welsh | `cy` |
46+
| Danish | `da` |
47+
| German | `de`
48+
| Greek | `el` |
49+
| English (US) | `en-us` |
50+
| Esperanto | `eo` |
51+
| Spanish | `es` |
52+
| Estonian | `et` |
53+
| Basque | `eu` |
54+
| Persian (Farsi) | `fa` |
55+
| Finnish | `fi` |
56+
| French | `fr` |
57+
| Western Frisian | `fy` |
58+
| Irish | `ga` |
59+
| Scottish Gaelic | `gd` |
60+
| Galician | `gl` |
61+
| Gujarati | `gu` |
62+
| Hausa | `ha` |
63+
| Hebrew | `he` |
64+
| Hindi | `hi` |
65+
| Croatian | `hr` |
66+
| Hungarian | `hu` |
67+
| Armenian | `hy` |
68+
| Indonesian | `id` |
69+
| Italian | `it` |
70+
| Japanese | `ja` |
71+
| Javanese | `jv` |
72+
| Georgian | `ka` |
73+
| Kazakh | `kk` |
74+
| Khmer | `km` |
75+
| Kannada | `kn` |
76+
| Korean | `ko` |
77+
| Kurdish (Kurmanji) | `ku` |
78+
| Kyrgyz | `ky` |
79+
| Latin | `la` |
80+
| Lao | `lo` |
81+
| Lithuanian | `lt` |
82+
| Latvian | `lv` |
83+
| Malagasy | `mg` |
84+
| Macedonian | `mk` |
85+
| Malayalam | `ml` |
86+
| Mongolian | `mn` |
87+
| Marathi | `mr` |
88+
| Malay | `ms` |
89+
| Burmese | `my` |
90+
| Nepali | `ne` |
91+
| Dutch | `nl` |
92+
| Norwegian (Bokmal) | `nb` |
93+
| Oriya | `or` |
94+
| Punjabi | `pa` |
95+
| Polish | `pl` |
96+
| Pashto | `ps` |
97+
| Portuguese (Brazil) | `pt-br` |
98+
| Portuguese (Portugal) | `pt-pt` |
99+
| Romanian | `ro` |
100+
| Russian | `ru` |
101+
| Sanskrit | `sa` |
102+
| Sindhi | `sd` |
103+
| Sinhala | `si` |
104+
| Slovak | `sk` |
105+
| Slovenian | `sl` |
106+
| Somali | `so` |
107+
| Albanian | `sq` |
108+
| Serbian | `sr` |
109+
| Sundanese | `su` |
110+
| Swedish | `sv` |
111+
| Swahili | `sw` |
112+
| Tamil | `ta` |
113+
| Telugu | `te` |
114+
| Thai | `th` |
115+
| Filipino | `tl` |
116+
| Turkish | `tr` |
117+
| Uyghur | `ug` |
118+
| Ukrainian | `uk` |
119+
| Urdu | `ur` |
120+
| Uzbek | `uz` |
121+
| Vietnamese | `vi` |
122+
| Xhosa | `xh` |
123+
| Yiddish | `yi` |
124+
| Chinese (Simplified) | `zh-hans` |
125+
| Zulu | `zu` |
40126

41127
## Next steps
42128

‎articles/cognitive-services/language-service/custom-named-entity-recognition/language-support.md

Lines changed: 96 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ manager: nitinme
88
ms.service: cognitive-services
99
ms.subservice: language-service
1010
ms.topic: conceptual
11-
ms.date: 11/02/2021
11+
ms.date: 03/14/2022
1212
ms.custom: references_regions, language-service-custom-ner, ignite-fall-2021
1313
ms.author: aahi
1414
---
@@ -28,15 +28,101 @@ With custom NER, you can train a model in one language and test in another langu
2828

2929
Custom NER supports `.txt` files in the following languages:
3030

31-
| Language | Locale |
32-
|--|--|
33-
| English (United States) |`en-US` |
34-
| French (France) |`fr-FR` |
35-
| German |`de-DE` |
36-
| Italian |`it-IT` |
37-
| Spanish (Spain) |`es-ES` |
38-
| Portuguese (Portugal) | `pt-PT` |
39-
| Portuguese (Brazil) | `pt-BR` |
31+
| Language | Language code |
32+
| --- | --- |
33+
| Afrikaans | `af` |
34+
| Amharic | `am` |
35+
| Arabic | `ar` |
36+
| Assamese | `as` |
37+
| Azerbaijani | `az` |
38+
| Belarusian | `be` |
39+
| Bulgarian | `bg` |
40+
| Bengali | `bn` |
41+
| Breton | `br` |
42+
| Bosnian | `bs` |
43+
| Catalan | `ca` |
44+
| Czech | `cs` |
45+
| Welsh | `cy` |
46+
| Danish | `da` |
47+
| German | `de`
48+
| Greek | `el` |
49+
| English (US) | `en-us` |
50+
| Esperanto | `eo` |
51+
| Spanish | `es` |
52+
| Estonian | `et` |
53+
| Basque | `eu` |
54+
| Persian (Farsi) | `fa` |
55+
| Finnish | `fi` |
56+
| French | `fr` |
57+
| Western Frisian | `fy` |
58+
| Irish | `ga` |
59+
| Scottish Gaelic | `gd` |
60+
| Galician | `gl` |
61+
| Gujarati | `gu` |
62+
| Hausa | `ha` |
63+
| Hebrew | `he` |
64+
| Hindi | `hi` |
65+
| Croatian | `hr` |
66+
| Hungarian | `hu` |
67+
| Armenian | `hy` |
68+
| Indonesian | `id` |
69+
| Italian | `it` |
70+
| Japanese | `ja` |
71+
| Javanese | `jv` |
72+
| Georgian | `ka` |
73+
| Kazakh | `kk` |
74+
| Khmer | `km` |
75+
| Kannada | `kn` |
76+
| Korean | `ko` |
77+
| Kurdish (Kurmanji) | `ku` |
78+
| Kyrgyz | `ky` |
79+
| Latin | `la` |
80+
| Lao | `lo` |
81+
| Lithuanian | `lt` |
82+
| Latvian | `lv` |
83+
| Malagasy | `mg` |
84+
| Macedonian | `mk` |
85+
| Malayalam | `ml` |
86+
| Mongolian | `mn` |
87+
| Marathi | `mr` |
88+
| Malay | `ms` |
89+
| Burmese | `my` |
90+
| Nepali | `ne` |
91+
| Dutch | `nl` |
92+
| Norwegian (Bokmal) | `nb` |
93+
| Oriya | `or` |
94+
| Punjabi | `pa` |
95+
| Polish | `pl` |
96+
| Pashto | `ps` |
97+
| Portuguese (Brazil) | `pt-br` |
98+
| Portuguese (Portugal) | `pt-pt` |
99+
| Romanian | `ro` |
100+
| Russian | `ru` |
101+
| Sanskrit | `sa` |
102+
| Sindhi | `sd` |
103+
| Sinhala | `si` |
104+
| Slovak | `sk` |
105+
| Slovenian | `sl` |
106+
| Somali | `so` |
107+
| Albanian | `sq` |
108+
| Serbian | `sr` |
109+
| Sundanese | `su` |
110+
| Swedish | `sv` |
111+
| Swahili | `sw` |
112+
| Tamil | `ta` |
113+
| Telugu | `te` |
114+
| Thai | `th` |
115+
| Filipino | `tl` |
116+
| Turkish | `tr` |
117+
| Uyghur | `ug` |
118+
| Ukrainian | `uk` |
119+
| Urdu | `ur` |
120+
| Uzbek | `uz` |
121+
| Vietnamese | `vi` |
122+
| Xhosa | `xh` |
123+
| Yiddish | `yi` |
124+
| Chinese (Simplified) | `zh-hans` |
125+
| Zulu | `zu` |
40126

41127
## Next steps
42128

0 commit comments

Comments
 (0)