Skip to content

Commit 8aedb96

Browse files
v-albemiv-albemi
authored
Merge pull request #102851 from aahill/jan2020-ner
[Cog Svcs] Updating NER entities
2 parents d187e0c + 49a6b65 commit 8aedb96

File tree

5 files changed

+250
-55
lines changed

5 files changed

+250
-55
lines changed

‎articles/cognitive-services/text-analytics/includes/entity-types/general-entities.md

Lines changed: 108 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -6,98 +6,179 @@ author: aahill
66
manager: nitinme
77
ms.service: cognitive-services
88
ms.topic: include
9-
ms.date: 09/18/2019
9+
ms.date: 02/06/2020
1010
ms.author: aahi
1111
---
1212

1313
## General entity types:
1414

1515
### Person
16-
Recognized names and other persons in text.
16+
17+
Recognize person names in text.
18+
19+
Languages:
20+
* Public preview: `English`
21+
22+
| Subtype name | Description | Available starting with model version |
23+
|--------------|------------------------------------------------------------------|---------------------------------------|
24+
| N/A | Recognized person names, for example `Bill Gates`, `Marie Curie` | `2019-10-01` |
25+
26+
### PersonType
27+
Job type or role held by a person.
28+
1729
Languages:
1830
* Public preview: `English`
1931

20-
| Subtype name | Description |
21-
|--------------|-------------------------|
22-
| N/A | Recognized names, for example `Bill Gates`, `Marie Curie` |
32+
| Subtype name | Description | Available starting with model version |
33+
|--------------|--------------------------------------------------------------------------------------------|----------------------------------------|
34+
| N/A | Job types for example `civil engineer`, `salesperson`, `chef`, `librarian`, `nursing aide` | `2020-02-01` |
2335

2436
### Location
2537

26-
Natural and human-made landmarks, structures, and geographical features.
38+
Natural and human-made landmarks, structures, geographical features and geopolitical entities.
2739

2840
Languages:
2941

30-
3142
* Public preview: `English`
3243

33-
| Subtype name | Description |
34-
|--------------|--------------------------------------------------------------------------------------------------|
35-
| N/A | locations, for example `Atlantic Ocean`, `library`, `Eiffel Tower`, `Statue of Liberty` |
44+
| Subtype name | Description | Available starting with model version |
45+
|---------------------------|------------------------------------------------------------------------------------------|----------------------------------------|
46+
| N/A | locations, for example `Atlantic Ocean`, `library`, `Eiffel Tower`, `Statue of Liberty` | `2019-10-01` |
47+
| Geopolitical Entity (GPE) | Cities, countries, states for example `Seattle`, `Pennsylvania`, `South Africa`, `Tokyo` | `2020-02-01` |
3648

3749
### Organization
3850

3951
Recognized organizations, corporations, agencies, and other groups of people. For example: companies, political groups, musical bands, sport clubs, government bodies, and public organizations. Nationalities and religions are not included in this entity type.
52+
53+
Languages:
54+
55+
* Public preview: `English`
56+
57+
| Subtype name | Description | Available starting with model version |
58+
|--------------|---------------------------------------------------------------------------------------------------------|----------------------------------------|
59+
| N/A | organizations, for example `Microsoft`, `NASA`, `National Oceanic and Atmospheric Administration`,`VOA` | `2019-10-01` |
60+
61+
### Event
62+
63+
Historical, social and natural-occuring events.
64+
65+
Languages:
66+
67+
* Public preview: `English`
68+
69+
| Subtype name | Description | Available starting with model version |
70+
|--------------|------------------------------------------------------------------------|----------------------------------------|
71+
| N/A | Events such as `wedding`, `hurricane`, `car accident`, `solar eclipse`, `American Revolution` | `2020-02-01` |
72+
73+
### Product
74+
75+
Physical objects of various categories.
76+
77+
Languages:
78+
79+
* Public preview: `English`
80+
81+
| Subtype name | Description | Available starting with model version |
82+
|--------------|------------------------------------------------------------------------------------|----------------------------------------|
83+
| N/A | For example, `Microsoft Surface laptop`, `sunglasses`, `motorcycle`, `bag`, `Xbox` | `2020-02-01` |
84+
| Computing | `Azure Cosmos DB`, `Azure Kubernetes Service` | `2020-02-01` |
85+
86+
### Skill
87+
88+
An entity describing a capability or expertise.
89+
4090
Languages:
4191

4292
* Public preview: `English`
4393

44-
| Subtype name | Description |
45-
|--------------|--------------------------------------------------------------------------------------------------|
46-
| N/A | organizations, for example `Microsoft`, `NASA` `National Oceanic and Atmospheric Administration` |
94+
| Subtype name | Description | Available starting with model version |
95+
|--------------|-----------------------------------------------------------------------------|----------------------------------------|
96+
| N/A | `nursing`, `data mining`, `linguistics`, `critical thinking`, `photography` | `2020-02-01` |
4797

4898
### Phone Number
4999

50100
Phone numbers (US Phone numbers only).
51101

52102
Languages:
53103

54-
55104
* Public preview: `English`
56105

57-
| Subtype name | Description |
58-
|----------|----------------------------------------------|
59-
| N/A | US phone numbers, for example `(312) 555-0176`. |
106+
| Subtype name | Description | Available starting with model version |
107+
|--------------|------------------------------------------------|----------------------------------------|
108+
| N/A | US phone numbers, for example `(312) 555-0176` | `2019-10-01` |
60109

61110
### Email
62111

63112
Email address.
64113

65114
Languages:
66115

67-
68116
* Public preview: `English`
69117

70-
| Subtype name | Description |
71-
|----------|----------------------------------------------|
72-
| N/A | Email address, for example `[email protected]` |
118+
| Subtype name | Description | Available starting with model version |
119+
|--------------|--------------------------------------------------|----------------------------------------|
120+
| N/A | Email address, for example `[email protected]` | `2019-10-01` |
73121

74122
### URL
75123

76124
Internet URLs.
77125

78126
Languages:
79127

128+
* Public preview: `English`
129+
130+
| Subtype name | Description | Available starting with model version |
131+
|--------------|------------------------------------------------------|----------------------------------------|
132+
| N/A | URLs to websites, for example `https://www.bing.com` | `2019-10-01` |
133+
134+
### IP Address
135+
136+
Internet Protocol Address
137+
138+
Languages:
80139

81140
* Public preview: `English`
82141

83-
| Subtype name | Description |
84-
|----------|-------------------------------------------------------|
85-
| N/A | URLs to websites, for example `https://www.bing.com`. |
142+
| Subtype name | Description | Available starting with model version |
143+
|--------------|------------------------------------------|----------------------------------------|
144+
| N/A | Network address for example `10.0.0.101` | `2019-10-01` |
86145

87-
### Number
146+
### DateTime
88147

89-
Numbers and numeric quantities.
148+
Date and Time entities.
149+
150+
* Available starting with model version `2019-10-01`
90151

91152
Languages:
92153

154+
* Public preview: `English`
155+
156+
| Subtype name | Examples |
157+
|-------------|------------------------------|
158+
| N/A | `6:30PM February 4, 2012`, `4/1/2011 2:45` |
159+
| Date | `May 2nd, 2017`, `05/02/2017` |
160+
| Time | `8:15`, `6AM` |
161+
| DateRange | `August 2nd to August 5th` |
162+
| TimeRange | `4-6PM`, `10:00AM to Noon` |
163+
| Duration | `2.5 minutes`, `one and a half hours` |
164+
| Set | `every Saturday` |
165+
166+
### Quantity
167+
168+
Numbers and numeric quantities.
169+
170+
* Available starting with model version `2019-10-01`
171+
172+
Languages:
93173

94174
* Public preview: `English`
95175

96176
| Subtype name | Examples |
97177
|-------------|------------------------------|
98-
| N/A | `6`, `six` |
178+
| Number | `6`, `six` |
99179
| Percentage | `50%`, `fifty percent` |
100180
| Ordinal | `2nd`, `second` |
181+
| Age | `90 day old`, `30 years old` |
101182
| Currency | `$10.99`, `€30.00` |
102183
| Dimension | `10 miles`, `40 cm` |
103184
| Temperature | `32 degrees`, `10°C` |

‎articles/cognitive-services/text-analytics/includes/entity-types/personal-information-entities.md

Lines changed: 94 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6,25 +6,105 @@ author: aahill
66
manager: nitinme
77
ms.service: cognitive-services
88
ms.topic: include
9-
ms.date: 10/21/2019
9+
ms.date: 02/06/2020
1010
ms.author: aahi
1111
---
1212

1313
## Personal information entity types:
1414

15+
### Person
16+
Recognize person names in text.
17+
18+
Languages:
19+
* Public preview: `English`
20+
21+
| Subtype name | Description | Available starting with model version |
22+
|--------------|-----------------------------------------------------------|----------------------------------------|
23+
| N/A | Recognized names, for example `Bill Gates`, `Marie Curie` | `2020-02-01` |
24+
25+
### Organization
26+
27+
Recognize organizations, corporations, agencies, companies, clubs and other groups of people.
28+
29+
Languages:
30+
31+
* Public preview: `English`
32+
33+
| Subtype name | Description | |
34+
|--------------|---------------------------------------------------------------------------------------------------|--------------|
35+
| N/A | organizations, for example `Microsoft`, `NASA`, `National Oceanic and Atmospheric Administration` | `2020-02-01` |
36+
1537
### Phone Number
1638

17-
Phone numbers.
39+
Phone numbers (US Phone numbers only).
40+
41+
Languages:
42+
43+
* Public preview: `English`
44+
45+
| Subtype name | Description | Available starting with model version |
46+
|--------------|------------------------------------------------|----------------------------------------|
47+
| N/A | US phone numbers, for example `(312) 555-0176` | `2020-02-01` |
48+
49+
### Email
50+
51+
Email address.
52+
53+
Languages:
54+
55+
* Public preview: `English`
56+
57+
| Subtype name | Description | Available starting with model version |
58+
|--------------|--------------------------------------------------|----------------------------------------|
59+
| N/A | Email address, for example `[email protected]` | `2020-02-01` |
60+
61+
### URL
62+
63+
Internet URLs.
64+
65+
Languages:
66+
67+
* Public preview: `English`
68+
69+
| Subtype name | Description | Available starting with model version |
70+
|--------------|------------------------------------------------------|----------------------------------------|
71+
| N/A | URLs to websites, for example `https://www.bing.com` | `2020-02-01` |
72+
73+
### IP Address
74+
75+
Internet Protocol Address
76+
77+
Languages:
78+
79+
* Public preview: `English`
80+
81+
| Subtype name | Description | Available starting with model version |
82+
|--------------|------------------------------------------|----------------------------------------|
83+
| N/A | Network address for example `10.0.0.101` | `2020-02-01` |
84+
85+
### Quantity
86+
87+
Numeric quantities
88+
89+
Languages:
90+
91+
* Public preview: `English`
92+
93+
| Subtype name | Description | Available starting with model version |
94+
|--------------|-------------------------------|----------------------------------------|
95+
| Age | `90 days old`, `30 years old` | `2020-02-01` |
96+
97+
### DateTime
98+
99+
Date and Time entities
18100

19101
Languages:
20102

21103
* Public preview: `English`
22104

23-
| Subtype name | Description |
24-
|------------------------|-------------------------------------------------------|
25-
| N/A | Phone numbers, for example `+1 123-123-123`. |
26-
| EU Phone number | Phone numbers specific to the European union. |
27-
| EU Mobile Phone number | Mobile phone numbers specific to the European union. |
105+
| Subtype name | Description | Available starting with model version |
106+
|--------------|-------------------------------|----------------------------------------|
107+
| Date | `May 2nd, 2017`, `05/02/2017` | `2020-02-01` |
28108

29109
### EU GPS Coordinates
30110

@@ -34,14 +114,16 @@ Languages:
34114

35115
* Public preview: `English`
36116

37-
| Subtype name | Description |
38-
|--------------|-------------------------------------------|
39-
| N/A | GPS coordinates within the European Union |
117+
| Subtype name | Description | Available starting with model version |
118+
|--------------|-------------------------------------------|----------------------------------------|
119+
| N/A | GPS coordinates within the European Union | `2019-10-01` |
40120

41121
### Azure information
42122

43123
Identifiable Azure information including authentication information, and connection strings.
44124

125+
* Available starting with model version `2019-10-01`.
126+
45127
Languages:
46128

47129
* Public preview: `English`
@@ -62,6 +144,8 @@ Languages:
62144

63145
### Identification
64146

147+
* Available starting with model version `2019-10-01`.
148+
65149
Languages:
66150

67151
* Public preview: `English`

‎articles/cognitive-services/text-analytics/includes/model-versioning.md

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,14 +7,17 @@ author: aahill
77
manager: nitinme
88
ms.service: cognitive-services
99
ms.topic: include
10-
ms.date: 10/25/2019
10+
ms.date: 02/06/2020
1111
ms.author: aahi
1212
---
1313

14-
Version 3 of the Text Analytics API lets you choose the Text Analytics model used on your data. Use the optional `model-version` parameter to select a version of the model in your requests. If this parameter isn't specified the API will default to `latest`, the latest stable model version.
14+
Version 3 of the Text Analytics API lets you choose the model version that is most current for your data. Use the optional `model-version` parameter to select the version of the model that is desired for your requests. If this parameter isn't specified the API will default to `latest`, the latest stable version. Even though you can use the newest model-version in any request, only some features are updated in each version. The table below describes which features have been updated in each model version:
15+
16+
| Model version | Features updated | Latest version for: |
17+
|-------------------------|--------------------------|--------------------------|
18+
| `2020-02-01` | Entity recognition | Entity recognition |
19+
| `2019-10-01` | Entity recognition, Sentiment analysis | Language detection, Key phrase extraction, Sentiment analysis|
1520

16-
Available model versions:
17-
* `2019-10-01` (`latest`)
1821

1922
Each response from the v3 endpoints includes a `model-version` field specifying the model version that was used.
2023

@@ -25,3 +28,4 @@ Each response from the v3 endpoints includes a `model-version` field specifying
2528
"model-version": "2019-10-01"
2629
}
2730
```
31+
See [What's new](../whats-new.md) for details on the updates for these model versions.

‎articles/cognitive-services/text-analytics/named-entity-types.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ manager: nitinme
99
ms.service: cognitive-services
1010
ms.subservice: text-analytics
1111
ms.topic: article
12-
ms.date: 11/04/2019
12+
ms.date: 02/06/2020
1313
ms.author: aahi
1414
---
1515

0 commit comments

Comments
 (0)