Skip to content

Commit 5f6113d

Browse files
authored
Merge pull request #269843 from jboback/NER-Concepts-3.21.24
NER Concepts Update
2 parents f63cc9d + 72a4ac2 commit 5f6113d

File tree

5 files changed

+92
-42
lines changed

5 files changed

+92
-42
lines changed

articles/ai-services/language-service/named-entity-recognition/concepts/entity-resolutions.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,11 +16,15 @@ ms.custom: language-service-ner
1616

1717
A resolution is a standard format for an entity. Entities can be expressed in various forms and resolutions provide standard predictable formats for common quantifiable types. For example, "eighty" and "80" should both resolve to the integer `80`.
1818

19-
You can use NER resolutions to implement actions or retrieve further information. For example, your service can extract datetime entities to extract dates and times that will be provided to a meeting scheduling system.
19+
You can use NER resolutions to implement actions or retrieve further information. For example, your service can extract datetime entities to extract dates and times that will be provided to a meeting scheduling system.
20+
21+
> [!IMPORTANT]
22+
> Starting from version 2023-04-15-preview, the entity resolution feature is replaced by [entity metadata](entity-metadata.md)
2023
2124
> [!NOTE]
2225
> Entity resolution responses are only supported starting from **_api-version=2022-10-01-preview_** and **_"modelVersion": "2022-10-01-preview"_**.
2326
27+
2428
This article documents the resolution objects returned for each entity category or subcategory.
2529

2630
## Age

articles/ai-services/language-service/named-entity-recognition/concepts/ga-preview-mapping.md

Lines changed: 21 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ ms.custom: language-service-ner
1414

1515
# Preview API changes
1616

17-
Use this article to get an overview of the new API changes starting from `2023-04-15-preview` version. This API change mainly introduces two new concepts (`entity types` and `entity tags`) replacing the `category` and `subcategory` fields in the current Generally Available API.
17+
Use this article to get an overview of the new API changes starting from `2023-04-15-preview` version. This API change mainly introduces two new concepts (`entity types` and `entity tags`) replacing the `category` and `subcategory` fields in the current Generally Available API. A detailed overview of each API parameter and the supported API versions it corresponds to can be found on the [Skill Parameters][../how-to/skill-parameters.md] page
1818

1919
## Entity types
2020
Entity types represent the lowest (or finest) granularity at which the entity has been detected and can be considered to be the base class that has been detected.
@@ -23,8 +23,16 @@ Entity types represent the lowest (or finest) granularity at which the entity ha
2323
Entity tags are used to further identify an entity where a detected entity is tagged by the entity type and additional tags to differentiate the identified entity. The entity tags list could be considered to include categories, subcategories, sub-subcategories, and so on.
2424

2525
## Changes from generally available API to preview API
26-
The changes introduce better flexibility for named entity recognition, including:
27-
* More granular entity recognition through introducing the tags list where an entity could be tagged by more than one entity tag.
26+
The changes introduce better flexibility for the named entity recognition service, including:
27+
28+
Updates to the structure of input formats:
29+
• InclusionList
30+
• ExclusionList
31+
• Overlap policy
32+
33+
Updates to the handling of output formats:
34+
35+
* More granular entity recognition outputs through introducing the tags list where an entity could be tagged by more than one entity tag.
2836
* Overlapping entities where entities could be recognized as more than one entity type and if so, this entity would be returned twice. If an entity was recognized to belong to two entity tags under the same entity type, both entity tags are returned in the tags list.
2937
* Filtering entities using entity tags, you can learn more about this by navigating to [this article](../how-to-call.md#select-which-entities-to-be-returned-preview-api-only).
3038
* Metadata Objects which contain additional information about the entity but currently only act as a wrapper for the existing entity resolution feature. You can learn more about this new feature [here](entity-metadata.md).
@@ -54,23 +62,24 @@ You can see a comparison between the structure of the entity categories/types in
5462
| Age | Numeric, Age |
5563
| Currency | Numeric, Currency |
5664
| Number | Numeric, Number |
65+
| PhoneNumber | PhoneNumber |
5766
| NumberRange | Numeric, NumberRange |
5867
| Percentage | Numeric, Percentage |
5968
| Ordinal | Numeric, Ordinal |
60-
| Temperature | Numeric, Dimension, Temperature |
61-
| Speed | Numeric, Dimension, Speed |
62-
| Weight | Numeric, Dimension, Weight |
63-
| Height | Numeric, Dimension, Height |
64-
| Length | Numeric, Dimension, Length |
65-
| Volume | Numeric, Dimension, Volume |
66-
| Area | Numeric, Dimension, Area |
67-
| Information | Numeric, Dimension, Information |
69+
| Temperature | Numeric, Dimension, Temperature |
70+
| Speed | Numeric, Dimension, Speed |
71+
| Weight | Numeric, Dimension, Weight |
72+
| Height | Numeric, Dimension, Height |
73+
| Length | Numeric, Dimension, Length |
74+
| Volume | Numeric, Dimension, Volume |
75+
| Area | Numeric, Dimension, Area |
76+
| Information | Numeric, Dimension, Information |
6877
| Address | Address |
6978
| Person | Person |
7079
| PersonType | PersonType |
7180
| Organization | Organization |
7281
| Product | Product |
73-
| ComputingProduct | Product, ComputingProduct |
82+
| ComputingProduct | Product, ComputingProduct |
7483
| IP | IP |
7584
| Email | Email |
7685
| URL | URL |
Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,49 @@
1+
---
2+
title: Named entity recognition skill parameters
3+
titleSuffix: Azure AI services
4+
description: Learn about skill parameters for named entity recognition.
5+
#services: cognitive-services
6+
author: jboback
7+
manager: nitinme
8+
ms.service: azure-ai-language
9+
ms.custom:
10+
ms.topic: how-to
11+
ms.date: 03/21/2024
12+
ms.author: jboback
13+
---
14+
15+
# Learn about named entity recognition skill parameters
16+
17+
Use this article to get an overview of the different API parameters used to adjust the input to a NER API call.
18+
19+
## InclusionList parameter
20+
21+
The “inclusionList” parameter allows for you to specify which of the NER entity tags, listed here [link to Preview API table], you would like included in the entity list output in your inference JSON listing out all words and categorizations recognized by the NER service. By default, all recognized entities will be listed.
22+
23+
## ExclusionList parameter
24+
25+
The “exclusionList” parameter allows for you to specify which of the NER entity tags, listed here [link to Preview API table], you would like excluded in the entity list output in your inference JSON listing out all words and categorizations recognized by the NER service. By default, all recognized entities will be listed.
26+
27+
## Example
28+
29+
To do: work with Bidisha & Mikael to update with a good example
30+
31+
## overlapPolicy parameter
32+
33+
The “overlapPolicy” parameter allows for you to specify how you like the NER service to respond to recognized words/phrases that fall into more than one category.
34+
35+
By default, the overlapPolicy parameter will be set to “matchLongest”. This option will categorize the extracted word/phrase under the entity category that can encompass the longest span of the extracted word/phrase (longest defined by the most number of characters included).
36+
37+
The alternative option for this parameter is “allowOverlap”, where all possible entity categories will be listed.
38+
Parameters by supported API version
39+
40+
|Parameter |API versions which support |
41+
|------------------------------------------------------------|--------------------------------------|
42+
|inclusionList |2023-04-15-preview, 2023-11-15-preview|
43+
|exclusionList |2023-04-15-preview, 2023-11-15-preview|
44+
|Overlap policy |2023-04-15-preview, 2023-11-15-preview|
45+
|[Entity resolution](link to archived Entity Resolution page)|2022-10-01-preview |
46+
47+
## Next steps
48+
49+
* See [Configure containers](../../concepts/configure-containers.md) for configuration settings.

articles/ai-services/language-service/named-entity-recognition/overview.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -14,14 +14,16 @@ ms.custom: language-service-ner
1414

1515
# What is Named Entity Recognition (NER) in Azure AI Language?
1616

17-
Named Entity Recognition (NER) is one of the features offered by [Azure AI Language](../overview.md), a collection of machine learning and AI algorithms in the cloud for developing intelligent applications that involve written language. The NER feature can identify and categorize entities in unstructured text. For example: people, places, organizations, and quantities.
17+
Named Entity Recognition (NER) is one of the features offered by [Azure AI Language](../overview.md), a collection of machine learning and AI algorithms in the cloud for developing intelligent applications that involve written language. The NER feature can identify and categorize entities in unstructured text. For example: people, places, organizations, and quantities. The prebuilt NER feature has a pre-set list of [recognized entities](concepts/named-entity-categories.md). The custom NER feature allows you to train the model to recognize specialized entities specific to your use case.
1818

1919
* [**Quickstarts**](quickstart.md) are getting-started instructions to guide you through making requests to the service.
2020
* [**How-to guides**](how-to-call.md) contain instructions for using the service in more specific or customized ways.
2121
* The [**conceptual articles**](concepts/named-entity-categories.md) provide in-depth explanations of the service's functionality and features.
2222

23-
[!INCLUDE [Typical workflow for pre-configured language features](../includes/overview-typical-workflow.md)]
23+
> [!NOTE]
24+
> [Entity Resolution](concepts/entity-resolutions.md) was upgraded to the [Entity Metadata](concepts/entity-metadata.md) starting in API version 2023-04-15-preview. If you are calling the preview version of the API equal or newer than 2023-04-15-preview, please check out the [Entity Metadata](concepts/entity-metadata.md) article to use the resolution feature.
2425
26+
[!INCLUDE [Typical workflow for pre-configured language features](../includes/overview-typical-workflow.md)]
2527

2628
## Get started with named entity recognition
2729

articles/ai-services/language-service/toc.yml

Lines changed: 13 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -249,23 +249,25 @@ items:
249249
href: named-entity-recognition/quickstart.md
250250
- name: NER language support
251251
href: named-entity-recognition/language-support.md
252+
- name: Responsible use of AI
253+
items:
254+
- name: Transparency note for NER
255+
href: /legal/cognitive-services/language-service/transparency-note-named-entity-recognition?context=/azure/ai-services/language-service/context/context
256+
displayName: Transparency note for NER, Named Entity Recognition transparency, Responsible AI, Responsible use of AI
257+
- name: Integration and responsible use
258+
href: /legal/cognitive-services/language-service/guidance-integration-responsible-use?context=/azure/ai-services/language-service/context/context
259+
displayName: Responsible deployment, Responsible use, Responsible integration, AI deployment, AI use
260+
- name: Data, privacy, and security
261+
href: /legal/cognitive-services/language-service/data-privacy?context=/azure/ai-services/language-service/context/context
262+
displayName: Data privacy, logging, data retention
252263
- name: Prebuilt
253264
items:
254-
- name: Responsible use of AI
255-
items:
256-
- name: Transparency note for NER
257-
href: /legal/cognitive-services/language-service/transparency-note-named-entity-recognition?context=/azure/ai-services/language-service/context/context
258-
displayName: Transparency note for NER, Named Entity Recognition transparency, Responsible AI, Responsible use of AI
259-
- name: Integration and responsible use
260-
href: /legal/cognitive-services/language-service/guidance-integration-responsible-use?context=/azure/ai-services/language-service/context/context
261-
displayName: Responsible deployment, Responsible use, Responsible integration, AI deployment, AI use
262-
- name: Data, privacy, and security
263-
href: /legal/cognitive-services/language-service/data-privacy?context=/azure/ai-services/language-service/context/context
264-
displayName: Data privacy, logging, data retention
265265
- name: How-to guides
266266
items:
267267
- name: Call NER
268268
href: named-entity-recognition/how-to-call.md
269+
- name: Use skill parameters
270+
href: named-entity-recognition/how-to/skill-parameters.md
269271
- name: Use containers
270272
items:
271273
- name: Use Docker containers
@@ -282,8 +284,6 @@ items:
282284
items:
283285
- name: Recognized entity categories
284286
href: named-entity-recognition/concepts/named-entity-categories.md
285-
- name: Entity resolution
286-
href: named-entity-recognition/concepts/entity-resolutions.md
287287
- name: Entity Metadata
288288
href: named-entity-recognition/concepts/entity-metadata.md
289289
- name: Preview API overview
@@ -302,20 +302,6 @@ items:
302302
href: custom-named-entity-recognition/language-support.md
303303
- name: Custom NER FAQ
304304
href: custom-named-entity-recognition/faq.md
305-
- name: Responsible use of AI
306-
items:
307-
- name: Transparency note for custom NER
308-
href: /legal/cognitive-services/language-service/cner-transparency-note?context=/azure/ai-services/language-service/context/context
309-
displayName: Transparency note for Custom NER, Custom NER Transparency, Responsible AI, Responsible use of AI
310-
- name: Integration and responsible use
311-
href: /legal/cognitive-services/language-service/cner-guidance-integration-responsible-use?context=/azure/ai-services/language-service/context/context
312-
displayName: Responsible deployment, Responsible use, Responsible integration, AI deployment, AI use
313-
- name: Characteristics and limitations
314-
href: /legal/cognitive-services/language-service/cner-characteristics-and-limitations?context=/azure/ai-services/language-service/context/context
315-
displayName: Custom NER characteristics, Custom NER limitations
316-
- name: Data, privacy, and security
317-
href: /legal/cognitive-services/language-service/cner-data-privacy-security?context=/azure/ai-services/language-service/context/context
318-
displayName: Data privacy, logging, data retention
319305
- name: How-to guides
320306
items:
321307
- name: Create projects

0 commit comments

Comments
 (0)