You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: ui/embedding.mdx
+4-36Lines changed: 4 additions & 36 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -59,41 +59,9 @@ on Hugging Face:
59
59
60
60
## Generate embeddings
61
61
62
-
To generate embeddings, choose one of the following embedding providers and models in the **Select Embedding Model** section of an **Embedder** node in a workflow:
62
+
To generate embeddings, choose one of the available embedding providers and models in the **Select Embedding Model** section of an **Embedder** node in a workflow.
63
63
64
-
<Note>You can change a workflow's preconfigured provider only through [Custom](/ui/workflows#create-a-custom-workflow) workflow settings.</Note>
65
-
66
-
-**Azure OpenAI**: Use [Azure OpenAI](https://azure.microsoft.com/products/ai-services/openai-service) to generate embeddings with one of the following models:
67
-
68
-
-**text-embedding-3-small**, with 1536 dimensions.
69
-
-**text-embedding-3-large**, with 3072 dimensions.
70
-
-**Ada 002 (Text)** (`text-embedding-ada-002`), with 1536 dimensions.
-**Amazon Bedrock**: Use [Amazon Bedrock](https://aws.amazon.com/bedrock) to generate embeddings with one of the following models:
75
-
76
-
-**Titan Text Embeddings V2**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html).
77
-
-**Titan Embeddings G1 - Text**, with 1536 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html).
78
-
-**Titan Multimodal Embeddings G1**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/titan-multiemb-models.html).
79
-
-**Cohere Embed English**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-embed.html).
80
-
-**Cohere Embed Multilingual**, with 1024 dimensions. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-embed.html).
64
+
When choosing an embedding model, be sure to pay attention to the number of dimensions listed next to each model. This number must match the number of dimensions in the
65
+
embeddings field of your destination connector's table, collection, or index.
81
66
82
-
-**TogetherAI**: Use [TogetherAI](https://www.together.ai/) to generate embeddings with one of the following models:
83
-
84
-
-**M2-BERT-80M-32K-Retrieval**, with 768 dimensions.
To generate image descriptions, in an **Enrichment** node in a workflow, specify the following:
63
+
To generate image descriptions, in an **Enrichment** node in a workflow, select **Image**, and then choose one of the available provider (and model) combinations that are shown.
68
64
69
65
<Note>
70
66
You can change a workflow's image description settings only through [Custom](/ui/workflows#create-a-custom-workflow) workflow settings.
@@ -74,9 +70,3 @@ To generate image descriptions, in an **Enrichment** node in a workflow, specify
74
70
</Note>
75
71
76
72
<EnrichmentImageSummaryHiResOnly />
77
-
78
-
Select **Image**, and then choose one of the following provider (and model) combinations to use:
Copy file name to clipboardExpand all lines: ui/enriching/ner.mdx
+2-5Lines changed: 2 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,10 +5,7 @@ title: Named entity recognition (NER)
5
5
After partitioning, you can have Unstructured generate a list of recognized entities and their types (such as the names of organizations, products, and people) in the content, through a process known as _named entity recognition_ (NER).
6
6
You can also have Unstructured generate a list of relationships between the entities that are recognized.
7
7
8
-
This NER is done by using models offered through these providers:
9
-
10
-
-[GPT-4o](https://openai.com/index/hello-gpt-4o/), provided through OpenAI.
11
-
-[Claude 3.5 Sonnet](https://www.anthropic.com/news/claude-3-5-sonnet), provided through Anthropic.
8
+
This NER is done by using models offered through various model providers.
12
9
13
10
Here is an example of a list of recognized entities and their entity types, along with a list of relationships between those
14
11
entities and their relationship types, using GPT-4o. Note specifically the `entities` field that is added to the `metadata` field.
@@ -147,7 +144,7 @@ To generate a list of recognized entities and their relationships, in an **Enric
147
144
</Note>
148
145
149
146
1. Select **Text**.
150
-
2. For **Model**, select either **OpenAI (GPT-4o)** or **Anthropic (Claude 3.5 Sonnet)**.
147
+
2. For **Model**, select one of the available models that are shown.
151
148
3. The selected model will follow a default set of instructions (called a _prompt_) to perform NER using a set of predefined entity types and relationships. To experiment
152
149
with running the default prompt against some sample data, click **Edit**, and then click **Run Prompt**. The selected **Model** uses the
153
150
**Prompt** to run NER on the **Input sample** and shows the results in the **Output**. Look specifically at the `response_json` field for the
To generate table descriptions, in an **Enrichment** node in a workflow, specify the following:
73
+
To generate table descriptions, in an **Enrichment** node in a workflow, select **Table**, and then choose one of the available provider (and model) combinations that are shown.
74
+
75
+
Make sure after you choose the provider and model, that **Table Description** is also displayed. If **Table Description** and **Table to HTML** are both
76
+
displayed, be sure to select **Table Description**.
78
77
79
78
<Note>
80
79
You can change a workflow's table description settings only through [Custom](/ui/workflows#create-a-custom-workflow) workflow settings.
@@ -85,14 +84,7 @@ To generate table descriptions, in an **Enrichment** node in a workflow, specify
85
84
86
85
<EnrichmentTableSummaryHiResOnly />
87
86
88
-
Select **Table**, and then choose one of the following provider (and model) combinations to use:
Make sure after you choose the provider and model, that **Table Description** is also displayed. If **Table Description** and **Table to HTML** are both
95
-
displayed, be sure to select **Table Description**.
0 commit comments