Skip to content

Commit 8c50adc

Browse files
authored
Enrichment examples showing tables, images, and NER (#660)
1 parent a5b5aaf commit 8c50adc

File tree

9 files changed

+19
-0
lines changed

9 files changed

+19
-0
lines changed
366 KB
Loading
295 KB
Loading
209 KB
Loading

img/enriching/NER-Example.png

656 KB
Loading
290 KB
Loading
402 KB
Loading

ui/enriching/image-descriptions.mdx

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,14 @@ Line breaks have been inserted here for readability. The output will not contain
3939
}
4040
```
4141

42+
Here are three examples of the descriptions for detected images. These descriptions are generated with GPT-4o by OpenAI:
43+
44+
![Description of an image showing a scatter plot graph](/img/enriching/Image-Description-1.png)
45+
46+
![Description of an image showing the Matthews Correlation Coefficient for different VQA datasets](/img/enriching/Image-Description-2.png)
47+
48+
![Description of an image showing three scatter plots](/img/enriching/Image-Description-3.png)
49+
4250
Any embeddings that are produced after these summaries are generated will be based on the `text` field's contents.
4351

4452
## Generate image descriptions

ui/enriching/ner.mdx

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -96,6 +96,11 @@ entities and their relationship types, using GPT-4o. Note specifically the `enti
9696
}
9797
```
9898

99+
Here is another example of some of the entities, their entity types, and relationships that are recognized for a given paragraph of text. This information
100+
is generated by GPT-4o by OpenAI:
101+
102+
![Named entity recognition for information in a paragraph of text](/img/enriching/NER-Example.png)
103+
99104
By default, the following entity types are supported for NER:
100105

101106
- `PERSON`

ui/enriching/table-descriptions.mdx

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,12 @@ Line breaks have been inserted here for readability. The output will not contain
4343
}
4444
```
4545

46+
Here are two examples of the descriptions for detected tables. These descriptions are generated with GPT-4o by OpenAI:
47+
48+
![Description of a table with information about endoscopic datasets](/img/enriching/Table-Description-1.png)
49+
50+
![Description of a table with information about potentiodynamic polarization of stainless steel](/img/enriching/Table-Description-2.png)
51+
4652
The generated table's summary will overwrite any previous contents in the `text` field. The table's original content is available
4753
in the `image_base64` field.
4854

0 commit comments

Comments
 (0)