Skip to content

Commit 89c9dc7

Browse files
authored
Snowflake destination connector: how to create a compatible table (#371)
1 parent 7c5e9c9 commit 89c9dc7

File tree

1 file changed

+49
-0
lines changed

1 file changed

+49
-0
lines changed

snippets/general-shared-text/snowflake.mdx

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -58,3 +58,52 @@
5858
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture"
5959
allowfullscreen
6060
></iframe>
61+
62+
Snowflake requires the target table to have a defined schema before Unstructured can write to the table. The recommended table
63+
schema for Unstructured is as follows:
64+
65+
```sql SQL
66+
CREATE TABLE ELEMENTS (
67+
ID VARCHAR(36) NOT NULL DEFAULT UUID_STRING(),
68+
RECORD_ID VARCHAR,
69+
ELEMENT_ID VARCHAR,
70+
TEXT VARCHAR,
71+
EMBEDDINGS ARRAY,
72+
TYPE VARCHAR,
73+
SYSTEM VARCHAR,
74+
LAYOUT_WIDTH NUMBER,
75+
LAYOUT_HEIGHT NUMBER,
76+
POINTS VARCHAR,
77+
URL VARCHAR,
78+
VERSION VARCHAR,
79+
DATE_CREATED TIMESTAMP_TZ,
80+
DATE_MODIFIED TIMESTAMP_TZ,
81+
DATE_PROCESSED TIMESTAMP_TZ,
82+
PERMISSIONS_DATA VARCHAR,
83+
RECORD_LOCATOR VARCHAR,
84+
CATEGORY_DEPTH NUMBER,
85+
PARENT_ID VARCHAR,
86+
ATTACHED_FILENAME VARCHAR,
87+
FILETYPE VARCHAR,
88+
LAST_MODIFIED TIMESTAMP_TZ,
89+
FILE_DIRECTORY VARCHAR,
90+
FILENAME VARCHAR,
91+
LANGUAGES ARRAY,
92+
PAGE_NUMBER VARCHAR,
93+
LINKS VARCHAR,
94+
PAGE_NAME VARCHAR,
95+
LINK_URLS ARRAY,
96+
LINK_TEXTS ARRAY,
97+
SENT_FROM ARRAY,
98+
SENT_TO ARRAY,
99+
SUBJECT VARCHAR,
100+
SECTION VARCHAR,
101+
HEADER_FOOTER_TYPE VARCHAR,
102+
EMPHASIZED_TEXT_CONTENTS ARRAY,
103+
EMPHASIZED_TEXT_TAGS ARRAY,
104+
TEXT_AS_HTML VARCHAR,
105+
REGEX_METADATA VARCHAR,
106+
DETECTION_CLASS_PROB NUMBER,
107+
PRIMARY KEY (ID)
108+
);
109+
```

0 commit comments

Comments
 (0)