You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
import FunctionDescription from '@site/src/components/FunctionDescription';
5
5
6
-
<FunctionDescriptiondescription="Introduced or updated: v1.2.530"/>
6
+
<FunctionDescriptiondescription="Introduced or updated: v1.2.713"/>
7
7
8
8
Databend accepts a variety of file formats both as a source and as a target for data loading or unloading. This page explains the supported file formats and their available options.
9
9
@@ -72,14 +72,10 @@ Separates fields in a record.
72
72
73
73
**Default**: `,` (comma)
74
74
75
-
### QUOTE
75
+
### QUOTE (Load Only)
76
76
77
77
Quotes strings in a CSV file. For data loading, the quote is not necessary unless a string contains the character of a [QUOTE](#quote), [ESCAPE](#escape), [RECORD_DELIMITER](#record_delimiter), or [FIELD_DELIMITER](#field_delimiter).
78
78
79
-
:::note
80
-
**Used for data loading ONLY**: This option is not available when you unload data from Databend.
81
-
:::
82
-
83
79
**Available Values**: `'`, `"`, or `(backtick)
84
80
85
81
**Default**: `"`
@@ -92,49 +88,43 @@ Escapes a quote in a quoted string.
92
88
93
89
**Default**: `''`
94
90
95
-
### SKIP_HEADER
91
+
### SKIP_HEADER (Load Only)
96
92
97
93
Specifies how many lines to be skipped from the beginning of the file.
98
94
99
-
:::note
100
-
**Used for data loading ONLY**: This option is not available when you unload data from Databend.
101
-
:::
102
-
103
95
**Default**: `0`
104
96
105
-
### NAN_DISPLAY
97
+
### NAN_DISPLAY (Load Only)
106
98
107
99
Specifies how "NaN" (Not-a-Number) values are displayed in query results.
108
100
109
101
**Available Values**: Must be literal `'nan'` or `'null'` (case-insensitive)
110
102
111
103
**Default**: `'NaN'`
112
104
113
-
### NULL_DISPLAY
105
+
### NULL_DISPLAY (Load Only)
114
106
115
107
Specifies how NULL values are displayed in query results.
116
108
117
109
**Default**: `'\N'`
118
110
119
-
### ERROR_ON_COLUMN_COUNT_MISMATCH
111
+
### ERROR_ON_COLUMN_COUNT_MISMATCH (Load Only)
120
112
121
113
ERROR_ON_COLUMN_COUNT_MISMATCH is a boolean option that, when set to true, specifies that an error should be raised if the number of columns in the data file doesn't match the number of columns in the destination table. Setting it to true helps ensure data integrity and consistency during the loading process.
122
114
123
115
**Default**: `true`
124
116
125
-
### EMPTY_FIELD_AS
117
+
### EMPTY_FIELD_AS (Load Only)
126
118
127
119
Specifies the value that should be used when encountering empty fields, including both `,,` and `,"",`, in the CSV data being loaded into the table.
|`NONE` (Default) | Indicates that the files are not compressed. |
154
142
|`AUTO`| Auto detect compression via file extensions |
@@ -209,7 +197,7 @@ Same as [the COMPRESSION option for CSV](#compression).
209
197
210
198
## NDJSON Options
211
199
212
-
### NULL_FIELD_AS
200
+
### NULL_FIELD_AS (Load Only)
213
201
214
202
Specifies how to handle null values during data loading. Refer to the options in the table below for possible configurations.
215
203
@@ -218,7 +206,7 @@ Specifies how to handle null values during data loading. Refer to the options in
218
206
|`NULL` (Default) | Interprets null values as NULL for nullable fields. An error will be generated for non-nullable fields. |
219
207
|`FIELD_DEFAULT`| Uses the default value of the field for null values. |
220
208
221
-
### MISSING_FIELD_AS
209
+
### MISSING_FIELD_AS (Load Only)
222
210
223
211
Determines the behavior when encountering missing fields during data loading. Refer to the options in the table below for possible configurations.
224
212
@@ -234,7 +222,7 @@ Same as [the COMPRESSION option for CSV](#compression).
234
222
235
223
## PARQUET Options
236
224
237
-
### MISSING_FIELD_AS
225
+
### MISSING_FIELD_AS (Load Only)
238
226
239
227
Determines the behavior when encountering missing fields during data loading. Refer to the options in the table below for possible configurations.
240
228
@@ -243,9 +231,19 @@ Determines the behavior when encountering missing fields during data loading. Re
243
231
|`ERROR` (Default)| Generates an error if a missing field is encountered. |
244
232
|`FIELD_DEFAULT`| Uses the default value of the field for missing fields. |
245
233
234
+
### COMPRESSION (Unload Only)
235
+
236
+
Specifies the compression algorithm, which is used for compressing internal blocks of the file rather than the entire file, so the output remains in Parquet format.
0 commit comments