You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/cosmos-db/postgresql/howto-ingest-azure-blob-storage.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -66,7 +66,7 @@ pg_size_pretty | 5257 kB
66
66
content_type | application/x-gzip
67
67
```
68
68
69
-
You can filter the output either by using a regular SQL `WHERE` clause, or by using the `prefix` parameter of the `blob_list` UDF. The latter will filter the returned rows on the Azure Blob Storage side.
69
+
You can filter the output either by using a regular SQL `WHERE` clause, or by using the `prefix` parameter of the `blob_list` UDF. The latter filters the returned rows on the Azure Blob Storage side.
70
70
71
71
72
72
> [!NOTE]
@@ -178,7 +178,7 @@ Currently the extension supports the following file formats:
178
178
179
179
### Load data with blob_get()
180
180
181
-
The `COPY` command is convenient, but limited in flexibility. Internally COPY uses the `blob_get` function, which you can use directly to manipulate data in much more complex scenarios.
181
+
The `COPY` command is convenient, but limited in flexibility. Internally COPY uses the `blob_get` function, which you can use directly to manipulate data in more complex scenarios.
Copy file name to clipboardExpand all lines: articles/cosmos-db/postgresql/reference-pg-azure-storage.md
+25-22Lines changed: 25 additions & 22 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -101,6 +101,9 @@ An Azure blob storage (ABS) account contains all of your ABS objects: blobs, fil
101
101
#### user_p
102
102
Role created by user visible on the cluster.
103
103
104
+
> [!Note]
105
+
> `account_user_add`,`account_add`,`account_remove`,`account_user_remove` functions require setting permissions for each individual nodes in cluster.
106
+
104
107
## azure_storage.account_user_remove
105
108
The function allows removing access for a role to a storage account.
106
109
@@ -209,7 +212,7 @@ azure_storage.blob_get
209
212
)
210
213
RETURNS SETOF record;
211
214
```
212
-
There is an overloaded version of function, containing rec parameter which allows you to conveniently define the output format record.
215
+
There's an overloaded version of function, containing rec parameter that allows you to conveniently define the output format record.
213
216
```postgresql
214
217
azure_storage.blob_get
215
218
(account_name text
@@ -245,9 +248,9 @@ Decoder can be set to auto (default) or any of the following values
245
248
| text | A file containing a single text value (for example, large JSON or XML) |
246
249
247
250
#### compression
248
-
defines the compression format. Available options are `auto`, `gzip` & `none`. The use of the `auto` option (default), guesses the compression based on the file extension (.gz == gzip). The option none forces to ignore the extension and not attempt to decode and gzip forces using the gzip decoder (for when you have a gzipped file with a non-standard extension). We currently don't support any other compression formats for the extension.
251
+
defines the compression format. Available options are `auto`, `gzip` & `none`. The use of the `auto` option (default), guesses the compression based on the file extension (.gz == gzip). The option `none` forces to ignore the extension and not attempt to decode. While gzip forces using the gzip decoder (for when you have a gzipped file with a non-standard extension). We currently don't support any other compression formats for the extension.
249
252
#### options
250
-
for handling custom headers, custom separators, escape characters etc., `options` works in similar fashion to `COPY` command in PostgreSQL, parameter utilises to blob_get function.
253
+
for handling custom headers, custom separators, escape characters etc., `options` works in similar fashion to `COPY` command in PostgreSQL, parameter utilizes to blob_get function.
251
254
252
255
### Return Type
253
256
SETOF Record
@@ -256,7 +259,7 @@ SETOF Record
256
259
> There are four utility functions, called as a parameter within blob_get that help building values for it. Each utility function is designated for the decoder matching its name.
257
260
258
261
## azure_storage.options_csv_get
259
-
The function acts as a utility function called as a parameter within blob_get. This is useful for decoding the csv content.
262
+
The function acts as a utility function called as a parameter within blob_get, which is useful for decoding the csv content.
260
263
261
264
```postgresql
262
265
azure_storage.options_csv_get
@@ -274,7 +277,7 @@ Returns jsonb;
274
277
275
278
### Arguments
276
279
#### delimiter
277
-
Specifies the character that separates columns within each row (line) of the file. The default is a tab character in text format, a comma in CSV format. This must be a single one-byte character.
280
+
Specifies the character that separates columns within each row (line) of the file. The default is a tab character in text format, a comma in CSV format. It must be a single one-byte character.
278
281
279
282
#### null_string
280
283
Specifies the string that represents a null value. The default is \N (backslash-N) in text format, and an unquoted empty string in CSV format. You might prefer an empty string even in text format for cases where you don't want to distinguish nulls from empty strings.
@@ -283,19 +286,19 @@ Specifies the string that represents a null value. The default is \N (backslash-
283
286
Specifies that the file contains a header line with the names of each column in the file. On output, the first line contains the column names from the table.
284
287
285
288
#### quote
286
-
Specifies the quoting character to be used when a data value is quoted. The default is double-quote. This must be a single one-byte character.
289
+
Specifies the quoting character to be used when a data value is quoted. The default is double-quote. It must be a single one-byte character.
287
290
288
291
#### escape
289
-
Specifies the character that should appear before a data character that matches the QUOTE value. The default is the same as the QUOTE value (so that the quoting character is doubled if it appears in the data). This must be a single one-byte character.
292
+
Specifies the character that should appear before a data character that matches the QUOTE value. The default is the same as the QUOTE value (so that the quoting character is doubled if it appears in the data). It must be a single one-byte character.
290
293
291
294
#### force_not_null
292
-
Do not match the specified columns' values against the null string. In the default case where the null string is empty, this means that empty values will be read as zero-length strings rather than nulls, even when they are not quoted.
295
+
Don't match the specified columns' values against the null string. In the default case where the null string is empty, it means that empty values are read as zero-length strings rather than nulls, even when they aren't quoted.
293
296
294
297
#### force_null
295
-
Match the specified columns' values against the null string, even if it has been quoted, and if a match is found set the value to NULL. In the default case where the null string is empty, this converts a quoted empty string into NULL.
298
+
Match the specified columns' values against the null string, even if it has been quoted, and if a match is found set the value to NULL. In the default case where the null string is empty, it converts a quoted empty string into NULL.
296
299
297
300
#### content_encoding
298
-
Specifies that the file is encoded in the encoding_name. If this option is omitted, the current client encoding is used.
301
+
Specifies that the file is encoded in the encoding_name. If the option is omitted, the current client encoding is used.
299
302
300
303
### Return Type
301
304
jsonb
@@ -320,7 +323,7 @@ Returns jsonb;
320
323
321
324
### Arguments
322
325
#### delimiter
323
-
Specifies the character that separates columns within each row (line) of the file. The default is a tab character in text format, a comma in CSV format. This must be a single one-byte character.
326
+
Specifies the character that separates columns within each row (line) of the file. The default is a tab character in text format, a comma in CSV format. It must be a single one-byte character.
324
327
325
328
#### null_string
326
329
Specifies the string that represents a null value. The default is \N (backslash-N) in text format, and an unquoted empty string in CSV format. You might prefer an empty string even in text format for cases where you don't want to distinguish nulls from empty strings.
@@ -329,28 +332,28 @@ Specifies the string that represents a null value. The default is \N (backslash-
329
332
Specifies that the file contains a header line with the names of each column in the file. On output, the first line contains the column names from the table.
330
333
331
334
#### quote
332
-
Specifies the quoting character to be used when a data value is quoted. The default is double-quote. This must be a single one-byte character.
335
+
Specifies the quoting character to be used when a data value is quoted. The default is double-quote. It must be a single one-byte character.
333
336
334
337
#### escape
335
-
Specifies the character that should appear before a data character that matches the QUOTE value. The default is the same as the QUOTE value (so that the quoting character is doubled if it appears in the data). This must be a single one-byte character.
338
+
Specifies the character that should appear before a data character that matches the QUOTE value. The default is the same as the QUOTE value (so that the quoting character is doubled if it appears in the data). It must be a single one-byte character.
336
339
337
340
#### force_quote
338
-
Forces quoting to be used for all non-NULL values in each specified column. NULL output is never quoted. If * is specified, non-NULL values will be quoted in all columns.
341
+
Forces quoting to be used for all non-NULL values in each specified column. NULL output is never quoted. If * is specified, non-NULL values are quoted in all columns.
339
342
340
343
#### force_not_null
341
-
Do not match the specified columns' values against the null string. In the default case where the null string is empty, this means that empty values will be read as zero-length strings rather than nulls, even when they are not quoted.
344
+
Don't match the specified columns' values against the null string. In the default case where the null string is empty, it means that empty values are read as zero-length strings rather than nulls, even when they aren't quoted.
342
345
343
346
#### force_null
344
-
Match the specified columns' values against the null string, even if it has been quoted, and if a match is found set the value to NULL. In the default case where the null string is empty, this converts a quoted empty string into NULL.
347
+
Match the specified columns' values against the null string, even if it has been quoted, and if a match is found set the value to NULL. In the default case where the null string is empty, it converts a quoted empty string into NULL.
345
348
346
349
#### content_encoding
347
-
Specifies that the file is encoded in the encoding_name. If this option is omitted, the current client encoding is used.
350
+
Specifies that the file is encoded in the encoding_name. If the option is omitted, the current client encoding is used.
348
351
349
352
### Return Type
350
353
jsonb
351
354
352
355
## azure_storage.options_tsv
353
-
The function acts as a utility function called as a parameter within blob_get. This is useful for decoding the tsv content.
356
+
The function acts as a utility function called as a parameter within blob_get. It's useful for decoding the tsv content.
354
357
355
358
```postgresql
356
359
azure_storage.options_tsv
@@ -363,19 +366,19 @@ Returns jsonb;
363
366
364
367
### Arguments
365
368
#### delimiter
366
-
Specifies the character that separates columns within each row (line) of the file. The default is a tab character in text format, a comma in CSV format. This must be a single one-byte character.
369
+
Specifies the character that separates columns within each row (line) of the file. The default is a tab character in text format, a comma in CSV format. It must be a single one-byte character.
367
370
368
371
#### null_string
369
372
Specifies the string that represents a null value. The default is \N (backslash-N) in text format, and an unquoted empty string in CSV format. You might prefer an empty string even in text format for cases where you don't want to distinguish nulls from empty strings.
370
373
371
374
#### content_encoding
372
-
Specifies that the file is encoded in the encoding_name. If this option is omitted, the current client encoding is used.
375
+
Specifies that the file is encoded in the encoding_name. If the option is omitted, the current client encoding is used.
373
376
374
377
### Return Type
375
378
jsonb
376
379
377
380
## azure_storage.options_binary
378
-
The function acts as a utility function called as a parameter within blob_get. This is useful for decoding the binary content.
381
+
The function acts as a utility function called as a parameter within blob_get. It's useful for decoding the binary content.
379
382
380
383
```postgresql
381
384
azure_storage.options_binary
@@ -498,7 +501,7 @@ LIMIT 5;
498
501
```
499
502
500
503
### Use compression with decoder option
501
-
The example below shows how to enforce using the gzip compression on a gzip compressed file without a standard .gz extension..
504
+
The example shows how to enforce using the gzip compression on a gzip compressed file without a standard .gz extension.
0 commit comments