You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
| type | The type property under `storeSettings` must be set to **AmazonS3ReadSetting**. | Yes |
152
+
| type | The type property under `storeSettings` must be set to **AmazonS3ReadSettings**. | Yes |
153
153
| recursive | Indicates whether the data is read recursively from the subfolders or only from the specified folder. Note that when recursive is set to true and the sink is a file-based store, an empty folder or subfolder isn't copied or created at the sink. Allowed values are **true** (default) and **false**. | No |
154
154
| prefix | Prefix for the S3 object key under the given bucket configured in dataset to filter source objects. Objects whose keys start with this prefix are selected. <br>Applies only when `wildcardFolderPath` and `wildcardFileName` properties are not specified. | No |
155
155
| wildcardFolderPath | The folder path with wildcard characters under the given bucket configured in dataset to filter source folders. <br>Allowed wildcards are: `*` (matches zero or more characters) and `?` (matches zero or single character); use `^` to escape if your actual folder name has wildcard or this escape char inside. <br>See more examples in [Folder and file filter examples](#folder-and-file-filter-examples). | No |
@@ -181,11 +181,11 @@ The following properties are supported for Amazon S3 under `storeSettings` setti
| type | The type property under `storeSettings` must be set to **AzureBlobStorageReadSetting**. | Yes |
361
+
| type | The type property under `storeSettings` must be set to **AzureBlobStorageReadSettings**. | Yes |
362
362
| recursive | Indicates whether the data is read recursively from the subfolders or only from the specified folder. Note that when recursive is set to true and the sink is a file-based store, an empty folder or subfolder isn't copied or created at the sink. Allowed values are **true** (default) and **false**. | No |
363
363
| wildcardFolderPath | The folder path with wildcard characters under the given container configured in dataset to filter source folders. <br>Allowed wildcards are: `*` (matches zero or more characters) and `?` (matches zero or single character); use `^` to escape if your actual folder name has wildcard or this escape char inside. <br>See more examples in [Folder and file filter examples](#folder-and-file-filter-examples). | No |
364
364
| wildcardFileName | The file name with wildcard characters under the given container + folderPath/wildcardFolderPath to filter source files. <br>Allowed wildcards are: `*` (matches zero or more characters) and `?` (matches zero or single character); use `^` to escape if your actual folder name has wildcard or this escape char inside. See more examples in [Folder and file filter examples](#folder-and-file-filter-examples). | Yes if `fileName` is not specified in dataset |
@@ -392,11 +392,11 @@ The following properties are supported for Azure Blob under `storeSettings` sett
392
392
"source": {
393
393
"type": "DelimitedTextSource",
394
394
"formatSettings":{
395
-
"type": "DelimitedTextReadSetting",
395
+
"type": "DelimitedTextReadSettings",
396
396
"skipLineCount": 10
397
397
},
398
398
"storeSettings":{
399
-
"type": "AzureBlobStorageReadSetting",
399
+
"type": "AzureBlobStorageReadSettings",
400
400
"recursive": true,
401
401
"wildcardFolderPath": "myfolder*A",
402
402
"wildcardFileName": "*.csv"
@@ -418,7 +418,7 @@ The following properties are supported for Azure Blob under `storeSettings` sett
| type | The type property under `storeSettings` must be set to **AzureBlobStorageWriteSetting**. | Yes |
421
+
| type | The type property under `storeSettings` must be set to **AzureBlobStorageWriteSettings**. | Yes |
422
422
| copyBehavior | Defines the copy behavior when the source is files from a file-based data store.<br/><br/>Allowed values are:<br/><b>- PreserveHierarchy (default)</b>: Preserves the file hierarchy in the target folder. The relative path of source file to source folder is identical to the relative path of target file to target folder.<br/><b>- FlattenHierarchy</b>: All files from the source folder are in the first level of the target folder. The target files have autogenerated names. <br/><b>- MergeFiles</b>: Merges all files from the source folder to one file. If the file or blob name is specified, the merged file name is the specified name. Otherwise, it's an autogenerated file name. | No |
423
423
| maxConcurrentConnections | The number of the connections to connect to storage store concurrently. Specify only when you want to limit the concurrent connection to the data store. | No |
424
424
@@ -448,7 +448,7 @@ The following properties are supported for Azure Blob under `storeSettings` sett
| type | The type property under `storeSettings` must be set to **AzureBlobFSReadSetting**. | Yes |
253
+
| type | The type property under `storeSettings` must be set to **AzureBlobFSReadSettings**. | Yes |
254
254
| recursive | Indicates whether the data is read recursively from the subfolders or only from the specified folder. When recursive is set to true and the sink is a file-based store, an empty folder or subfolder isn't copied or created at the sink. Allowed values are **true** (default) and **false**. | No |
255
255
| wildcardFolderPath | The folder path with wildcard characters under the given file system configured in dataset to filter source folders. <br>Allowed wildcards are `*` (matches zero or more characters) and `?` (matches zero or single character). Use `^` to escape if your actual folder name has a wildcard or this escape char inside. <br>See more examples in [Folder and file filter examples](#folder-and-file-filter-examples). | No |
256
256
| wildcardFileName | The file name with wildcard characters under the given file system + folderPath/wildcardFolderPath to filter source files. <br>Allowed wildcards are `*` (matches zero or more characters) and `?` (matches zero or single character). Use `^` to escape if your actual folder name has a wildcard or this escape char inside. See more examples in [Folder and file filter examples](#folder-and-file-filter-examples). | Yes if `fileName` isn't specified in dataset |
@@ -281,11 +281,11 @@ The following properties are supported for Data Lake Storage Gen2 under `storeSe
281
281
"source": {
282
282
"type": "DelimitedTextSource",
283
283
"formatSettings":{
284
-
"type": "DelimitedTextReadSetting",
284
+
"type": "DelimitedTextReadSettings",
285
285
"skipLineCount": 10
286
286
},
287
287
"storeSettings":{
288
-
"type": "AzureBlobFSReadSetting",
288
+
"type": "AzureBlobFSReadSettings",
289
289
"recursive": true,
290
290
"wildcardFolderPath": "myfolder*A",
291
291
"wildcardFileName": "*.csv"
@@ -307,7 +307,7 @@ The following properties are supported for Data Lake Storage Gen2 under `storeSe
| type | The type property under `storeSettings` must be set to **AzureBlobFSWriteSetting**. | Yes |
310
+
| type | The type property under `storeSettings` must be set to **AzureBlobFSWriteSettings**. | Yes |
311
311
| copyBehavior | Defines the copy behavior when the source is files from a file-based data store.<br/><br/>Allowed values are:<br/><b>- PreserveHierarchy (default)</b>: Preserves the file hierarchy in the target folder. The relative path of the source file to the source folder is identical to the relative path of the target file to the target folder.<br/><b>- FlattenHierarchy</b>: All files from the source folder are in the first level of the target folder. The target files have autogenerated names. <br/><b>- MergeFiles</b>: Merges all files from the source folder to one file. If the file name is specified, the merged file name is the specified name. Otherwise, it's an autogenerated file name. | No |
312
312
| maxConcurrentConnections | The number of connections to connect to the data store concurrently. Specify only when you want to limit the concurrent connection to the data store. | No |
313
313
@@ -337,7 +337,7 @@ The following properties are supported for Data Lake Storage Gen2 under `storeSe
| type | The type property under `storeSettings` must be set to **AzureDataLakeStoreReadSetting**. | Yes |
200
+
| type | The type property under `storeSettings` must be set to **AzureDataLakeStoreReadSettings**. | Yes |
201
201
| recursive | Indicates whether the data is read recursively from the subfolders or only from the specified folder. When recursive is set to true and the sink is a file-based store, an empty folder or subfolder isn't copied or created at the sink. Allowed values are **true** (default) and **false**. | No |
202
202
| wildcardFolderPath | The folder path with wildcard characters to filter source folders. <br>Allowed wildcards are `*` (matches zero or more characters) and `?` (matches zero or single character). Use `^` to escape if your actual folder name has a wildcard or this escape char inside. <br>See more examples in [Folder and file filter examples](#folder-and-file-filter-examples). | No |
203
203
| wildcardFileName | The file name with wildcard characters under the given folderPath/wildcardFolderPath to filter source files. <br>Allowed wildcards are `*` (matches zero or more characters) and `?` (matches zero or single character). Use `^` to escape if your actual folder name has a wildcard or this escape char inside. See more examples in [Folder and file filter examples](#folder-and-file-filter-examples). | Yes if `fileName` isn't specified in dataset |
@@ -228,11 +228,11 @@ The following properties are supported for Azure Data Lake Store Gen1 under `sto
228
228
"source": {
229
229
"type": "DelimitedTextSource",
230
230
"formatSettings":{
231
-
"type": "DelimitedTextReadSetting",
231
+
"type": "DelimitedTextReadSettings",
232
232
"skipLineCount": 10
233
233
},
234
234
"storeSettings":{
235
-
"type": "AzureDataLakeStoreReadSetting",
235
+
"type": "AzureDataLakeStoreReadSettings",
236
236
"recursive": true,
237
237
"wildcardFolderPath": "myfolder*A",
238
238
"wildcardFileName": "*.csv"
@@ -254,7 +254,7 @@ The following properties are supported for Azure Data Lake Store Gen1 under `sto
| type | The type property under `storeSettings` must be set to **AzureDataLakeStoreWriteSetting**. | Yes |
257
+
| type | The type property under `storeSettings` must be set to **AzureDataLakeStoreWriteSettings**. | Yes |
258
258
| copyBehavior | Defines the copy behavior when the source is files from a file-based data store.<br/><br/>Allowed values are:<br/><b>- PreserveHierarchy (default)</b>: Preserves the file hierarchy in the target folder. The relative path of the source file to the source folder is identical to the relative path of the target file to the target folder.<br/><b>- FlattenHierarchy</b>: All files from the source folder are in the first level of the target folder. The target files have autogenerated names. <br/><b>- MergeFiles</b>: Merges all files from the source folder to one file. If the file name is specified, the merged file name is the specified name. Otherwise, it's an autogenerated file name. | No |
259
259
| maxConcurrentConnections | The number of connections to connect to the data store concurrently. Specify only when you want to limit the concurrent connection to the data store. | No |
260
260
@@ -284,7 +284,7 @@ The following properties are supported for Azure Data Lake Store Gen1 under `sto
0 commit comments