You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-`#secretAccessKey`: Secret access key (will be encrypted)
132
132
-`regionName`: Region
133
133
134
-
-`exports`: array of exports
135
-
-`id`: unique numeric identifier of export
136
-
-`name`: unique string identifier of export (base table will be named after it)
137
-
-`table`: name of the table to export from
138
-
-`index`: (optional)name of the index to export from
139
-
-`enabled` (optional, default: `true`): if export is enabled or not (there has to be at least one enabled export)
140
-
-`incremental`: if load of tables to storage will be incremental
141
-
-`primaryKey`: primary key to set on imported table, defined as array
142
-
-`mode`: (optional): enum(scan|query)reading mode from dynamoDb - default is scan
143
-
-`keyConditionExpression`: (required): provide a specific value for the partition key
144
-
-`expressionAttributeValues`: (required): values that can be substituted in an expression
145
-
-`expressionAttributeNames`: (optional): substitution tokens for attribute names in an expression. You can use placeholder `$` instead of `#` see sample
146
-
-`dateFilter` (optional): how to filter scanned documents (only for scan mode)
147
-
-`field`: field name in document by which you want to filter
148
-
-`format`: date format (e.g. `Y-m-d` for date or `Y` for year)
149
-
-`value`: date string from which date value will be created (e.g. `-2 days`)
150
-
-`limit` (optional): how many documents you want to export
151
-
-`mapping`: how to map fields in document to CSV columns
134
+
-`exports`: An array of export configurations.
135
+
-`id`: A unique numeric identifier for the export.
136
+
-`name`: A unique string identifier for the export (the base table will be named after it).
137
+
-`table`: The name of the table to export from.
138
+
-`index` (optional): The name of the index to export from.
139
+
-`enabled` (optional, default: `true`): Specifies whether the export is enabled. (At least one export must be enabled.)
140
+
-`incremental`: Determines whether tables loads to Storage will be incremental.
141
+
-`primaryKey`: The primary key to set on the imported table, defined as an array.
142
+
-`mode` (optional): enum(scan|query): The reading mode from DynamoDB. Default: `scan`.
143
+
-`keyConditionExpression` (required): Specifies a specific value for the partition key.
144
+
-`expressionAttributeValues` (required): Defines values that can be substituted in an expression.
145
+
-`expressionAttributeNames` (optional): Substitution tokens for attribute names in an expression. You can use the placeholder `$` instead of `#`(see sample).
146
+
-`dateFilter` (optional): Defines how to filter scanned documents. *(Applicable only for scan mode.)*
147
+
-`field`: The document field name used for filtering.
148
+
-`format`: The date format (e.g.,`Y-m-d` for a full date or `Y` for a year).
149
+
-`value`: The relative date string from which date value will be calculated (e.g.,`-2 days`).
150
+
-`limit` (optional): Specifies how many documents to export.
151
+
-`mapping`: Defines how document fields should be mapped to CSV columns.
152
152
153
153
154
154
### `dateFilter`
155
155
156
-
*Note: To be able to use `dateFilter` and incremental loads, make sure your database (or index)
157
-
contains field by which documents can be filtered. E.g. add `creationDate` to every document you create*
156
+
***Note:** To use `dateFilter` and incremental loads, make sure that your database (or index)
157
+
contains a field that can be used for filtering documents. For example, add a `creationDate`field to every document you create.*
158
158
159
-
Extractor uses `Scan` operation to selecting documents from DynamoDB.
159
+
The extractor uses the `Scan` operation to select documents from DynamoDB.
160
160
161
-
You can specify `dateFilter` parameter to filter documents you want export. Filter condition is
162
-
composed from 3 fields: `field`, `format` and `value`.
161
+
You can specify the `dateFilter` parameter to filter the documents you want export. The filter condition is
162
+
composed of three fields: `field`, `format`, and `value`.
163
163
164
-
The `value` field is passed to [**strtotime**](https://secure.php.net/strtotime) function. Then the
165
-
`format` and `value` fields are passed to [**date**](https://secure.php.net/date) function to create
166
-
final value which will be used to filter documents. Something like`date($format, strtotime($value))`.
164
+
The `value` field is passed to the [**strtotime**](https://secure.php.net/strtotime) function. Then, the
165
+
`format` and `value` fields are passed to the [**date**](https://secure.php.net/date) function to generate the
166
+
final value, which will be used to filter documents. The equivalent function call is:`date($format, strtotime($value))`.
167
167
168
168
#### Example
169
169
170
-
(for date `2018-03-13 18:00:00`)
170
+
(For date `2018-03-13 18:00:00`)
171
171
172
172
|field|format|value|composed condition|
173
173
|---|---|---|---|
@@ -178,13 +178,13 @@ final value which will be used to filter documents. Something like `date($format
178
178
179
179
### `mapping`
180
180
181
-
-[php-csvmap](https://github.com/keboola/php-csvmap) library is used to parse exported documents
182
-
-in most cases you'll be happy with simple `"some.path.key": "destination"`mapping
183
-
-for advanced usages please check documentation of mapping sections of in
184
-
[MongoDB Extractor](https://help.keboola.com/extractors/database/mongodb/mapping/) or
0 commit comments