You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/connectors.md
+19Lines changed: 19 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -131,6 +131,7 @@ This source manages the receiving of objects from AWS S3 or IBM Cloud Object Sto
131
131
-`endpoint` the name of the public endpoint from the bucket configuration qualified by the URI scheme (for example, `https://`);
132
132
-`region` (optional) the region of the bucket, if left empty the region will be automatically parsed by Rayvens from the endpoint;
133
133
-`move_after_read` (optional) enables moving of any read file from bucket specified by `bucket_name` to new bucket that is the value of this field. If using the Cloud Object Storage, the new bucket has to be created ahead of time. The new bucket name is provided as the value of this field;
134
+
-`meta_event_only` (optional) this option only allows for the filename to be propagated;
134
135
135
136
This source will fetch and delete the files in the bucket unless the `move_after_read` option is enabled in which case the read files are moved to the bucket specified by the `move_after_read` field value.
Convert the event to JSON when handling the event:
164
+
165
+
```
166
+
import json
167
+
json_event = json.loads(event)
168
+
```
169
+
and then access its field like so:
170
+
```
171
+
json_event['filename']
172
+
json_event['body']
173
+
```
174
+
156
175
### `kind="file-source"`
157
176
158
177
This source reads a file from the file system when the file becomes available. The event is triggered automatically whenever the file becomes available. The file content is read to memory and returned by the source to be processed further by the application. This source has the following options:
0 commit comments