You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+8Lines changed: 8 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -118,8 +118,16 @@ source:
118
118
# only actually needed if source type is hdfs
119
119
azure:
120
120
# azure options
121
+
index:
122
+
# Interval to fully synchronize the index with the source storage
123
+
fullSyncInterval: 3600
124
+
# Interval to sync empty directories with.
125
+
# They are also synced during a full sync.
126
+
emptyDirectorySyncInterval: 900
121
127
```
122
128
129
+
The index makes a scan of the source before any operations. Further list operations are done on the index only. This is especially relevant for S3 storage where list operations are priced.
130
+
123
131
The target is similar, and in addition supports the local file system (`local`).
0 commit comments