Skip to content

Commit 7f8cdd3

Browse files
rashtaoSimran-B
andauthored
[DE-616] Spark: ttl (#500)
* Spark: ttl * Review --------- Co-authored-by: Simran Spiller <[email protected]>
1 parent a1f6a39 commit 7f8cdd3

File tree

4 files changed

+4
-0
lines changed

4 files changed

+4
-0
lines changed

site/content/3.10/develop/integrations/arangodb-datasource-for-apache-spark.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,7 @@ usersDF.filter(col("birthday") === "1982-12-15").show()
150150
- `sampleSize`: sample size prefetched for schema inference, only used if read schema is not provided, `1000` by default
151151
- `fillBlockCache`: specifies whether the query should store the data it reads in the RocksDB block cache (`true` or `false`), `false` by default
152152
- `stream`: specifies whether the query should be executed lazily, `true` by default
153+
- `ttl`: cursor time to live in seconds, `30` by default
153154
- `mode`: allows setting a mode for dealing with corrupt records during parsing:
154155
- `PERMISSIVE` : win case of a corrupted record, the malformed string is put into a field configured by
155156
`columnNameOfCorruptRecord`, and sets malformed fields to null. To keep corrupt records, a user can set a string

site/content/3.11/develop/integrations/arangodb-datasource-for-apache-spark.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,7 @@ usersDF.filter(col("birthday") === "1982-12-15").show()
150150
- `sampleSize`: sample size prefetched for schema inference, only used if read schema is not provided, `1000` by default
151151
- `fillBlockCache`: specifies whether the query should store the data it reads in the RocksDB block cache (`true` or `false`), `false` by default
152152
- `stream`: specifies whether the query should be executed lazily, `true` by default
153+
- `ttl`: cursor time to live in seconds, `30` by default
153154
- `mode`: allows setting a mode for dealing with corrupt records during parsing:
154155
- `PERMISSIVE` : win case of a corrupted record, the malformed string is put into a field configured by
155156
`columnNameOfCorruptRecord`, and sets malformed fields to null. To keep corrupt records, a user can set a string

site/content/3.12/develop/integrations/arangodb-datasource-for-apache-spark.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,7 @@ usersDF.filter(col("birthday") === "1982-12-15").show()
150150
- `sampleSize`: sample size prefetched for schema inference, only used if read schema is not provided, `1000` by default
151151
- `fillBlockCache`: specifies whether the query should store the data it reads in the RocksDB block cache (`true` or `false`), `false` by default
152152
- `stream`: specifies whether the query should be executed lazily, `true` by default
153+
- `ttl`: cursor time to live in seconds, `30` by default
153154
- `mode`: allows setting a mode for dealing with corrupt records during parsing:
154155
- `PERMISSIVE` : win case of a corrupted record, the malformed string is put into a field configured by
155156
`columnNameOfCorruptRecord`, and sets malformed fields to null. To keep corrupt records, a user can set a string

site/content/4.0/develop/integrations/arangodb-datasource-for-apache-spark.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,7 @@ usersDF.filter(col("birthday") === "1982-12-15").show()
150150
- `sampleSize`: sample size prefetched for schema inference, only used if read schema is not provided, `1000` by default
151151
- `fillBlockCache`: specifies whether the query should store the data it reads in the RocksDB block cache (`true` or `false`), `false` by default
152152
- `stream`: specifies whether the query should be executed lazily, `true` by default
153+
- `ttl`: cursor time to live in seconds, `30` by default
153154
- `mode`: allows setting a mode for dealing with corrupt records during parsing:
154155
- `PERMISSIVE` : win case of a corrupted record, the malformed string is put into a field configured by
155156
`columnNameOfCorruptRecord`, and sets malformed fields to null. To keep corrupt records, a user can set a string

0 commit comments

Comments
 (0)