You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -291,22 +291,22 @@ This table outlines the general file I/O configuration properties for SwiftLake.
291
291
|`io.file-system-cache.max-total-bytes`| 536,870,912 (512 MiB) | Sets the maximum total bytes for the I/O file system cache |
292
292
|`io.file-system-cache.expiration-interval-seconds`| 172,800 (2 days) | Sets the I/O file system cache expiration interval in seconds |
293
293
|`delegate-io-impl`| - | Specifies the delegate file I/O implementation class |
294
-
|`cache-io-provider`|<code>com.arcesium.swiftlake.io.<br>SingletonCacheFileIOProvider</code>| Specifies the cache file I/O provider class |
294
+
|`cache-io-provider`| com.arcesium.swiftlake.io.<br>SingletonCacheFileIOProvider | Specifies the cache file I/O provider class |
295
295
|`metric-collector-provider`| - | Specifies the metric collector provider class |
296
296
297
297
#### SwiftLakeS3FileIOProperties
298
298
This table presents the S3-specific configuration properties for SwiftLake. These properties are used to configure the connection to Amazon S3 or S3-compatible storage services.
|`s3.crt.target-throughput-gbps`| 10.0 | Target throughput in Gbps for the S3 CRT (Common Runtime) client. This setting helps optimize performance when creating the S3 CRT client. |
303
-
|`s3.crt.max-concurrency`| - | Maximum number of concurrent requests for the S3 CRT client. Used to control the level of parallelism in S3 operations. |
304
-
|`s3.crt.max-native-memory-limit-bytes`| - | Maximum native memory limit in bytes for the S3 CRT client. Helps manage memory usage of the client. |
305
-
|`s3.crt.multipart.threshold-bytes`| - | Threshold in bytes for switching to multipart uploads in the S3 CRT client. Files larger than this size will use multipart uploads. |
306
-
|`s3.transfer-manager-provider`|<code>com.arcesium.swiftlake.aws.<br>SingletonS3TransferManagerProvider</code>| Specifies the class name for the S3 transfer manager provider. This class is responsible for creating and managing S3TransferManager instances. |
307
-
|`s3.transfer-manager-provider.*`| - | Prefix for additional properties specific to the configured S3 transfer manager provider. These properties are passed to the provider during initialization. |
308
-
|`s3.duckdb.s3-extension-enabled`| false | Enables or disables the DuckDB S3 extension integration. When true, allows for direct querying of S3 data using DuckDB. |
309
-
|`s3.duckdb.s3-extension-threshold-bytes`| - | Minimum file size (in bytes) for using DuckDB S3 integration. If the file size is greater than or equal to this value, DuckDB S3 integration is used. |
|`s3.crt.target-throughput-gbps`| 10.0 | Target throughput in Gbps for the S3 CRT (Common Runtime) client. This setting helps optimize performance when creating the S3 CRT client. |
303
+
|`s3.crt.max-concurrency`| - | Maximum number of concurrent requests for the S3 CRT client. Used to control the level of parallelism in S3 operations. |
304
+
|`s3.crt.max-native-memory-limit-bytes`| - | Maximum native memory limit in bytes for the S3 CRT client. Helps manage memory usage of the client. |
305
+
|`s3.crt.multipart.threshold-bytes`| - | Threshold in bytes for switching to multipart uploads in the S3 CRT client. Files larger than this size will use multipart uploads. |
306
+
|`s3.transfer-manager-provider`| com.arcesium.swiftlake.aws.<br>SingletonS3TransferManagerProvider | Specifies the class name for the S3 transfer manager provider. This class is responsible for creating and managing S3TransferManager instances. |
307
+
|`s3.transfer-manager-provider.*`| - | Prefix for additional properties specific to the configured S3 transfer manager provider. These properties are passed to the provider during initialization. |
308
+
|`s3.duckdb.s3-extension-enabled`| false | Enables or disables the DuckDB S3 extension integration. When true, allows for direct querying of S3 data using DuckDB. |
309
+
|`s3.duckdb.s3-extension-threshold-bytes`| - | Minimum file size (in bytes) for using DuckDB S3 integration. If the file size is greater than or equal to this value, DuckDB S3 integration is used. |
310
310
311
311
#### Configuring Caching
312
312
To enable and configure caching when creating a catalog, you can use the following properties:
0 commit comments