Skip to content

Commit e17bce3

Browse files
andygrovecomphead
andauthored
docs: Add note about Root CA Certificate location with native scans (#2325)
* Add note about Root CA Certificate location with native scans * Add note about Root CA Certificate location with native scans * Add note about Root CA Certificate location with native scans * Update datasources.md Co-authored-by: Oleks V <[email protected]> * address feedback --------- Co-authored-by: Oleks V <[email protected]>
1 parent e129da2 commit e17bce3

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

docs/source/user-guide/latest/datasources.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -175,6 +175,14 @@ The `native_datafusion` and `native_iceberg_compat` Parquet scan implementations
175175

176176
This implementation maintains compatibility with existing Hadoop S3A configurations, so existing code will continue to work as long as the configurations are supported and can be translated without loss of functionality.
177177

178+
#### Root CA Certificates
179+
180+
One major difference between `native_comet` and the other scan implementations is the mechanism for discovering Root
181+
CA Certificates. The `native_comet` scan uses the JVM to read CA Certificates from the Java Trust Store, but the native
182+
scan implementations `native_datafusion` and `native_iceberg_compat` use system Root CA Certificates (typically stored
183+
in `/etc/ssl/certs` on Linux). These scans will not be able to interact with S3 if the Root CA Certificates are not
184+
installed.
185+
178186
#### Supported Credential Providers
179187

180188
AWS credential providers can be configured using the `fs.s3a.aws.credentials.provider` configuration. The following table shows the supported credential providers and their configuration options:

0 commit comments

Comments
 (0)