Skip to content

Latest commit

 

History

History
237 lines (236 loc) · 6.8 KB

File metadata and controls

237 lines (236 loc) · 6.8 KB

Lake Pulse Storage Support

Storage Backend Support Notes
Standard Protocols
HTTP/WebDAV WebDAV extends HTTP with file operations (RFC 2518)
HTTP/WebDAV Configuration
FTP
SFTP/SSH
Major Cloud Object Storage
AWS S3 (and compatible) See AWS S3 Configuration
Azure Blob Storage See Azure Configuration
Azure Data Lake Storage Gen2 Supports both standard and Fabric endpoints
See Azure Configuration
Google Cloud Storage See GCP Configuration
Other Cloud Object Storage
Alibaba Cloud OSS Use AWS config with custom endpoint
See AWS S3 Configuration
Backblaze B2 Use AWS config with custom endpoint
See AWS S3 Configuration
Ceph Use AWS config with custom endpoint
See AWS S3 Configuration
Cloudflare R2 Use AWS config with custom endpoint
See AWS S3 Configuration
Huawei OBS Use AWS config with custom endpoint
See AWS S3 Configuration
MinIO Use AWS config with custom endpoint
See AWS S3 Configuration
OpenStack Swift Use AWS config with custom endpoint
See AWS S3 Configuration
Tencent Cloud COS Use AWS config with custom endpoint
See AWS S3 Configuration
Upyun
Vercel Blob
File Systems
Local filesystem
HDFS Via hdfs-native-object-store crate
See HDFS Configuration
Alluxio
Azure Files
Databricks DBFS
IPFS
MongoDB GridFS
WebHDFS
Consumer Cloud Storage
Aliyun Drive
Dropbox
Google Drive
Koofr
OneDrive
pCloud
Seafile
Yandex Disk