-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Currently, the downloader middleware supports reading WACZ files from local storage and Amazon S3. To enhance the flexibility of the middleware, it would be beneficial to add support for reading WACZ files stored in Google Cloud Storage (GCS).
Proposed Changes
Implement a new GCSZipStorageHandler class extending the ZipStorageHandler base class.
Use the Google Cloud Storage API to fetch files and metadata using range requests for optimal performance. Update the ZipStorageHandlerFactory to recognize gs:// URIs and return the GCSZipStorageHandler.
Tasks
- Create
GCSZipStorageHandlerwith methods for fetching files and metadata. - Update the
ZipStorageHandlerFactoryto handlegs://URIs. - Write unit tests for GCSZipStorageHandler.
- Update documentation to include GCS support.
- Create
GCSFileResolverwith methods for resolving files matching a regex pattern.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request